System

Abstract

A system is provided.SOLUTION: A system, comprising: means for collecting personal data and purpose data input by a user; means for analyzing the collected data and creating a customized generative artificial intelligence model based on user needs; means for registering the generative artificial intelligence model with a marketplace; means for purchasing the generative artificial intelligence model at the marketplace by another user; and means for operating the purchased generative artificial intelligence model in a user device to respond and generate data in response to user instructions.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional generative AI systems have had the problem of being unable to meet the specialized needs of each user, and only producing formulaic, mechanical results. Furthermore, these systems require specialized development, making it difficult for general users to easily create and utilize customized AI. Furthermore, the lack of a platform for sharing and selling generated AI models with other users has hindered the sharing of knowledge and models among users. The present invention aims to solve these problems by providing a system that allows users to easily create, share, and sell customizable AI models that meet their needs. [Means for solving the problem]

[0005] The present invention solves the above-mentioned problems by providing the following means: A system includes means for collecting personal data and objective data input by a user, means for analyzing the collected data and creating a generative AI model customized based on the user's needs, means for registering the generative AI model in a marketplace, means for other users to purchase the generative AI model on the marketplace, and means for the purchased generative AI model to operate within the user's device and respond and generate data in accordance with the user's instructions. Furthermore, by further including means for the user to interactively input personal data and objective data and means for the generative AI model to process various media inputs (images, voice, text, etc.), flexible generation and use of AI models tailored to user needs is realized.

[0006] A "user" is someone who uses the system to create, purchase, or use generative AI models.

[0007] "Personal data" refers to personal information and behavioral data about users, and is information used to generate customized AI models based on these.

[0008] "Purpose data" refers to data regarding the specific functions and uses that a user sets for a generated AI model.

[0009] "Means of collection" refers to the methods and technologies used to allow the system to acquire personal data and target data entered by users.

[0010] "Means of analysis" refers to the algorithms and processing techniques used to train and customize AI models based on collected personal data and objective data.

[0011] A "generative artificial intelligence model" is a generative AI that responds to the individual needs of users based on collected and analyzed data.

[0012] "Marketplace" refers to an online platform for sharing and selling generated AI models with other users.

[0013] "Means of Purchasing" refers to the transaction process for acquiring a Generative AI Model on the Marketplace.

[0014] "Operating means" refers to the technology that enables an AI model purchased or generated by a user to run within the user's device and respond or generate in response to user input or instructions.

[0015] "Media input" refers to an input method for handling data in various formats, such as images, audio, and text. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10]1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram illustrating a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0024] [First embodiment]

[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0037] The present invention is a system that allows users to create their own generative AI models and share and sell them with other users. This system includes the means described in the claims and provides users with a simple and effective environment for customizing and using generative AI models.

[0038] System Configuration

[0039] The system includes the following elements:

[0040] 1. Server: Responsible for generating, registering, and managing AI models and operating the marketplace.

[0041] 2. Device: The device (e.g., smartphone, tablet) used by a user to create, purchase, or use a generative AI bot.

[0042] 3. User: A person who creates conversational AI bots and shares or sells them to other users.

[0043] Explanation of program processing

[0044] Creating an AI Bot

[0045] User: Open the "Create AI Bot" menu in the LINE app and select "Create New."

[0046] User: Start the creation flow by selecting "Create New" on the AI ​​bot creation screen.

[0047] Terminal: Ask the user questions about the functionality they want the bot to have and prompt them for personal and objective data.

[0048] Terminal: Display the question "What would you like your bot to do?"

[0049] User: Enters the bot's functionality and detailed data.

[0050] User: Enter "I want to have a household accounting function. I want to visualize my monthly income and expenses in graphs."

[0051] Terminal: Collects input data and sends it to the server.

[0052] Terminal: Sends collected data to the server via API.

[0053] Server: Creates and customizes a generative AI model based on the received data.

[0054] Server: Runs the generation engine, trains the AI ​​model based on user data, and saves the model once customization is complete.

[0055] Server: Registers the completed AI model on the marketplace and notifies the user that registration is complete.

[0056] Server: Registers the model on the marketplace and sends a notification to the device saying "AI bot creation and registration completed."

[0057] On the device: Display a notification to the user that the model has been registered.

[0058] On your device: Display a notification that says "AI bot creation and registration complete."

[0059] Purchasing and Using AI Bots

[0060] User: Search for "Household Accounting Management AI" in the Marketplace and select it.

[0061] User: Use the Marketplace search function to find and select "Household Accounting Management AI."

[0062] User: Clicks the purchase button and enters the required payment information.

[0063] User: Clicks the purchase button and enters payment information to complete the purchase.

[0064] Server: Processes the purchase and sends the purchase information to the device after approval.

[0065] Server: Processes the purchase information and, once authorization is complete, sends the information to the device.

[0066] On the device: Display a purchase completion notification to the user.

[0067] On your device: Display a "Purchase complete" notification to the user.

[0068] Device: Download the purchased AI bot and integrate it into the chat screen.

[0069] Device: Download the AI ​​bot and add it to the user's chat screen.

[0070] User: Uses an AI bot to give instructions on managing household finances.

[0071] User: Texts "Visualize my spending this month."

[0072] Server: Receives user instructions, generates graphs based on income and expenditure data, and sends the results to the user's device.

[0073] Server: Analyzes the instructions and returns the results to the user's device.

[0074] Terminal: Displays the response to the user.

[0075] Terminal: Shows the user a "This Month's Spending Graph."

[0076] Specific examples

[0077] For example, if a user were to create a household accounting management AI, the process would be as follows: The user would input "I want a household accounting management function" and provide detailed income and expenditure data. The server would generate an AI model based on this data and register it on the marketplace. Other users could then purchase and use this AI model, improving the efficiency of their lives and work.

[0078] In this way, the present invention provides a system that allows users to easily create and use generative AI models that meet their needs, thereby effectively resolving conventional problems.

[0079] The processing flow will be explained below.

[0080] Creating an AI Bot

[0081] Step 1:

[0082] User: Open the "Create AI Bot" menu in the LINE app and select "Create New."

[0083] How it works: The user clicks the "Create New" button to begin the AI ​​bot creation flow.

[0084] Step 2:

[0085] Terminal: Asks the user about the functions they want the bot to have and prompts them to enter personal and objective data.

[0086] What it does: The device displays the question, "What functionality do you want your bot to have?"

[0087] Step 3:

[0088] User: Enters the bot's functionality, basic data, and purpose.

[0089] Operation: The user specifically inputs, "I want to have a household accounting function. I want to visualize my monthly income and expenses in graphs."

[0090] Step 4:

[0091] Terminal: Asks you to enter detailed data (e.g. income, expenses).

[0092] How it works: The device asks the user to "Enter your monthly income and expenditure data."

[0093] Step 5:

[0094] User: Enters specific details.

[0095] How it works: The user enters something like "Income: 300,000 yen, Expenses: 200,000 yen."

[0096] Step 6:

[0097] Terminal: Sends collected data to the server.

[0098] How it works: The device sends all collected data to the server via API calls.

[0099] Step 7:

[0100] Server: Creates and customizes a generative AI model based on the received data.

[0101] How it works: The server analyzes the data, trains an AI model based on the user's business logic, and generates a customized model.

[0102] Step 8:

[0103] Server: Registers the completed AI model on the marketplace and notifies users.

[0104] Operation: The server sends a notification message to the user device saying "AI bot creation and registration completed."

[0105] Step 9:

[0106] Terminal: Display a notification to the user that the model has been registered.

[0107] What it does: The device will display a notification message saying "AI bot creation and registration complete."

[0108] Purchasing and Using AI Bots

[0109] Step 1:

[0110] User: Search for "Household Accounting Management AI" on the marketplace and select it.

[0111] How it works: A user uses the Marketplace search function to select "Household Accounting Management AI."

[0112] Step 2:

[0113] User: Clicks the purchase button and enters the required payment information.

[0114] How it works: The user presses the buy button and enters payment information to complete the purchase.

[0115] Step 3:

[0116] Server: Processes the purchase procedure and sends the purchase information to the terminal after approval.

[0117] How it works: The server processes the purchase information and, once approved, sends it to the device.

[0118] Step 4:

[0119] Terminal: Display a purchase completion notification to the user.

[0120] Action: The device displays a "Purchase Complete" message to the user.

[0121] Step 5:

[0122] Device: Download the purchased AI bot and integrate it into the chat screen.

[0123] How it works: The device downloads the AI ​​bot and adds it to the user's chat screen.

[0124] Step 6:

[0125] User: Uses an AI bot to give instructions on managing household finances.

[0126] How it works: The user types in the text "Visualize my spending this month."

[0127] Step 7:

[0128] Server: Receives user instructions, generates graphs based on income and expenditure data, and sends the results to the user's terminal.

[0129] Operation: The server analyzes the instructions, generates the graph, and then sends the results back to the user's terminal.

[0130] Step 8:

[0131] Terminal: displays the response to the user.

[0132] Action: The device displays a "This Month's Spending Graph" to the user.

[0133] Through these steps, users can create generative AI models that meet their needs and share or sell them with other users.

[0134] Example 1

[0135] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0136] Conventional generative AI models require users to have advanced technical knowledge to create them, making them difficult for general users to use. Furthermore, existing generative AI models often lack versatility and are unable to flexibly respond to the needs of individual users. Furthermore, there are limited ways to effectively share or sell generated models with other users, making it difficult to promote widespread use.

[0137] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0138] In this invention, the server includes means for collecting personal information and objective information input by a user, means for analyzing the collected information and creating a generative AI model customized based on the user's needs, means for registering the generative AI model on a marketplace, means for other users to purchase the generative AI model on the marketplace, means for the purchased generative AI model to operate within a user device and respond and generate data in accordance with user instructions, means for the user device to receive input from the user and transmit the input data to the server, and means for the server to generate graphs based on the user input data and transmit the results to the user terminal. This enables users, even without technical knowledge, to easily create, share, and sell generative AI models that meet their needs.

[0139] "Personal information" refers to specific data about a user, including individual information such as name, age, address, contact details, income and expenses.

[0140] "Objective information" refers to information that a user needs to accomplish a specific goal or task, such as household accounting, health management, or work efficiency improvement.

[0141] A "generative artificial intelligence model" is a customized artificial intelligence model created based on user input data and needs, and designed to perform a specific task.

[0142] "Marketplace" refers to an online platform or marketplace where generative artificial intelligence models are registered and available for purchase by other users.

[0143] A "user device" is a device used by a user to create, purchase, or use a generative artificial intelligence model, and includes electronic devices such as smartphones, tablets, and personal computers.

[0144] "Server" refers to a central computer that collects and analyzes data from users and creates, manages, and registers generative artificial intelligence models.

[0145] A "graph generation tool" is software or a library for creating visualizations based on collected data, including Chart.js and Matplotlib.

[0146] An "input form" is an interface for a user to input personal information or purpose information, and takes the form of, for example, a text box or a drop-down list.

[0147] "Payment System" means the payment processing system used when a user purchases a generative artificial intelligence model on the marketplace, including credit cards and online payment services.

[0148] This invention is a system that allows users to create their own generative AI models and share and sell them with other users. This system includes the means described in the claims and provides users with a simple and effective environment for customizing and using generative AI models.

[0149] System Configuration

[0150] The system includes the following elements:

[0151] 1. Server: A central computer that collects and analyzes data from users and creates, manages, and registers generative artificial intelligence models. Software used includes generation engines, natural language processing engines, payment systems, and graph generation tools (e.g., Chart.js and Matplotlib).

[0152] 2. Device: The device used by a user to create, purchase, or use a generative AI model. Specifically, this includes electronic devices such as smartphones, tablets, and PCs.

[0153] 3. User: A person who uses the system to create generative AI models and share or sell them with other users. Users input data using an interactive interface such as the LINE app.

[0154] Explanation of program processing

[0155] Creating an AI Bot

[0156] The user opens the "Create AI Bot" menu in the LINE app and selects "Create New." This starts the creation flow.

[0157] The terminal asks the user questions about the functions they want the bot to have and prompts them to enter personal information and purpose information. For example, the terminal displays a question such as, "What functions do you want the bot to have?"

[0158] The user inputs the bot's functions and detailed data. For example, they might input, "I want the bot to have a household accounting function. I want to visualize my monthly income and expenses in graphs."

[0159] The device collects the input data and sends it to the server, which sends the collected data as a POST request to the specified API endpoint.

[0160] The server analyzes the received data, launches the generation engine, and generates an AI model based on the user data. Once training is complete, the model is saved and registered in the marketplace.

[0161] Once the model registration is complete, the server will send a notification to the device stating, "AI bot creation and registration has been completed."

[0162] The terminal displays a notification to the user that the model registration has been completed.

[0163] Purchasing and Using AI Bots

[0164] Users search for "household accounting management AI" on the marketplace, select it, click the purchase button, and enter the required payment information to complete the purchase.

[0165] The server processes the purchase procedure and, after approval, sends the purchase information to the terminal.

[0166] The device will display a purchase completion notification to the user, download the purchased AI bot, and integrate it into the chat screen.

[0167] Users can use the AI ​​bot to give instructions for managing their household finances, such as "Visualize this month's expenses."

[0168] The server receives the user's instructions and generates a graph using a graph generation tool based on the income and expenditure data. The generated graph is sent to the user's terminal as image data.

[0169] The terminal displays the received graph image in the chat window.

[0170] Specific examples

[0171] For example, if a user were to create a household accounting management AI, the process would be as follows: The user would enter "I want a household accounting management function" through the LINE app and provide detailed information such as income and expenditure data. The server would then generate an AI model based on this data and register it on the marketplace. Other users could then purchase and use this AI model, improving the efficiency of their lives and work.

[0172] Prompt Sentence Examples

[0173] "Tell me your income and expenses this month."

[0174] "Set a budget for next month."

[0175] "Category my expenses and display them in a graph."

[0176] In this way, the present invention provides a system that allows users to easily create and use generative artificial intelligence models that meet their needs.

[0177] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0178] Step 1: User initiates bot creation

[0179] Input: The user opens the "Create AI Bot" menu in the LINE app and selects "Create New."

[0180] Data processing: Communicate to the terminal the information that the user selected to "create new."

[0181] Output: The terminal will display an interface to take you to the next step.

[0182] Specific actions: Launch the LINE app, select the appropriate menu, and tap the "Create New" button.

[0183] Step 2: Enter the bot's purpose and functionality

[0184] Input: The device asks the user about the capabilities they want the bot to have.

[0185] Data processing: Collect input data (text) received from the user.

[0186] Output: Text data entered by the user as a function or purpose.

[0187] Specific behavior: Display the question "What functionality do you want your bot to have?" on the terminal screen.

[0188] Step 3: User Enters Data

[0189] Input: The user enters the bot's functionality and detailed data.

[0190] Data processing: The entered data is temporarily stored on the device.

[0191] Output: Input data (e.g., household accounting function, income and expenditure data).

[0192] Specific actions: In the input form, write, "I want to have a household accounting function. I want to visualize my monthly income and expenses in graphs."

[0193] Step 4: Sending data

[0194] Input: Data collected by the device.

[0195] Data processing: Send a POST request to the server via the API.

[0196] Output: User input data sent to the server.

[0197] Specific behavior: The user completes the input and clicks the "Submit" button. The device sends the collected data to the specified API endpoint.

[0198] Step 5: The server receives and analyzes the data

[0199] Input: Data received by the server from the device.

[0200] Data processing: Validating, analyzing, and preparing incoming data for AI model generation.

[0201] Output: Data ready to generate an AI model.

[0202] What happens: The server validates the structure of the data and filters and cleanses it as needed.

[0203] Step 6: AI model generation

[0204] Input: Ready data.

[0205] Data processing: Train and customize AI models based on data.

[0206] Output: The completed AI model.

[0207] Specific operation: The server starts the generation engine, trains the AI ​​model based on the received data, and saves the model to storage once training is complete.

[0208] Step 7: Register your model on the Marketplace

[0209] Input: The completed AI model.

[0210] Data processing: Add metadata to the AI ​​model and publish it to the marketplace.

[0211] Output: An AI model registered in the marketplace.

[0212] Specific operation: The server registers and publishes information about the generated AI model in the model database.

[0213] Step 8: Registration completion notification

[0214] Input: Information about the AI ​​model registered in the marketplace.

[0215] Data processing: Generate a registration completion notice.

[0216] Output: A notification message that is displayed on the user's terminal.

[0217] Specific action: Send a notification to the device saying "AI bot creation and registration completed."

[0218] Step 9: User finds the bot

[0219] Input: User action.

[0220] Data Processing: Search for bots in the marketplace and view the list.

[0221] Output: Search results for "household accounting management AI".

[0222] What it does: Search for "household accounting management AI" in the marketplace and select the appropriate bot.

[0223] Step 10: Checkout the Bot

[0224] Input: User selected bot and payment information.

[0225] Data processing: Processing payment information and finalizing payments.

[0226] Output: Purchase complete message.

[0227] Specific operation: Enter payment information and click the purchase button. The server processes the payment through the payment system.

[0228] Step 11: Purchase completion notification

[0229] Input: Authorization information from payment system.

[0230] Data processing: Generates a notification of purchase completion.

[0231] Output: Messages that are displayed on the user's terminal.

[0232] Specific behavior: Display a notification message saying "Purchase completed."

[0233] Step 12: Download the AI ​​Bot

[0234] Input: Purchase information.

[0235] Data processing: Download data for the AI ​​bot.

[0236] Output: The downloaded AI bot.

[0237] Specific operation: Downloads the AI ​​bot's data from the server and integrates it into the user's chat screen.

[0238] Step 13: Users use the bot

[0239] Input: User instructions (prompt text).

[0240] Data processing: Analysis based on the expected task.

[0241] Output: Graph generation information.

[0242] Specific action: Enter "Visualize this month's expenses" and send the instruction to the server.

[0243] Step 14: Server processes the instruction

[0244] Input: User-specified data.

[0245] Data processing: instruction analysis, retrieval of income and expenditure data from database, graph generation.

[0246] Output: The generated graph image.

[0247] What it does: Parse instructions, get the necessary income and expenditure data, visualize it using a graph generation tool, and output it as image data.

[0248] Step 15: The terminal displays the response

[0249] Input: The generated graph image.

[0250] Data processing: Preparing received images for display.

[0251] Output: A graph that is displayed in the user's chat window.

[0252] Specific operation: The received graph image is displayed in the chat window and presented to the user in a visible form.

[0253] The above are the specific processing steps and details of this system.

[0254] (Application example 1)

[0255] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0256] Conventional generative AI model systems make it difficult for users to easily create and use AI models customized to their needs. In particular, content distribution services require personalized content recommendations based on users' viewing history and interests, but current systems are unable to effectively achieve this.

[0257] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0258] In this invention, the server includes means for collecting personal data and objective data input by a user, means for analyzing the collected data and creating a generative AI model customized based on user needs, means for registering the generative AI model in a marketplace, means for other users to purchase the generative AI model on the marketplace, means for the purchased generative AI model to operate within the user device and respond and generate data according to user instructions, means for collecting and analyzing the user's viewing history and interest data to recommend personalized content, and means for recommending content based on the user's interests. This allows users to easily create a customized AI model based on their needs and receive personalized content recommendations.

[0259] "User needs" refers to the individual requirements and expectations of users.

[0260] "Personal Data" is information about a user that is specific to that user and records that user's unique characteristics and preferences.

[0261] "Objective data" is information that a user inputs to achieve a specific objective.

[0262] A "generative artificial intelligence model" is an artificial intelligence program that is generated based on user input data and has the ability to perform specific tasks.

[0263] A "marketplace" is an online platform where users can publish their AI models and allow other users to purchase or share them.

[0264] A "viewing history" is a record of content that a user has viewed or listened to in the past.

[0265] "Interest data" is a collection of data that indicates the areas of interest and concerns of a user.

[0266] "Content recommendation" is the process of suggesting appropriate content based on a user's viewing history and interests.

[0267] "User device" refers to a terminal or device used by a user, such as a smartphone or tablet.

[0268] "Response and data generation" refers to the process of returning appropriate answers and generating necessary data in response to user instructions.

[0269] This invention is a system that allows users to create generative AI models and share or sell them with other users. The system includes the following elements:

[0270] First, the device used by the user (smartphone, tablet, PC, etc.) provides an interface for inputting personal data and objective data. By inputting this data interactively, the user can proceed to the next step.

[0271] The device sends the collected data to a server, which creates a generative AI model and registers it on the marketplace. Specifically, the server uses the following software and hardware:

[0272] For hardware, a server equipped with a high-performance processor and large memory capacity is required. Specifically, NVIDIA GPUs or Intel CPUs are recommended. For software, a programming language such as Python and a framework for training AI models such as TensorFlow or PyTorch are used.

[0273] The server analyzes the input data and creates a customized generative AI model based on the user's needs. To achieve this, it utilizes natural language processing and data analysis algorithms, such as vectorizing text data using TfidfVectorizer and comparing data using cosine similarity.

[0274] The generated AI model is registered in a marketplace. Other users can search for and purchase the generated AI model through this marketplace. Once the purchase procedure is complete, the server sends the purchased AI model to the user's device. The user's device downloads the received AI model and runs it within the application.

[0275] To collect and analyze a user's viewing history and interest data, the user's operation history and input data are used. For example, data on the content the user has viewed in the past and the fields in which the user has shown interest is collected. This enables personalized content recommendations.

[0276] For example, if a user is interested in rock music, information about rock-related videos they have watched in the past and artists they have shown an interest in can be collected, and the server can then use this data to recommend content that best suits the user's profile.

[0277] For example, the following prompt sentences are used:

[0278] "Recommend the latest rock videos suitable for users who are interested in rock music."

[0279] In this way, the present invention provides a system that allows users to easily create AI models customized to their needs and receive personalized content recommendations.

[0280] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0281] Step 1:

[0282] The user uses the terminal to input personal and objective data. The terminal interface provides a screen for interactively inputting this data. The input data is then stored in the terminal's memory.

[0283] Input: User's personal data and purpose data

[0284] Output: Data stored in the device's data storage area

[0285] Step 2:

[0286] The device sends the collected personal data and target data to the server, where the data is encrypted and securely transmitted via API.

[0287] Input: User data stored on the device

[0288] Output: User data sent to the server

[0289] Step 3:

[0290] The server analyzes the received user data and creates a customized generative AI model based on the user's needs. Specifically, it vectorizes the text data using TfidfVectorizer and calculates cosine similarity. It also trains the model using frameworks such as TensorFlow and PyTorch.

[0291] Input: User data sent to the server

[0292] Output: A customized generative AI model

[0293] Step 4:

[0294] The server registers the generated AI model on the marketplace, allowing other users to view and purchase the model.

[0295] Input: A customized generative AI model

[0296] Output: AI model registered in the marketplace

[0297] Step 5:

[0298] Other users search for and purchase generative AI models on the marketplace. Once the purchase process is complete, the server processes the purchase information and sends the AI ​​model to the buyer's device.

[0299] Input: Purchase procedure information

[0300] Output: The purchased AI model is sent.

[0301] Step 6:

[0302] The device receives the purchased AI model, installs it into the application, and runs it. The user gives the model instructions, which then generate data and respond based on those instructions.

[0303] Input: Submitted AI model

[0304] Output: The installed AI model runs and responds to the user.

[0305] Step 7:

[0306] The device collects and analyzes the user's viewing history and interest data to recommend personalized content. The viewing history and interest data are updated in real time based on the user's operations and input.

[0307] Input: User viewing history and interest data

[0308] Output: Recommended personalized content

[0309] Specifically, if a user inputs a prompt such as "Recommend the latest rock videos suitable for a user interested in rock music," the server will analyze the user's viewing history and interest data based on the prompt and recommend appropriate content to the user. This entire process is done in real time, improving the user experience.

[0310] The above is the processing steps of the application example and their specific explanation.

[0311] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0312] This invention is a system that allows users to create their own generative AI models and share and sell them with other users. In addition to conventional customization, this system combines an emotion engine that recognizes user emotions and responds and generates data based on those emotions to provide more advanced and personalized services.

[0313] System Configuration

[0314] The system includes the following elements:

[0315] 1. Server: Responsible for generating, registering, and managing AI models and operating the marketplace.

[0316] 2. Device: The device (e.g., smartphone, tablet) used by a user to create, purchase, or use a generative AI bot.

[0317] 3. User: A person who creates conversational AI bots and shares or sells them to other users.

[0318] 4. Emotion engine: A component that recognizes and analyzes emotions from user input data and text and voice during dialogue.

[0319] Explanation of program processing

[0320] Creating an AI Bot

[0321] User: Open the "Create AI Bot" menu in the LINE app and select "Create New."

[0322] User: Clicks the "Create New" button to begin the AI ​​bot creation flow.

[0323] Terminal: Ask the user questions about the functionality they want the bot to have and prompt them for personal and objective data.

[0324] Terminal: Display the question "What would you like your bot to do?"

[0325] User: Enters the bot's capabilities, basic data, and purpose.

[0326] User: Enter the following specific information: "I want to have a household accounting function. I want to be able to visualize my monthly income and expenses in graphs."

[0327] Terminal: Asks you to enter detailed data (e.g. income, expenses).

[0328] Terminal: Prompts the user to "Enter your monthly income and expenditure data."

[0329] User: Enter specific details.

[0330] User: Enter something like "Income: 300,000 yen, Expenses: 200,000 yen."

[0331] Terminal: Sends collected data to the server.

[0332] Device: Sends all collected data to the server via API calls.

[0333] Server: Creates and customizes a generative AI model based on the received data.

[0334] Server: Analyzes data, trains AI models based on the user's business logic, and generates customized models.

[0335] Server: Registers the completed AI model on the marketplace and notifies users.

[0336] Server: Registers the model in the marketplace and sends a notification message to the user's device stating that "AI bot creation and registration is complete."

[0337] On the device: Display a notification to the user that the model has been registered.

[0338] On your device: Display a notification message saying "AI bot creation and registration complete."

[0339] Use of Emotion Recognition in AI Bots

[0340] User: Also inputs emotional data to create an AI bot with an emotion engine.

[0341] User: When creating a bot, select "I want to include an emotion engine" and enter emotion data.

[0342] Terminal: Collects user input data and emotion data and sends them to the server.

[0343] Device: Sends collected data to the server via API calls.

[0344] Server: Analyzes the received emotion data, trains the emotion engine, and integrates it into a generative AI model.

[0345] Server: Analyzes emotion data, trains the emotion engine, and integrates it into the AI ​​model.

[0346] Server: Registers AI models equipped with emotion engines in the marketplace and notifies users.

[0347] Server: Registers and notifies models equipped with emotion engines on the marketplace.

[0348] Purchasing and Using AI Bots

[0349] User: Search for "Emotion Engine-powered Household Accounting Management AI" in the Marketplace and select it.

[0350] User: Use the Marketplace search function to select "Household accounting management AI with emotion engine."

[0351] User: Clicks the purchase button and enters the required payment information.

[0352] User: Clicks the purchase button and enters payment information to complete the purchase.

[0353] Server: Processes the purchase and sends the purchase information to the device after approval.

[0354] Server: Processes the purchase information and sends it to the device once authorization is complete.

[0355] On the device: Display a purchase completion notification to the user.

[0356] On the device: Display a "Purchase complete" message to the user.

[0357] Device: Download the AI ​​bot with the emotion engine you purchased and integrate it into the chat screen.

[0358] Device: Download the AI ​​bot and add it to the user's chat screen.

[0359] User: Uses an AI bot with an emotion engine to give instructions on managing household finances.

[0360] User: Texts in "Visualize my spending this month" and mentions feeling depressed.

[0361] Server: The emotion engine analyzes the user's emotions and generates a response accordingly.

[0362] Server: The emotion engine analyzes the "depressed" emotion from the user's input and generates a spending graph along with an encouraging message.

[0363] Terminal: Displays the response to the user.

[0364] Device: Display this month's spending graph along with a message like "Cheer up, you'll save more next month!"

[0365] In this way, a system integrating an emotion engine can provide personalized responses that reflect the user's emotions and assist the user more effectively than ever before. This provides a system that allows users to easily create and use customizable generative AI models that respond to their emotions as well as their needs.

[0366] The processing flow will be explained below.

[0367] Creating an AI Bot

[0368] Step 1:

[0369] User: Open the "Create AI Bot" menu in the LINE app and select "Create New."

[0370] How it works: The user clicks the "Create New" button to begin the AI ​​bot creation flow.

[0371] Step 2:

[0372] Terminal: Ask the user questions about the functionality they want the bot to have and prompt them for personal and objective data.

[0373] What it does: The device displays the question, "What functionality do you want your bot to have?"

[0374] Step 3:

[0375] User: Enters the bot's capabilities, basic data, and purpose.

[0376] Operation: The user specifically inputs, "I want to have a household accounting function. I want to visualize my monthly income and expenses in graphs."

[0377] Step 4:

[0378] Terminal: Asks you to enter detailed data (e.g. income, expenses).

[0379] How it works: The device asks the user to "Enter your monthly income and expenditure data."

[0380] Step 5:

[0381] User: Enter specific details.

[0382] How it works: The user enters something like "Income: 300,000 yen, Expenses: 200,000 yen."

[0383] Step 6:

[0384] Terminal: Sends collected data to the server.

[0385] How it works: The device sends all collected data to the server via API calls.

[0386] Step 7:

[0387] Server: Creates and customizes a generative AI model based on the received data.

[0388] How it works: The server analyzes the data, trains the AI ​​model based on the user's needs, and generates a customized model.

[0389] Step 8:

[0390] Server: Registers the completed AI model on the marketplace and notifies users.

[0391] Operation: The server registers the model in the marketplace and sends a notification message to the user's device saying "AI bot creation and registration completed."

[0392] Step 9:

[0393] On the device: Display a notification to the user that the model has been registered.

[0394] What it does: The device will display a notification message saying "AI bot creation and registration complete."

[0395] Use of Emotion Recognition in AI Bots

[0396] Step 1:

[0397] User: Also inputs emotional data to create an AI bot with an emotion engine.

[0398] How it works: The user selects the option "I want to include an emotion engine" and enters emotion data according to the format.

[0399] Step 2:

[0400] Terminal: Collects user input data and emotion data and sends them to the server.

[0401] How it works: The device collects all this data and sends it to the server via an API call.

[0402] Step 3:

[0403] Server: Analyzes the received emotion data, trains the emotion engine, and integrates it into a generative AI model.

[0404] How it works: The server analyzes emotion data and trains an emotion engine, which is then integrated into a generative AI model.

[0405] Step 4:

[0406] Server: Registers AI models equipped with emotion engines on the marketplace and notifies users.

[0407] Operation: The server registers the model integrating the emotion engine in the marketplace and sends a notification to the user's device.

[0408] Purchasing and Using AI Bots

[0409] Step 1:

[0410] User: Search for "Household accounting management AI with emotion engine" on the marketplace and select it.

[0411] How it works: The user uses the marketplace search function to select and choose "Household accounting management AI with emotion engine."

[0412] Step 2:

[0413] User: Clicks the purchase button and enters the required payment information.

[0414] What happens: The user clicks the buy button, enters payment information, and completes the purchase.

[0415] Step 3:

[0416] Server: Processes the purchase procedure and sends the purchase information to the terminal after approval.

[0417] Operation: The server processes the purchase information and, once approval is complete, sends the information to the user's terminal.

[0418] Step 4:

[0419] Terminal: Display a purchase completion notification to the user.

[0420] Action: The device displays a "Purchase Complete" message to the user.

[0421] Step 5:

[0422] Device: Download the AI ​​bot equipped with the purchased emotion engine and integrate it into the chat screen.

[0423] How it works: The device downloads the AI ​​bot and adds it to the user's chat screen.

[0424] Step 6:

[0425] User: Uses an AI bot equipped with an emotion engine to give instructions on managing household finances.

[0426] How it works: The user enters the text "Visualize my spending this month" and describes their emotional state.

[0427] Step 7:

[0428] Server: The emotion engine analyzes the user's emotions and generates appropriate responses accordingly.

[0429] Operation: The server launches the emotion engine, analyzes the user's emotion data, and generates emotion-matched response and expenditure graphs.

[0430] Step 8:

[0431] Server: Sends the generated response and expenditure graph to the user terminal.

[0432] Operation: The server sends an emotion-based response message and a spending graph to the user terminal.

[0433] Step 9:

[0434] Terminal: displays the response to the user.

[0435] What it does: Your device displays a graph of your spending this month along with an emotional message such as "Cheer up, you'll save more next month!"

[0436] In this way, a system integrating an emotion engine can provide personalized responses that reflect the user's emotions and assist the user more effectively than ever before. This provides a system that allows users to easily create and use customizable generative AI models that respond to their emotions as well as their needs.

[0437] Example 2

[0438] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0439] While conventional generative AI models were able to customize based on user needs, they lacked the ability to recognize and reflect user emotions, making it difficult to provide fully personalized responses. By solving this problem, there is a demand for systems that can improve the user experience and generate more effective responses and data.

[0440] The identification processing by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for collecting personal data and object data input by the user; means for analyzing the collected data and creating a generative AI model customized based on the user needs; means for registering the generative AI model in a marketplace; means for other users to purchase the generative AI model in the marketplace; means for the purchased generative AI model to operate in the user terminal and respond and generate data according to the user's instructions; means including an emotion analysis engine that recognizes and analyzes emotions from the user's input data and dialogue data; and means for responding and generating data using the emotion analysis engine based on the analyzed emotion data. This makes it possible to generate responses and data that reflect the user's emotions.

[0441] "Personal data" refers to information about an individual entered by a user, including the individual's attributes, preferences, behavioral history, and so on.

[0442] "Target data" refers to data that includes information about the intended use or function of the generated AI model.

[0443] A "generative artificial intelligence model" is a customized AI model that is generated based on the user's personal data and objective data.

[0444] A "marketplace" is an online platform where generative AI models can be registered and purchased by other users.

[0445] A "user device" is an electronic device used by a user to create, purchase, or use a generative AI model, including a smartphone or tablet.

[0446] An "emotion analysis engine" is a software component for recognizing and analyzing emotions from user input data and interaction data.

[0447] "Response and data generation" is the process by which a generative artificial intelligence model provides appropriate responses and information based on user instructions.

[0448] This invention relates to a system that allows users to create their own generative AI models and share or sell them with other users. In particular, by integrating an emotion analysis engine, it is possible to generate personalized responses and data that reflect the user's emotions. The system includes the following elements:

[0449] System Configuration

[0450] 1. Server:

[0451] Generates, registers, manages, and operates a marketplace for AI models.

[0452] The servers are located in a cloud environment, enabling high-speed processing and data analysis.

[0453] 2. Terminal:

[0454] A device used by a user to create, purchase, and use generative AI models, including smartphones and tablets.

[0455] The terminal is connected to the Internet and has a dedicated application installed for communicating with the server.

[0456] 3. User:

[0457] A person who interactively creates AI models and shares or sells them to other users.

[0458] Users operate the device to input the necessary data and customize the generative AI model.

[0459] 4. Sentiment Analysis Engine:

[0460] It is a software component that recognizes and analyzes emotions from user input data and text and voice during dialogue.

[0461] It is placed on a server and performs sentiment analysis in real time.

[0462] Overview of program processing

[0463] 1. Creating an AI Bot

[0464] The user accesses the "AI Bot Creation" menu using the LINE app on their device and selects "Create New." The device then asks the user what functions they would like the bot to have, and the user inputs their desired functions and purpose. For example, they can input "I want the bot to have a household accounting function." The device then prompts them to input specific data (e.g., monthly income and expenses). The input data is sent from the device to the server, which analyzes it and creates a generative AI model. The completed model is registered on the marketplace, and a notification that the model has been registered is sent to the user.

[0465] 2. Use of emotion recognition function

[0466] Users can choose whether to incorporate an emotion analysis engine when creating an AI bot. If emotion analysis is desired, the user also inputs emotion data, which is then sent to the server via the terminal. The server analyzes the received emotion data, trains the emotion engine, and integrates it into a generative AI model. The integrated model is then registered on the marketplace again and notified to the user.

[0467] 3. Purchasing and Using AI Bots

[0468] A user searches for and purchases a "household accounting management AI with an emotion engine" on the marketplace. After entering payment information and completing the purchase, the server processes the purchase information and sends it to the device. A notification is displayed indicating the purchase is complete, and the user downloads the purchased AI bot and integrates it into their chat screen. The user then types "Visualize this month's expenses" and conveys their emotional state. For example, if the user mentions that they are feeling depressed, the server uses the emotion analysis engine to generate an appropriate response and an expense graph, which are then sent to the device. The device then displays the generated response and graph to the user.

[0469] Specific examples

[0470] Example prompt sentence:

[0471] User: Clicks the "Create New" button to begin the AI ​​bot creation flow.

[0472] Terminal: Display the question "What would you like your bot to do?"

[0473] User: Enter the following specific information: "I want to have a household accounting function. I want to be able to visualize my monthly income and expenses in graphs."

[0474] Terminal: Prompts the user to "Enter your monthly income and expenditure data."

[0475] User: Enter something like "Income: 300,000 yen, Expenses: 200,000 yen."

[0476] This system provides a generative AI model that integrates an emotion analysis engine, enabling responses that reflect the user's emotions. Users can also use this to easily create and use customizable generative AI models, resulting in a highly effective user experience.

[0477] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0478] Step 1:

[0479] The user accesses the "Create AI Bot" menu in the LINE app on their device and selects "Create New."

[0480] (Input) User command: New creation

[0481] (Output) Display the next input prompt

[0482] (Operation) When the user clicks the "Create New" button, the system begins preparing to display the next input prompt.

[0483] Step 2:

[0484] The terminal asks questions about the features you want the bot to have.

[0485] (Input) "Create new" selected

[0486] (Output) The question "What functionality do you want your bot to have?"

[0487] (Action) The device displays the question on the screen: "What functionality do you want your bot to have?"

[0488] Step 3:

[0489] The user enters the bot's capabilities, basic data, and purpose.

[0490] (Input) User input: "I want to have a household accounting function. I want to visualize my monthly income and expenses in graphs."

[0491] (Output) Function and purpose information

[0492] (Operation) The user inputs specific functions (e.g., "I want to have a household accounting function") and purpose (e.g., "I want to visualize my monthly income and expenses in a graph").

[0493] Step 4:

[0494] The terminal will ask you to enter detailed data (e.g. monthly income, expenses).

[0495] (Input) Function and purpose information entered by the user

[0496] (Output) The question "Please enter your monthly income and expenditure data."

[0497] (Operation) The terminal asks the user to "Enter monthly income and expenditure data."

[0498] Step 5:

[0499] The user enters the details.

[0500] (Input) Specific data such as "Income: 300,000 yen, Expenses: 200,000 yen"

[0501] (Output) Detailed data

[0502] (Operation) The user enters specific figures such as "Income: 300,000 yen, Expenses: 200,000 yen." The device receives this and stores it as data.

[0503] Step 6:

[0504] The terminal transmits the collected data to the server.

[0505] (Input) All data entered by the user

[0506] (Output) API call sent to the server

[0507] (Operation) The device sends all collected data to the server via an API call.

[0508] Step 7:

[0509] The server creates and customizes a generative AI model based on the received data.

[0510] (Input) User data and detailed data sent from the terminal

[0511] (Output) Customized generative AI model

[0512] (Operation) The server analyzes the data, trains the AI ​​model based on the user's business logic, and generates a customized model.

[0513] Step 8:

[0514] The server registers the completed generative AI model on the marketplace and notifies the user.

[0515] (Input) Customized AI model generated by the server

[0516] (Output) Notification message "AI bot creation and registration completed."

[0517] (Operation) The server registers the generated AI model on the marketplace and sends a notification to the user device stating, "AI bot creation and registration has been completed."

[0518] Step 9:

[0519] The terminal displays a notification to the user that the model has been registered.

[0520] (Input) Notification message sent from the server

[0521] (Output) "AI bot creation and registration completed" message

[0522] (Operation) The device displays the message "AI bot creation and registration completed" on the screen.

[0523] Step 10:

[0524] Users also input emotional data to create AI bots with built-in emotion engines.

[0525] (Input) Input of selection and emotion data including emotion engine

[0526] (Output) Comprehensive emotion data

[0527] (Operation) The user selects to include the emotion engine and inputs emotion data. The device receives this and stores it as data.

[0528] Step 11:

[0529] The terminal collects the user's input data and emotion data and transmits them to the server.

[0530] (Input) Emotion data and user interaction data

[0531] (Output) API call sent to the server

[0532] (Operation) The device sends the collected data to the server via an API call.

[0533] Step 12:

[0534] The server analyzes the received emotion data, trains the emotion engine, and integrates it into a generative AI model.

[0535] (Input) Emotion data and user interaction data sent from the device

[0536] (Output) Generative AI model integrating emotion engine

[0537] (Operation) The server analyzes the emotion data, trains the emotion engine, and integrates it into a generative AI model.

[0538] Step 13:

[0539] The server registers the AI ​​model equipped with the emotion engine on the marketplace and notifies the user.

[0540] (Input) Generative AI model integrating emotion engine

[0541] (Output) Notification message: "AI model with emotion engine has been created."

[0542] (Operation) The server registers the AI ​​model equipped with the emotion engine in the marketplace and sends a completion notification to the user's device.

[0543] Step 14:

[0544] The device searches for and selects "household accounting management AI with emotion engine" in the marketplace.

[0545] (Input) Search criteria entered by the user

[0546] (Output) AI model list of search results

[0547] (Operation) The user searches for and selects a "household accounting management AI with an emotion engine" within the marketplace.

[0548] Step 15:

[0549] The user clicks the purchase button and enters the required payment information.

[0550] (Input) Payment information

[0551] (Output) Purchase completed status

[0552] (Action) The user presses the purchase button, enters payment information, and completes the purchase process.

[0553] Step 16:

[0554] The server processes the purchase procedure and, after approval, sends the purchase information to the terminal.

[0555] (Input) Payment Information Authorization

[0556] (Output) Purchase completion notification message

[0557] (Operation) The server processes the purchase information and, once approval is complete, sends the information to the terminal.

[0558] Step 17:

[0559] The terminal displays a purchase completion notification to the user.

[0560] (Input) Purchase completion notification message

[0561] (Output) "Purchase completed" message

[0562] (Operation) The device displays the message "Purchase completed."

[0563] Step 18:

[0564] The device downloads the AI ​​bot equipped with the purchased emotion engine and integrates it into the chat screen.

[0565] (Input) AI model download request

[0566] (Output) AI bot integrated into the chat screen

[0567] (Operation) The device downloads the AI ​​bot and adds it to the user's chat screen.

[0568] Step 19:

[0569] Users can use an AI bot equipped with an emotion engine to give instructions on managing their household finances.

[0570] (Input) Input of user instructions and emotions (e.g., "Visualize my expenses this month.")

[0571] (Output) Analysis request data and emotion data

[0572] (Action) The user gives a text prompt to describe their emotional state, for example, typing "I'm feeling depressed."

[0573] Step 20:

[0574] The server uses an emotion engine to analyze the user's emotions and generate a response accordingly.

[0575] (Input) User instructions and emotion data

[0576] (Output) Personalized responses and data

[0577] (Operation) The server uses an emotion engine to analyze the user's emotions and generates an appropriate response (e.g., an "encouraging message") and expenditure graph based on those emotions.

[0578] Step 21:

[0579] The terminal displays the response from the server to the user.

[0580] (Input) Response data from the server

[0581] (Output) Display of analysis results

[0582] (Operation) The terminal displays the generated responses and expenditure graph to the user, providing feedback adapted to the user's situation.

[0583] (Application example 2)

[0584] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0585] Many users today desire artificial intelligence models that they can customize themselves, but conventional systems have struggled to provide personalized services based on user emotions. Furthermore, providing appropriate service based on customer emotions in brick-and-mortar stores has been difficult, hindering customer satisfaction. To address these challenges, a system capable of recognizing user emotions and generating responses based on those emotions is needed.

[0586] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for collecting personal data and object data input by the user; means for analyzing the collected data and creating a generative AI model customized based on the user needs; means for registering the generative AI model in a marketplace; means for other users to purchase the generative AI model on the marketplace; means for the purchased generative AI model to operate in the user device and respond and generate data according to the user's instructions; means for analyzing the user's emotions and generating responses based thereon; and means for generating response data based on the emotions and providing personalized information to the user. This enables users to easily create their own generative AI models, share and sell them with other users, and further enables personalized services based on emotions to be provided.

[0587] "Personal data" refers to personal information about a user, including, for example, name, address, phone number, email address, lifestyle data, and the like.

[0588] "Purpose data" refers to data about the specific goals or objectives that a user wants to achieve with the generated AI model. For example, this could be for purposes such as household accounting, health management, or learning support.

[0589] A "generative artificial intelligence model" is an artificial intelligence model that is customized based on a user's personal data and objective data and is generated to perform a specific task or response.

[0590] A "marketplace" is an online platform where generative AI models are registered and can be searched, purchased, and used by other users.

[0591] "Analysis" is the act of processing collected data to extract and use information that meets user needs and objectives. This includes the application of data mining and machine learning algorithms.

[0592] "Analyzing emotions" refers to the process of identifying emotions from user input data, text during a conversation, voice, etc., and generating emotion data.

[0593] "Personalized information" refers to customized information provided according to a user's specific feelings and needs, and provides responses and services that are most appropriate for the user.

[0594] "Response data" is data that includes specific information or messages that are generated based on the user's instructions or feelings.

[0595] "User device" refers to a hardware device that allows a user to use a generative AI model, such as a smartphone, tablet, or smart glasses.

[0596] An "instruction" is an operation or command given by a user to a generative AI model, including a command to perform a specific task or response.

[0597] This invention is a system that allows users to create generative AI models and share and sell them with other users. This system incorporates an emotion engine that recognizes users' emotions and responds and generates data based on those emotions, thereby providing more advanced and personalized services. Components of this system include a server, a terminal, a user, and an emotion engine.

[0598] The server has the following features:

[0599] 1. Data collection function: Collects personal and purpose data entered by users. The collected data is used to create a generative artificial intelligence model customized based on the user's needs.

[0600] 2. Data analysis function: Analyzes collected data and creates customized generative AI models based on user needs. This is done using data mining and machine learning algorithms. Specific software examples include TensorFlow and PyTorch.

[0601] 3. Marketplace management function: The generated AI model is registered in the marketplace so that other users can search for, purchase, and use it. Purchased models are downloaded from the server to user devices.

[0602] 4. Emotion Recognition and Response Generation: Analyzes the user's emotions and generates responses based on them. The emotion engine uses an emotion recognition library such as Affectiva. Response generation uses a generative AI model such as OpenAI GPT-4.

[0603] The terminal has the following features:

[0604] 1. Data entry and transmission function: The user interactively enters personal data and objective data, which is then transmitted to the server.

[0605] 2. Emotional data capture function: Uses the camera and microphone of smart glasses or smartphones to capture emotional data such as the user's facial expressions and tone of voice.

[0606] 3. Response display function: The response data sent from the server is displayed to the user. The display device can be the display of smart glasses or the screen of a smartphone.

[0607] The user does the following:

[0608] 1. Data entry: Enter your personal data and purpose data into the terminal.

[0609] 2. Emotional Data Input: Use the emotion engine to input emotional data such as facial expressions and tone of voice.

[0610] 3. Response confirmation: Confirm and use the responses and data generation results provided by the generative AI model.

[0611] As a concrete example, consider a scenario in which smart glasses are used in a brick-and-mortar store. When a salesperson wears the smart glasses and selects a product using their gaze or voice, the customer's emotions are analyzed from their facial expressions and tone of voice. Based on the analysis results, an appropriate customer service script and product description are generated in real time and displayed on the glasses' display.

[0612] Specific examples of prompts are as follows:

[0613] "User's face shows a frown, and their voice tone is low."

[0614] The prompts for the generative AI model are:

[0615] Generate an appropriate customer response based on the following user sentiment data:

[0616] Facial expression: raised eyebrows, downturned corners of the mouth

[0617] Voice tone: low

[0618] "This product looks difficult to use, can you tell?"

[0619] This will enable the provision of personalized services to customers in physical stores, contributing to improved customer satisfaction.

[0620] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0621] Step 1:

[0622] The user uses the device to input personal data and purpose data, such as name, age, areas of interest, and purpose of use (e.g., household accounting) through the screen of smart glasses or a smartphone. This input data becomes the initial value of the system.

[0623] Step 2:

[0624] The device collects the personal and objective data entered and sends it to a server, which receives it via a secure protocol via an API call. The input data includes the user's identified goals and needs.

[0625] Step 3:

[0626] The server analyzes the received personal data and objective data to create a generative AI model customized based on the user's needs. Specifically, it uses data mining and machine learning algorithms, leveraging libraries such as TensorFlow and PyTorch. This analysis generates an AI model optimized for the user.

[0627] Step 4:

[0628] The server registers the generated generative AI model in the marketplace. This registration is added to the database within the system and becomes searchable by other users. The marketplace displays a description and features of the generative AI model.

[0629] Step 5:

[0630] When other users purchase a generative AI model on the marketplace, the server processes the purchase and makes the model available for download. The purchase process includes verifying and authenticating payment information. Once the purchase is complete, the model is downloaded to the user's device.

[0631] Step 6:

[0632] The purchased generative AI model runs within the user's device, responding to and generating data in response to user instructions. The device receives user instructions in the form of text or voice and sends them to a server.

[0633] Step 7:

[0634] The server analyzes the user's emotions, and a generative AI model generates a response based on that. An emotion recognition library (e.g., Affectiva) is used to determine emotions from the user's facial expressions and voice, and the generated emotion data is incorporated. A generative AI model such as OpenAI GPT-4 is used to generate responses.

[0635] Step 8:

[0636] The server generates personalized response data for the user and sends it to the device. An appropriate message is generated based on the user's emotions. This message may include encouragement or specific advice.

[0637] Step 9:

[0638] The device displays the response data sent from the server to the user, and the generated response message and related information are displayed on the smart glasses display or the smartphone screen, allowing the user to review it and decide on the next action.

[0639] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0640] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0641] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0642] [Second embodiment]

[0643] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0644] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0645] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0646] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0647] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0648] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0649] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0650] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0651] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0652] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0653] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0654] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0655] The present invention is a system that allows users to create their own generative AI models and share and sell them with other users. This system includes the means described in the claims and provides users with a simple and effective environment for customizing and using generative AI models.

[0656] System Configuration

[0657] The system includes the following elements:

[0658] 1. Server: Responsible for generating, registering, and managing AI models and operating the marketplace.

[0659] 2. Device: The device (e.g., smartphone, tablet) used by a user to create, purchase, or use a generative AI bot.

[0660] 3. User: A person who creates conversational AI bots and shares or sells them to other users.

[0661] Explanation of program processing

[0662] Creating an AI Bot

[0663] User: Open the "Create AI Bot" menu in the LINE app and select "Create New."

[0664] User: Start the creation flow by selecting "Create New" on the AI ​​bot creation screen.

[0665] Terminal: Ask the user questions about the functionality they want the bot to have and prompt them for personal and objective data.

[0666] Terminal: Display the question "What would you like your bot to do?"

[0667] User: Enters the bot's functionality and detailed data.

[0668] User: Enter "I want to have a household accounting function. I want to visualize my monthly income and expenses in graphs."

[0669] Terminal: Collects input data and sends it to the server.

[0670] Terminal: Sends collected data to the server via API.

[0671] Server: Creates and customizes a generative AI model based on the received data.

[0672] Server: Runs the generation engine, trains the AI ​​model based on user data, and saves the model once customization is complete.

[0673] Server: Registers the completed AI model on the marketplace and notifies the user that registration is complete.

[0674] Server: Registers the model on the marketplace and sends a notification to the device saying "AI bot creation and registration completed."

[0675] On the device: Display a notification to the user that the model has been registered.

[0676] On your device: Display a notification that says "AI bot creation and registration complete."

[0677] Purchasing and Using AI Bots

[0678] User: Search for "Household Accounting Management AI" in the Marketplace and select it.

[0679] User: Use the Marketplace search function to find and select "Household Accounting Management AI."

[0680] User: Clicks the purchase button and enters the required payment information.

[0681] User: Clicks the purchase button and enters payment information to complete the purchase.

[0682] Server: Processes the purchase and sends the purchase information to the device after approval.

[0683] Server: Processes the purchase information and, once authorization is complete, sends the information to the device.

[0684] On the device: Display a purchase completion notification to the user.

[0685] On your device: Display a "Purchase complete" notification to the user.

[0686] Device: Download the purchased AI bot and integrate it into the chat screen.

[0687] Device: Download the AI ​​bot and add it to the user's chat screen.

[0688] User: Uses an AI bot to give instructions on managing household finances.

[0689] User: Texts "Visualize my spending this month."

[0690] Server: Receives user instructions, generates graphs based on income and expenditure data, and sends the results to the user's device.

[0691] Server: Analyzes the instructions and returns the results to the user's device.

[0692] Terminal: Displays the response to the user.

[0693] Terminal: Shows the user a "This Month's Spending Graph."

[0694] Specific examples

[0695] For example, if a user were to create a household accounting management AI, the process would be as follows: The user would input "I want a household accounting management function" and provide detailed income and expenditure data. The server would generate an AI model based on this data and register it on the marketplace. Other users could then purchase and use this AI model, improving the efficiency of their lives and work.

[0696] In this way, the present invention provides a system that allows users to easily create and use generative AI models that meet their needs, thereby effectively resolving conventional problems.

[0697] The processing flow will be explained below.

[0698] Creating an AI Bot

[0699] Step 1:

[0700] User: Open the "Create AI Bot" menu in the LINE app and select "Create New."

[0701] How it works: The user clicks the "Create New" button to begin the AI ​​bot creation flow.

[0702] Step 2:

[0703] Terminal: Asks the user about the functions they want the bot to have and prompts them to enter personal and objective data.

[0704] What it does: The device displays the question, "What functionality do you want your bot to have?"

[0705] Step 3:

[0706] User: Enters the bot's functionality, basic data, and purpose.

[0707] Operation: The user specifically inputs, "I want to have a household accounting function. I want to visualize my monthly income and expenses in graphs."

[0708] Step 4:

[0709] Terminal: Asks you to enter detailed data (e.g. income, expenses).

[0710] How it works: The device asks the user to "Enter your monthly income and expenditure data."

[0711] Step 5:

[0712] User: Enters specific details.

[0713] How it works: The user enters something like "Income: 300,000 yen, Expenses: 200,000 yen."

[0714] Step 6:

[0715] Terminal: Sends collected data to the server.

[0716] How it works: The device sends all collected data to the server via API calls.

[0717] Step 7:

[0718] Server: Creates and customizes a generative AI model based on the received data.

[0719] How it works: The server analyzes the data, trains an AI model based on the user's business logic, and generates a customized model.

[0720] Step 8:

[0721] Server: Registers the completed AI model on the marketplace and notifies users.

[0722] Operation: The server sends a notification message to the user device saying "AI bot creation and registration completed."

[0723] Step 9:

[0724] Terminal: Display a notification to the user that the model has been registered.

[0725] What it does: The device will display a notification message saying "AI bot creation and registration complete."

[0726] Purchasing and Using AI Bots

[0727] Step 1:

[0728] User: Search for "Household Accounting Management AI" on the marketplace and select it.

[0729] How it works: A user uses the Marketplace search function to select "Household Accounting Management AI."

[0730] Step 2:

[0731] User: Clicks the purchase button and enters the required payment information.

[0732] How it works: The user presses the buy button and enters payment information to complete the purchase.

[0733] Step 3:

[0734] Server: Processes the purchase procedure and sends the purchase information to the terminal after approval.

[0735] How it works: The server processes the purchase information and, once approved, sends it to the device.

[0736] Step 4:

[0737] Terminal: Display a purchase completion notification to the user.

[0738] Action: The device displays a "Purchase Complete" message to the user.

[0739] Step 5:

[0740] Device: Download the purchased AI bot and integrate it into the chat screen.

[0741] How it works: The device downloads the AI ​​bot and adds it to the user's chat screen.

[0742] Step 6:

[0743] User: Uses an AI bot to give instructions on managing household finances.

[0744] How it works: The user types in the text "Visualize my spending this month."

[0745] Step 7:

[0746] Server: Receives user instructions, generates graphs based on income and expenditure data, and sends the results to the user's terminal.

[0747] Operation: The server analyzes the instructions, generates the graph, and then sends the results back to the user's terminal.

[0748] Step 8:

[0749] Terminal: displays the response to the user.

[0750] Action: The device displays a "This Month's Spending Graph" to the user.

[0751] Through these steps, users can create generative AI models that meet their needs and share or sell them with other users.

[0752] Example 1

[0753] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0754] Conventional generative AI models require users to have advanced technical knowledge to create them, making them difficult for general users to use. Furthermore, existing generative AI models often lack versatility and are unable to flexibly respond to the needs of individual users. Furthermore, there are limited ways to effectively share or sell generated models with other users, making it difficult to promote widespread use.

[0755] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0756] In this invention, the server includes means for collecting personal information and objective information input by a user, means for analyzing the collected information and creating a generative AI model customized based on the user's needs, means for registering the generative AI model on a marketplace, means for other users to purchase the generative AI model on the marketplace, means for the purchased generative AI model to operate within a user device and respond and generate data in accordance with user instructions, means for the user device to receive input from the user and transmit the input data to the server, and means for the server to generate graphs based on the user input data and transmit the results to the user terminal. This enables users, even without technical knowledge, to easily create, share, and sell generative AI models that meet their needs.

[0757] "Personal information" refers to specific data about a user, including individual information such as name, age, address, contact details, income and expenses.

[0758] "Objective information" refers to information that a user needs to accomplish a specific goal or task, such as household accounting, health management, or work efficiency improvement.

[0759] A "generative artificial intelligence model" is a customized artificial intelligence model created based on user input data and needs, and designed to perform a specific task.

[0760] "Marketplace" refers to an online platform or marketplace where generative artificial intelligence models are registered and available for purchase by other users.

[0761] A "user device" is a device used by a user to create, purchase, or use a generative artificial intelligence model, and includes electronic devices such as smartphones, tablets, and personal computers.

[0762] "Server" refers to a central computer that collects and analyzes data from users and creates, manages, and registers generative artificial intelligence models.

[0763] A "graph generation tool" is software or a library for creating visualizations based on collected data, including Chart.js and Matplotlib.

[0764] An "input form" is an interface for a user to input personal information or purpose information, and takes the form of, for example, a text box or a drop-down list.

[0765] "Payment System" means the payment processing system used when a user purchases a generative artificial intelligence model on the marketplace, including credit cards and online payment services.

[0766] This invention is a system that allows users to create their own generative AI models and share and sell them with other users. This system includes the means described in the claims and provides users with a simple and effective environment for customizing and using generative AI models.

[0767] System Configuration

[0768] The system includes the following elements:

[0769] 1. Server: A central computer that collects and analyzes data from users and creates, manages, and registers generative artificial intelligence models. Software used includes generation engines, natural language processing engines, payment systems, and graph generation tools (e.g., Chart.js and Matplotlib).

[0770] 2. Device: The device used by a user to create, purchase, or use a generative AI model. Specifically, this includes electronic devices such as smartphones, tablets, and PCs.

[0771] 3. User: A person who uses the system to create generative AI models and share or sell them with other users. Users input data using an interactive interface such as the LINE app.

[0772] Explanation of program processing

[0773] Creating an AI Bot

[0774] The user opens the "Create AI Bot" menu in the LINE app and selects "Create New." This starts the creation flow.

[0775] The terminal asks the user questions about the functions they want the bot to have and prompts them to enter personal information and purpose information. For example, the terminal displays a question such as, "What functions do you want the bot to have?"

[0776] The user inputs the bot's functions and detailed data. For example, they might input, "I want the bot to have a household accounting function. I want to visualize my monthly income and expenses in graphs."

[0777] The device collects the input data and sends it to the server, which sends the collected data as a POST request to the specified API endpoint.

[0778] The server analyzes the received data, launches the generation engine, and generates an AI model based on the user data. Once training is complete, the model is saved and registered in the marketplace.

[0779] Once the model registration is complete, the server will send a notification to the device stating, "AI bot creation and registration has been completed."

[0780] The terminal displays a notification to the user that the model registration has been completed.

[0781] Purchasing and Using AI Bots

[0782] Users search for "household accounting management AI" on the marketplace, select it, click the purchase button, and enter the required payment information to complete the purchase.

[0783] The server processes the purchase procedure and, after approval, sends the purchase information to the terminal.

[0784] The device will display a purchase completion notification to the user, download the purchased AI bot, and integrate it into the chat screen.

[0785] Users can use the AI ​​bot to give instructions for managing their household finances, such as "Visualize this month's expenses."

[0786] The server receives the user's instructions and generates a graph using a graph generation tool based on the income and expenditure data. The generated graph is sent to the user's terminal as image data.

[0787] The terminal displays the received graph image in the chat window.

[0788] Specific examples

[0789] For example, if a user were to create a household accounting management AI, the process would be as follows: The user would enter "I want a household accounting management function" through the LINE app and provide detailed information such as income and expenditure data. The server would then generate an AI model based on this data and register it on the marketplace. Other users could then purchase and use this AI model, improving the efficiency of their lives and work.

[0790] Prompt Sentence Examples

[0791] "Tell me your income and expenses this month."

[0792] "Set a budget for next month."

[0793] "Category my expenses and display them in a graph."

[0794] In this way, the present invention provides a system that allows users to easily create and use generative artificial intelligence models that meet their needs.

[0795] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0796] Step 1: User initiates bot creation

[0797] Input: The user opens the "Create AI Bot" menu in the LINE app and selects "Create New."

[0798] Data processing: Communicate to the terminal the information that the user selected to "create new."

[0799] Output: The terminal will display an interface to take you to the next step.

[0800] Specific actions: Launch the LINE app, select the appropriate menu, and tap the "Create New" button.

[0801] Step 2: Enter the bot's purpose and functionality

[0802] Input: The device asks the user about the capabilities they want the bot to have.

[0803] Data processing: Collect input data (text) received from the user.

[0804] Output: Text data entered by the user as a function or purpose.

[0805] Specific behavior: Display the question "What functionality do you want your bot to have?" on the terminal screen.

[0806] Step 3: User Enters Data

[0807] Input: The user enters the bot's functionality and detailed data.

[0808] Data processing: The entered data is temporarily stored on the device.

[0809] Output: Input data (e.g., household accounting function, income and expenditure data).

[0810] Specific actions: In the input form, write, "I want to have a household accounting function. I want to visualize my monthly income and expenses in graphs."

[0811] Step 4: Sending data

[0812] Input: Data collected by the device.

[0813] Data processing: Send a POST request to the server via the API.

[0814] Output: User input data sent to the server.

[0815] Specific behavior: The user completes the input and clicks the "Submit" button. The device sends the collected data to the specified API endpoint.

[0816] Step 5: The server receives and analyzes the data

[0817] Input: Data received by the server from the device.

[0818] Data processing: Validating, analyzing, and preparing incoming data for AI model generation.

[0819] Output: Data ready to generate an AI model.

[0820] What happens: The server validates the structure of the data and filters and cleanses it as needed.

[0821] Step 6: AI model generation

[0822] Input: Ready data.

[0823] Data processing: Train and customize AI models based on data.

[0824] Output: The completed AI model.

[0825] Specific operation: The server starts the generation engine, trains the AI ​​model based on the received data, and saves the model to storage once training is complete.

[0826] Step 7: Register your model on the Marketplace

[0827] Input: The completed AI model.

[0828] Data processing: Add metadata to the AI ​​model and publish it to the marketplace.

[0829] Output: An AI model registered in the marketplace.

[0830] Specific operation: The server registers and publishes information about the generated AI model in the model database.

[0831] Step 8: Registration completion notification

[0832] Input: Information about the AI ​​model registered in the marketplace.

[0833] Data processing: Generate a registration completion notice.

[0834] Output: A notification message that is displayed on the user's terminal.

[0835] Specific action: Send a notification to the device saying "AI bot creation and registration completed."

[0836] Step 9: User finds the bot

[0837] Input: User action.

[0838] Data Processing: Search for bots in the marketplace and view the list.

[0839] Output: Search results for "household accounting management AI".

[0840] What it does: Search for "household accounting management AI" in the marketplace and select the appropriate bot.

[0841] Step 10: Checkout the Bot

[0842] Input: User selected bot and payment information.

[0843] Data processing: Processing payment information and finalizing payments.

[0844] Output: Purchase complete message.

[0845] Specific operation: Enter payment information and click the purchase button. The server processes the payment through the payment system.

[0846] Step 11: Purchase completion notification

[0847] Input: Authorization information from payment system.

[0848] Data processing: Generates a notification of purchase completion.

[0849] Output: Messages that are displayed on the user's terminal.

[0850] Specific behavior: Display a notification message saying "Purchase completed."

[0851] Step 12: Download the AI ​​Bot

[0852] Input: Purchase information.

[0853] Data processing: Download data for the AI ​​bot.

[0854] Output: The downloaded AI bot.

[0855] Specific operation: Downloads the AI ​​bot's data from the server and integrates it into the user's chat screen.

[0856] Step 13: Users use the bot

[0857] Input: User instructions (prompt text).

[0858] Data processing: Analysis based on the expected task.

[0859] Output: Graph generation information.

[0860] Specific action: Enter "Visualize this month's expenses" and send the instruction to the server.

[0861] Step 14: Server processes the instruction

[0862] Input: User-specified data.

[0863] Data processing: instruction analysis, retrieval of income and expenditure data from database, graph generation.

[0864] Output: The generated graph image.

[0865] What it does: Parse instructions, get the necessary income and expenditure data, visualize it using a graph generation tool, and output it as image data.

[0866] Step 15: The terminal displays the response

[0867] Input: The generated graph image.

[0868] Data processing: Preparing received images for display.

[0869] Output: A graph that is displayed in the user's chat window.

[0870] Specific operation: The received graph image is displayed in the chat window and presented to the user in a visible form.

[0871] The above are the specific processing steps and details of this system.

[0872] (Application example 1)

[0873] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0874] Conventional generative AI model systems make it difficult for users to easily create and use AI models customized to their needs. In particular, content distribution services require personalized content recommendations based on users' viewing history and interests, but current systems are unable to effectively achieve this.

[0875] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0876] In this invention, the server includes means for collecting personal data and objective data input by a user, means for analyzing the collected data and creating a generative AI model customized based on user needs, means for registering the generative AI model in a marketplace, means for other users to purchase the generative AI model on the marketplace, means for the purchased generative AI model to operate within the user device and respond and generate data according to user instructions, means for collecting and analyzing the user's viewing history and interest data to recommend personalized content, and means for recommending content based on the user's interests. This allows users to easily create a customized AI model based on their needs and receive personalized content recommendations.

[0877] "User needs" refers to the individual requirements and expectations of users.

[0878] "Personal Data" is information about a user that is specific to that user and records that user's unique characteristics and preferences.

[0879] "Objective data" is information that a user inputs to achieve a specific objective.

[0880] A "generative artificial intelligence model" is an artificial intelligence program that is generated based on user input data and has the ability to perform specific tasks.

[0881] A "marketplace" is an online platform where users can publish their AI models and allow other users to purchase or share them.

[0882] A "viewing history" is a record of content that a user has viewed or listened to in the past.

[0883] "Interest data" is a collection of data that indicates the areas of interest and concerns of a user.

[0884] "Content recommendation" is the process of suggesting appropriate content based on a user's viewing history and interests.

[0885] "User device" refers to a terminal or device used by a user, such as a smartphone or tablet.

[0886] "Response and data generation" refers to the process of returning appropriate answers and generating necessary data in response to user instructions.

[0887] This invention is a system that allows users to create generative AI models and share or sell them with other users. The system includes the following elements:

[0888] First, the device used by the user (smartphone, tablet, PC, etc.) provides an interface for inputting personal data and objective data. By inputting this data interactively, the user can proceed to the next step.

[0889] The device sends the collected data to a server, which creates a generative AI model and registers it on the marketplace. Specifically, the server uses the following software and hardware:

[0890] For hardware, a server equipped with a high-performance processor and large memory capacity is required. Specifically, NVIDIA GPUs or Intel CPUs are recommended. For software, a programming language such as Python and a framework for training AI models such as TensorFlow or PyTorch are used.

[0891] The server analyzes the input data and creates a customized generative AI model based on the user's needs. To achieve this, it utilizes natural language processing and data analysis algorithms, such as vectorizing text data using TfidfVectorizer and comparing data using cosine similarity.

[0892] The generated AI model is registered in a marketplace. Other users can search for and purchase the generated AI model through this marketplace. Once the purchase procedure is complete, the server sends the purchased AI model to the user's device. The user's device downloads the received AI model and runs it within the application.

[0893] To collect and analyze a user's viewing history and interest data, the user's operation history and input data are used. For example, data on the content the user has viewed in the past and the fields in which the user has shown interest is collected. This enables personalized content recommendations.

[0894] For example, if a user is interested in rock music, information about rock-related videos they have watched in the past and artists they have shown an interest in can be collected, and the server can then use this data to recommend content that best suits the user's profile.

[0895] For example, the following prompt sentences are used:

[0896] "Recommend the latest rock videos suitable for users who are interested in rock music."

[0897] In this way, the present invention provides a system that allows users to easily create AI models customized to their needs and receive personalized content recommendations.

[0898] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0899] Step 1:

[0900] The user uses the terminal to input personal and objective data. The terminal interface provides a screen for interactively inputting this data. The input data is then stored in the terminal's memory.

[0901] Input: User's personal data and purpose data

[0902] Output: Data stored in the device's data storage area

[0903] Step 2:

[0904] The device sends the collected personal data and target data to the server, where the data is encrypted and securely transmitted via API.

[0905] Input: User data stored on the device

[0906] Output: User data sent to the server

[0907] Step 3:

[0908] The server analyzes the received user data and creates a customized generative AI model based on the user's needs. Specifically, it vectorizes the text data using TfidfVectorizer and calculates cosine similarity. It also trains the model using frameworks such as TensorFlow and PyTorch.

[0909] Input: User data sent to the server

[0910] Output: A customized generative AI model

[0911] Step 4:

[0912] The server registers the generated AI model on the marketplace, allowing other users to view and purchase the model.

[0913] Input: A customized generative AI model

[0914] Output: AI model registered in the marketplace

[0915] Step 5:

[0916] Other users search for and purchase generative AI models on the marketplace. Once the purchase process is complete, the server processes the purchase information and sends the AI ​​model to the buyer's device.

[0917] Input: Purchase procedure information

[0918] Output: The purchased AI model is sent.

[0919] Step 6:

[0920] The device receives the purchased AI model, installs it into the application, and runs it. The user gives the model instructions, which then generate data and respond based on those instructions.

[0921] Input: Submitted AI model

[0922] Output: The installed AI model runs and responds to the user.

[0923] Step 7:

[0924] The device collects and analyzes the user's viewing history and interest data to recommend personalized content. The viewing history and interest data are updated in real time based on the user's operations and input.

[0925] Input: User viewing history and interest data

[0926] Output: Recommended personalized content

[0927] Specifically, if a user inputs a prompt such as "Recommend the latest rock videos suitable for a user interested in rock music," the server will analyze the user's viewing history and interest data based on the prompt and recommend appropriate content to the user. This entire process is done in real time, improving the user experience.

[0928] The above is the processing steps of the application example and their specific explanation.

[0929] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0930] This invention is a system that allows users to create their own generative AI models and share and sell them with other users. In addition to conventional customization, this system combines an emotion engine that recognizes user emotions and responds and generates data based on those emotions to provide more advanced and personalized services.

[0931] System Configuration

[0932] The system includes the following elements:

[0933] 1. Server: Responsible for generating, registering, and managing AI models and operating the marketplace.

[0934] 2. Device: The device (e.g., smartphone, tablet) used by a user to create, purchase, or use a generative AI bot.

[0935] 3. User: A person who creates conversational AI bots and shares or sells them to other users.

[0936] 4. Emotion engine: A component that recognizes and analyzes emotions from user input data and text and voice during dialogue.

[0937] Explanation of program processing

[0938] Creating an AI Bot

[0939] User: Open the "Create AI Bot" menu in the LINE app and select "Create New."

[0940] User: Clicks the "Create New" button to begin the AI ​​bot creation flow.

[0941] Terminal: Ask the user questions about the functionality they want the bot to have and prompt them for personal and objective data.

[0942] Terminal: Display the question "What would you like your bot to do?"

[0943] User: Enters the bot's capabilities, basic data, and purpose.

[0944] User: Enter the following specific information: "I want to have a household accounting function. I want to be able to visualize my monthly income and expenses in graphs."

[0945] Terminal: Asks you to enter detailed data (e.g. income, expenses).

[0946] Terminal: Prompts the user to "Enter your monthly income and expenditure data."

[0947] User: Enter specific details.

[0948] User: Enter something like "Income: 300,000 yen, Expenses: 200,000 yen."

[0949] Terminal: Sends collected data to the server.

[0950] Device: Sends all collected data to the server via API calls.

[0951] Server: Creates and customizes a generative AI model based on the received data.

[0952] Server: Analyzes data, trains AI models based on the user's business logic, and generates customized models.

[0953] Server: Registers the completed AI model on the marketplace and notifies users.

[0954] Server: Registers the model in the marketplace and sends a notification message to the user's device stating that "AI bot creation and registration is complete."

[0955] On the device: Display a notification to the user that the model has been registered.

[0956] On your device: Display a notification message saying "AI bot creation and registration complete."

[0957] Use of Emotion Recognition in AI Bots

[0958] User: Also inputs emotional data to create an AI bot with an emotion engine.

[0959] User: When creating a bot, select "I want to include an emotion engine" and enter emotion data.

[0960] Terminal: Collects user input data and emotion data and sends them to the server.

[0961] Device: Sends collected data to the server via API calls.

[0962] Server: Analyzes the received emotion data, trains the emotion engine, and integrates it into a generative AI model.

[0963] Server: Analyzes emotion data, trains the emotion engine, and integrates it into the AI ​​model.

[0964] Server: Registers AI models equipped with emotion engines in the marketplace and notifies users.

[0965] Server: Registers and notifies models equipped with emotion engines on the marketplace.

[0966] Purchasing and Using AI Bots

[0967] User: Search for "Emotion Engine-powered Household Accounting Management AI" in the Marketplace and select it.

[0968] User: Use the Marketplace search function to select "Household accounting management AI with emotion engine."

[0969] User: Clicks the purchase button and enters the required payment information.

[0970] User: Clicks the purchase button and enters payment information to complete the purchase.

[0971] Server: Processes the purchase and sends the purchase information to the device after approval.

[0972] Server: Processes the purchase information and sends it to the device once authorization is complete.

[0973] On the device: Display a purchase completion notification to the user.

[0974] On the device: Display a "Purchase complete" message to the user.

[0975] Device: Download the AI ​​bot with the emotion engine you purchased and integrate it into the chat screen.

[0976] Device: Download the AI ​​bot and add it to the user's chat screen.

[0977] User: Uses an AI bot with an emotion engine to give instructions on managing household finances.

[0978] User: Texts in "Visualize my spending this month" and mentions feeling depressed.

[0979] Server: The emotion engine analyzes the user's emotions and generates a response accordingly.

[0980] Server: The emotion engine analyzes the "depressed" emotion from the user's input and generates a spending graph along with an encouraging message.

[0981] Terminal: Displays the response to the user.

[0982] Device: Display this month's spending graph along with a message like "Cheer up, you'll save more next month!"

[0983] In this way, a system integrating an emotion engine can provide personalized responses that reflect the user's emotions and assist the user more effectively than ever before. This provides a system that allows users to easily create and use customizable generative AI models that respond to their emotions as well as their needs.

[0984] The processing flow will be explained below.

[0985] Creating an AI Bot

[0986] Step 1:

[0987] User: Open the "Create AI Bot" menu in the LINE app and select "Create New."

[0988] How it works: The user clicks the "Create New" button to begin the AI ​​bot creation flow.

[0989] Step 2:

[0990] Terminal: Ask the user questions about the functionality they want the bot to have and prompt them for personal and objective data.

[0991] What it does: The device displays the question, "What functionality do you want your bot to have?"

[0992] Step 3:

[0993] User: Enters the bot's capabilities, basic data, and purpose.

[0994] Operation: The user specifically inputs, "I want to have a household accounting function. I want to visualize my monthly income and expenses in graphs."

[0995] Step 4:

[0996] Terminal: Asks you to enter detailed data (e.g. income, expenses).

[0997] How it works: The device asks the user to "Enter your monthly income and expenditure data."

[0998] Step 5:

[0999] User: Enter specific details.

[1000] How it works: The user enters something like "Income: 300,000 yen, Expenses: 200,000 yen."

[1001] Step 6:

[1002] Terminal: Sends collected data to the server.

[1003] How it works: The device sends all collected data to the server via API calls.

[1004] Step 7:

[1005] Server: Creates and customizes a generative AI model based on the received data.

[1006] How it works: The server analyzes the data, trains the AI ​​model based on the user's needs, and generates a customized model.

[1007] Step 8:

[1008] Server: Registers the completed AI model on the marketplace and notifies users.

[1009] Operation: The server registers the model in the marketplace and sends a notification message to the user's device saying "AI bot creation and registration completed."

[1010] Step 9:

[1011] On the device: Display a notification to the user that the model has been registered.

[1012] What it does: The device will display a notification message saying "AI bot creation and registration complete."

[1013] Use of Emotion Recognition in AI Bots

[1014] Step 1:

[1015] User: Also inputs emotional data to create an AI bot with an emotion engine.

[1016] How it works: The user selects the option "I want to include an emotion engine" and enters emotion data according to the format.

[1017] Step 2:

[1018] Terminal: Collects user input data and emotion data and sends them to the server.

[1019] How it works: The device collects all this data and sends it to the server via an API call.

[1020] Step 3:

[1021] Server: Analyzes the received emotion data, trains the emotion engine, and integrates it into a generative AI model.

[1022] How it works: The server analyzes emotion data and trains an emotion engine, which is then integrated into a generative AI model.

[1023] Step 4:

[1024] Server: Registers AI models equipped with emotion engines on the marketplace and notifies users.

[1025] Operation: The server registers the model integrating the emotion engine in the marketplace and sends a notification to the user's device.

[1026] Purchasing and Using AI Bots

[1027] Step 1:

[1028] User: Search for "Household accounting management AI with emotion engine" on the marketplace and select it.

[1029] How it works: The user uses the marketplace search function to select and choose "Household accounting management AI with emotion engine."

[1030] Step 2:

[1031] User: Clicks the purchase button and enters the required payment information.

[1032] What happens: The user clicks the buy button, enters payment information, and completes the purchase.

[1033] Step 3:

[1034] Server: Processes the purchase procedure and sends the purchase information to the terminal after approval.

[1035] Operation: The server processes the purchase information and, once approval is complete, sends the information to the user's terminal.

[1036] Step 4:

[1037] Terminal: Display a purchase completion notification to the user.

[1038] Action: The device displays a "Purchase Complete" message to the user.

[1039] Step 5:

[1040] Device: Download the AI ​​bot equipped with the purchased emotion engine and integrate it into the chat screen.

[1041] How it works: The device downloads the AI ​​bot and adds it to the user's chat screen.

[1042] Step 6:

[1043] User: Uses an AI bot equipped with an emotion engine to give instructions on managing household finances.

[1044] How it works: The user enters the text "Visualize my spending this month" and describes their emotional state.

[1045] Step 7:

[1046] Server: The emotion engine analyzes the user's emotions and generates appropriate responses accordingly.

[1047] Operation: The server launches the emotion engine, analyzes the user's emotion data, and generates emotion-matched response and expenditure graphs.

[1048] Step 8:

[1049] Server: Sends the generated response and expenditure graph to the user terminal.

[1050] Operation: The server sends an emotion-based response message and a spending graph to the user terminal.

[1051] Step 9:

[1052] Terminal: displays the response to the user.

[1053] What it does: Your device displays a graph of your spending this month along with an emotional message such as "Cheer up, you'll save more next month!"

[1054] In this way, a system integrating an emotion engine can provide personalized responses that reflect the user's emotions and assist the user more effectively than ever before. This provides a system that allows users to easily create and use customizable generative AI models that respond to their emotions as well as their needs.

[1055] Example 2

[1056] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1057] While conventional generative AI models were able to customize based on user needs, they lacked the ability to recognize and reflect user emotions, making it difficult to provide fully personalized responses. By solving this problem, there is a demand for systems that can improve the user experience and generate more effective responses and data.

[1058] The identification processing by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for collecting personal data and object data input by the user; means for analyzing the collected data and creating a generative AI model customized based on the user needs; means for registering the generative AI model in a marketplace; means for other users to purchase the generative AI model in the marketplace; means for the purchased generative AI model to operate in the user terminal and respond and generate data according to the user's instructions; means including an emotion analysis engine that recognizes and analyzes emotions from the user's input data and dialogue data; and means for responding and generating data using the emotion analysis engine based on the analyzed emotion data. This makes it possible to generate responses and data that reflect the user's emotions.

[1059] "Personal data" refers to information about an individual entered by a user, including the individual's attributes, preferences, behavioral history, and so on.

[1060] "Target data" refers to data that includes information about the intended use or function of the generated AI model.

[1061] A "generative artificial intelligence model" is a customized AI model that is generated based on the user's personal data and objective data.

[1062] A "marketplace" is an online platform where generative AI models can be registered and purchased by other users.

[1063] A "user device" is an electronic device used by a user to create, purchase, or use a generative AI model, including a smartphone or tablet.

[1064] An "emotion analysis engine" is a software component for recognizing and analyzing emotions from user input data and interaction data.

[1065] "Response and data generation" is the process by which a generative artificial intelligence model provides appropriate responses and information based on user instructions.

[1066] This invention relates to a system that allows users to create their own generative AI models and share or sell them with other users. In particular, by integrating an emotion analysis engine, it is possible to generate personalized responses and data that reflect the user's emotions. The system includes the following elements:

[1067] System Configuration

[1068] 1. Server:

[1069] Generates, registers, manages, and operates a marketplace for AI models.

[1070] The servers are located in a cloud environment, enabling high-speed processing and data analysis.

[1071] 2. Terminal:

[1072] A device used by a user to create, purchase, and use generative AI models, including smartphones and tablets.

[1073] The terminal is connected to the Internet and has a dedicated application installed for communicating with the server.

[1074] 3. User:

[1075] A person who interactively creates AI models and shares or sells them to other users.

[1076] Users operate the device to input the necessary data and customize the generative AI model.

[1077] 4. Sentiment Analysis Engine:

[1078] It is a software component that recognizes and analyzes emotions from user input data and text and voice during dialogue.

[1079] It is placed on a server and performs sentiment analysis in real time.

[1080] Overview of program processing

[1081] 1. Creating an AI Bot

[1082] The user accesses the "AI Bot Creation" menu using the LINE app on their device and selects "Create New." The device then asks the user what functions they would like the bot to have, and the user inputs their desired functions and purpose. For example, they can input "I want the bot to have a household accounting function." The device then prompts them to input specific data (e.g., monthly income and expenses). The input data is sent from the device to the server, which analyzes it and creates a generative AI model. The completed model is registered on the marketplace, and a notification that the model has been registered is sent to the user.

[1083] 2. Use of emotion recognition function

[1084] Users can choose whether to incorporate an emotion analysis engine when creating an AI bot. If emotion analysis is desired, the user also inputs emotion data, which is then sent to the server via the terminal. The server analyzes the received emotion data, trains the emotion engine, and integrates it into a generative AI model. The integrated model is then registered on the marketplace again and notified to the user.

[1085] 3. Purchasing and Using AI Bots

[1086] A user searches for and purchases a "household accounting management AI with an emotion engine" on the marketplace. After entering payment information and completing the purchase, the server processes the purchase information and sends it to the device. A notification is displayed indicating the purchase is complete, and the user downloads the purchased AI bot and integrates it into their chat screen. The user then types "Visualize this month's expenses" and conveys their emotional state. For example, if the user mentions that they are feeling depressed, the server uses the emotion analysis engine to generate an appropriate response and an expense graph, which are then sent to the device. The device then displays the generated response and graph to the user.

[1087] Specific examples

[1088] Example prompt sentence:

[1089] User: Clicks the "Create New" button to begin the AI ​​bot creation flow.

[1090] Terminal: Display the question "What would you like your bot to do?"

[1091] User: Enter the following specific information: "I want to have a household accounting function. I want to be able to visualize my monthly income and expenses in graphs."

[1092] Terminal: Prompts the user to "Enter your monthly income and expenditure data."

[1093] User: Enter something like "Income: 300,000 yen, Expenses: 200,000 yen."

[1094] This system provides a generative AI model that integrates an emotion analysis engine, enabling responses that reflect the user's emotions. Users can also use this to easily create and use customizable generative AI models, resulting in a highly effective user experience.

[1095] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1096] Step 1:

[1097] The user accesses the "Create AI Bot" menu in the LINE app on their device and selects "Create New."

[1098] (Input) User command: New creation

[1099] (Output) Display the next input prompt

[1100] (Operation) When the user clicks the "Create New" button, the system begins preparing to display the next input prompt.

[1101] Step 2:

[1102] The terminal asks questions about the features you want the bot to have.

[1103] (Input) "Create new" selected

[1104] (Output) The question "What functionality do you want your bot to have?"

[1105] (Action) The device displays the question on the screen: "What functionality do you want your bot to have?"

[1106] Step 3:

[1107] The user enters the bot's capabilities, basic data, and purpose.

[1108] (Input) User input: "I want to have a household accounting function. I want to visualize my monthly income and expenses in graphs."

[1109] (Output) Function and purpose information

[1110] (Operation) The user inputs specific functions (e.g., "I want to have a household accounting function") and purpose (e.g., "I want to visualize my monthly income and expenses in a graph").

[1111] Step 4:

[1112] The terminal will ask you to enter detailed data (e.g. monthly income, expenses).

[1113] (Input) Function and purpose information entered by the user

[1114] (Output) The question "Please enter your monthly income and expenditure data."

[1115] (Operation) The terminal asks the user to "Enter monthly income and expenditure data."

[1116] Step 5:

[1117] The user enters the details.

[1118] (Input) Specific data such as "Income: 300,000 yen, Expenses: 200,000 yen"

[1119] (Output) Detailed data

[1120] (Operation) The user enters specific figures such as "Income: 300,000 yen, Expenses: 200,000 yen." The device receives this and stores it as data.

[1121] Step 6:

[1122] The terminal transmits the collected data to the server.

[1123] (Input) All data entered by the user

[1124] (Output) API call sent to the server

[1125] (Operation) The device sends all collected data to the server via an API call.

[1126] Step 7:

[1127] The server creates and customizes a generative AI model based on the received data.

[1128] (Input) User data and detailed data sent from the terminal

[1129] (Output) Customized generative AI model

[1130] (Operation) The server analyzes the data, trains the AI ​​model based on the user's business logic, and generates a customized model.

[1131] Step 8:

[1132] The server registers the completed generative AI model on the marketplace and notifies the user.

[1133] (Input) Customized AI model generated by the server

[1134] (Output) Notification message "AI bot creation and registration completed."

[1135] (Operation) The server registers the generated AI model on the marketplace and sends a notification to the user device stating, "AI bot creation and registration has been completed."

[1136] Step 9:

[1137] The terminal displays a notification to the user that the model has been registered.

[1138] (Input) Notification message sent from the server

[1139] (Output) "AI bot creation and registration completed" message

[1140] (Operation) The device displays the message "AI bot creation and registration completed" on the screen.

[1141] Step 10:

[1142] Users also input emotional data to create AI bots with built-in emotion engines.

[1143] (Input) Input of selection and emotion data including emotion engine

[1144] (Output) Comprehensive emotion data

[1145] (Operation) The user selects to include the emotion engine and inputs emotion data. The device receives this and stores it as data.

[1146] Step 11:

[1147] The terminal collects the user's input data and emotion data and transmits them to the server.

[1148] (Input) Emotion data and user interaction data

[1149] (Output) API call sent to the server

[1150] (Operation) The device sends the collected data to the server via an API call.

[1151] Step 12:

[1152] The server analyzes the received emotion data, trains the emotion engine, and integrates it into a generative AI model.

[1153] (Input) Emotion data and user interaction data sent from the device

[1154] (Output) Generative AI model integrating emotion engine

[1155] (Operation) The server analyzes the emotion data, trains the emotion engine, and integrates it into a generative AI model.

[1156] Step 13:

[1157] The server registers the AI ​​model equipped with the emotion engine on the marketplace and notifies the user.

[1158] (Input) Generative AI model integrating emotion engine

[1159] (Output) Notification message: "AI model with emotion engine has been created."

[1160] (Operation) The server registers the AI ​​model equipped with the emotion engine in the marketplace and sends a completion notification to the user's device.

[1161] Step 14:

[1162] The device searches for and selects "household accounting management AI with emotion engine" in the marketplace.

[1163] (Input) Search criteria entered by the user

[1164] (Output) AI model list of search results

[1165] (Operation) The user searches for and selects a "household accounting management AI with an emotion engine" within the marketplace.

[1166] Step 15:

[1167] The user clicks the purchase button and enters the required payment information.

[1168] (Input) Payment information

[1169] (Output) Purchase completed status

[1170] (Action) The user presses the purchase button, enters payment information, and completes the purchase process.

[1171] Step 16:

[1172] The server processes the purchase procedure and, after approval, sends the purchase information to the terminal.

[1173] (Input) Payment Information Authorization

[1174] (Output) Purchase completion notification message

[1175] (Operation) The server processes the purchase information and, once approval is complete, sends the information to the terminal.

[1176] Step 17:

[1177] The terminal displays a purchase completion notification to the user.

[1178] (Input) Purchase completion notification message

[1179] (Output) "Purchase completed" message

[1180] (Operation) The device displays the message "Purchase completed."

[1181] Step 18:

[1182] The device downloads the AI ​​bot equipped with the purchased emotion engine and integrates it into the chat screen.

[1183] (Input) AI model download request

[1184] (Output) AI bot integrated into the chat screen

[1185] (Operation) The device downloads the AI ​​bot and adds it to the user's chat screen.

[1186] Step 19:

[1187] Users can use an AI bot equipped with an emotion engine to give instructions on managing their household finances.

[1188] (Input) Input of user instructions and emotions (e.g., "Visualize my expenses this month.")

[1189] (Output) Analysis request data and emotion data

[1190] (Action) The user gives a text prompt to describe their emotional state, for example, typing "I'm feeling depressed."

[1191] Step 20:

[1192] The server uses an emotion engine to analyze the user's emotions and generate a response accordingly.

[1193] (Input) User instructions and emotion data

[1194] (Output) Personalized responses and data

[1195] (Operation) The server uses an emotion engine to analyze the user's emotions and generates an appropriate response (e.g., an "encouraging message") and expenditure graph based on those emotions.

[1196] Step 21:

[1197] The terminal displays the response from the server to the user.

[1198] (Input) Response data from the server

[1199] (Output) Display of analysis results

[1200] (Operation) The terminal displays the generated responses and expenditure graph to the user, providing feedback adapted to the user's situation.

[1201] (Application example 2)

[1202] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1203] Many users today desire artificial intelligence models that they can customize themselves, but conventional systems have struggled to provide personalized services based on user emotions. Furthermore, providing appropriate service based on customer emotions in brick-and-mortar stores has been difficult, hindering customer satisfaction. To address these challenges, a system capable of recognizing user emotions and generating responses based on those emotions is needed.

[1204] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for collecting personal data and object data input by the user; means for analyzing the collected data and creating a generative AI model customized based on the user needs; means for registering the generative AI model in a marketplace; means for other users to purchase the generative AI model on the marketplace; means for the purchased generative AI model to operate in the user device and respond and generate data according to the user's instructions; means for analyzing the user's emotions and generating responses based thereon; and means for generating response data based on the emotions and providing personalized information to the user. This enables users to easily create their own generative AI models, share and sell them with other users, and further enables personalized services based on emotions to be provided.

[1205] "Personal data" refers to personal information about a user, including, for example, name, address, phone number, email address, lifestyle data, and the like.

[1206] "Purpose data" refers to data about the specific goals or objectives that a user wants to achieve with the generated AI model. For example, this could be for purposes such as household accounting, health management, or learning support.

[1207] A "generative artificial intelligence model" is an artificial intelligence model that is customized based on a user's personal data and objective data and is generated to perform a specific task or response.

[1208] A "marketplace" is an online platform where generative AI models are registered and can be searched, purchased, and used by other users.

[1209] "Analysis" is the act of processing collected data to extract and use information that meets user needs and objectives. This includes the application of data mining and machine learning algorithms.

[1210] "Analyzing emotions" refers to the process of identifying emotions from user input data, text during a conversation, voice, etc., and generating emotion data.

[1211] "Personalized information" refers to customized information provided according to a user's specific feelings and needs, and provides responses and services that are most appropriate for the user.

[1212] "Response data" is data that includes specific information or messages that are generated based on the user's instructions or feelings.

[1213] "User device" refers to a hardware device that allows a user to use a generative AI model, such as a smartphone, tablet, or smart glasses.

[1214] An "instruction" is an operation or command given by a user to a generative AI model, including a command to perform a specific task or response.

[1215] This invention is a system that allows users to create generative AI models and share and sell them with other users. This system incorporates an emotion engine that recognizes users' emotions and responds and generates data based on those emotions, thereby providing more advanced and personalized services. Components of this system include a server, a terminal, a user, and an emotion engine.

[1216] The server has the following features:

[1217] 1. Data collection function: Collects personal and purpose data entered by users. The collected data is used to create a generative artificial intelligence model customized based on the user's needs.

[1218] 2. Data analysis function: Analyzes collected data and creates customized generative AI models based on user needs. This is done using data mining and machine learning algorithms. Specific software examples include TensorFlow and PyTorch.

[1219] 3. Marketplace management function: The generated AI model is registered in the marketplace so that other users can search for, purchase, and use it. Purchased models are downloaded from the server to user devices.

[1220] 4. Emotion Recognition and Response Generation: Analyzes the user's emotions and generates responses based on them. The emotion engine uses an emotion recognition library such as Affectiva. Response generation uses a generative AI model such as OpenAI GPT-4.

[1221] The terminal has the following features:

[1222] 1. Data entry and transmission function: The user interactively enters personal data and objective data, which is then transmitted to the server.

[1223] 2. Emotional data capture function: Uses the camera and microphone of smart glasses or smartphones to capture emotional data such as the user's facial expressions and tone of voice.

[1224] 3. Response display function: The response data sent from the server is displayed to the user. The display device can be the display of smart glasses or the screen of a smartphone.

[1225] The user does the following:

[1226] 1. Data entry: Enter your personal data and purpose data into the terminal.

[1227] 2. Emotional Data Input: Use the emotion engine to input emotional data such as facial expressions and tone of voice.

[1228] 3. Response confirmation: Confirm and use the responses and data generation results provided by the generative AI model.

[1229] As a concrete example, consider a scenario in which smart glasses are used in a brick-and-mortar store. When a salesperson wears the smart glasses and selects a product using their gaze or voice, the customer's emotions are analyzed from their facial expressions and tone of voice. Based on the analysis results, an appropriate customer service script and product description are generated in real time and displayed on the glasses' display.

[1230] Specific examples of prompts are as follows:

[1231] "User's face shows a frown, and their voice tone is low."

[1232] The prompts for the generative AI model are:

[1233] Generate an appropriate customer response based on the following user sentiment data:

[1234] Facial expression: raised eyebrows, downturned corners of the mouth

[1235] Voice tone: low

[1236] "This product looks difficult to use, can you tell?"

[1237] This will enable the provision of personalized services to customers in physical stores, contributing to improved customer satisfaction.

[1238] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1239] Step 1:

[1240] The user uses the device to input personal data and purpose data, such as name, age, areas of interest, and purpose of use (e.g., household accounting) through the screen of smart glasses or a smartphone. This input data becomes the initial value of the system.

[1241] Step 2:

[1242] The device collects the personal and objective data entered and sends it to a server, which receives it via a secure protocol via an API call. The input data includes the user's identified goals and needs.

[1243] Step 3:

[1244] The server analyzes the received personal data and objective data to create a generative AI model customized based on the user's needs. Specifically, it uses data mining and machine learning algorithms, leveraging libraries such as TensorFlow and PyTorch. This analysis generates an AI model optimized for the user.

[1245] Step 4:

[1246] The server registers the generated generative AI model in the marketplace. This registration is added to the database within the system and becomes searchable by other users. The marketplace displays a description and features of the generative AI model.

[1247] Step 5:

[1248] When other users purchase a generative AI model on the marketplace, the server processes the purchase and makes the model available for download. The purchase process includes verifying and authenticating payment information. Once the purchase is complete, the model is downloaded to the user's device.

[1249] Step 6:

[1250] The purchased generative AI model runs within the user's device, responding to and generating data in response to user instructions. The device receives user instructions in the form of text or voice and sends them to a server.

[1251] Step 7:

[1252] The server analyzes the user's emotions, and a generative AI model generates a response based on that. An emotion recognition library (e.g., Affectiva) is used to determine emotions from the user's facial expressions and voice, and the generated emotion data is incorporated. A generative AI model such as OpenAI GPT-4 is used to generate responses.

[1253] Step 8:

[1254] The server generates personalized response data for the user and sends it to the device. An appropriate message is generated based on the user's emotions. This message may include encouragement or specific advice.

[1255] Step 9:

[1256] The device displays the response data sent from the server to the user, and the generated response message and related information are displayed on the smart glasses display or the smartphone screen, allowing the user to review it and decide on the next action.

[1257] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1258] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1259] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1260] [Third embodiment]

[1261] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1262] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1263] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1264] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1265] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1266] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1267] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1268] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1269] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1270] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1271] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1272] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1273] The present invention is a system that allows users to create their own generative AI models and share and sell them with other users. This system includes the means described in the claims and provides users with a simple and effective environment for customizing and using generative AI models.

[1274] System Configuration

[1275] The system includes the following elements:

[1276] 1. Server: Responsible for generating, registering, and managing AI models and operating the marketplace.

[1277] 2. Device: The device (e.g., smartphone, tablet) used by a user to create, purchase, or use a generative AI bot.

[1278] 3. User: A person who creates conversational AI bots and shares or sells them to other users.

[1279] Explanation of program processing

[1280] Creating an AI Bot

[1281] User: Open the "Create AI Bot" menu in the LINE app and select "Create New."

[1282] User: Start the creation flow by selecting "Create New" on the AI ​​bot creation screen.

[1283] Terminal: Ask the user questions about the functionality they want the bot to have and prompt them for personal and objective data.

[1284] Terminal: Display the question "What would you like your bot to do?"

[1285] User: Enters the bot's functionality and detailed data.

[1286] User: Enter "I want to have a household accounting function. I want to visualize my monthly income and expenses in graphs."

[1287] Terminal: Collects input data and sends it to the server.

[1288] Terminal: Sends collected data to the server via API.

[1289] Server: Creates and customizes a generative AI model based on the received data.

[1290] Server: Runs the generation engine, trains the AI ​​model based on user data, and saves the model once customization is complete.

[1291] Server: Registers the completed AI model on the marketplace and notifies the user that registration is complete.

[1292] Server: Registers the model on the marketplace and sends a notification to the device saying "AI bot creation and registration completed."

[1293] On the device: Display a notification to the user that the model has been registered.

[1294] On your device: Display a notification that says "AI bot creation and registration complete."

[1295] Purchasing and Using AI Bots

[1296] User: Search for "Household Accounting Management AI" in the Marketplace and select it.

[1297] User: Use the Marketplace search function to find and select "Household Accounting Management AI."

[1298] User: Clicks the purchase button and enters the required payment information.

[1299] User: Clicks the purchase button and enters payment information to complete the purchase.

[1300] Server: Processes the purchase and sends the purchase information to the device after approval.

[1301] Server: Processes the purchase information and, once authorization is complete, sends the information to the device.

[1302] On the device: Display a purchase completion notification to the user.

[1303] On your device: Display a "Purchase complete" notification to the user.

[1304] Device: Download the purchased AI bot and integrate it into the chat screen.

[1305] Device: Download the AI ​​bot and add it to the user's chat screen.

[1306] User: Uses an AI bot to give instructions on managing household finances.

[1307] User: Texts "Visualize my spending this month."

[1308] Server: Receives user instructions, generates graphs based on income and expenditure data, and sends the results to the user's device.

[1309] Server: Analyzes the instructions and returns the results to the user's device.

[1310] Terminal: Displays the response to the user.

[1311] Terminal: Shows the user a "This Month's Spending Graph."

[1312] Specific examples

[1313] For example, if a user were to create a household accounting management AI, the process would be as follows: The user would input "I want a household accounting management function" and provide detailed income and expenditure data. The server would generate an AI model based on this data and register it on the marketplace. Other users could then purchase and use this AI model, improving the efficiency of their lives and work.

[1314] In this way, the present invention provides a system that allows users to easily create and use generative AI models that meet their needs, thereby effectively resolving conventional problems.

[1315] The processing flow will be explained below.

[1316] Creating an AI Bot

[1317] Step 1:

[1318] User: Open the "Create AI Bot" menu in the LINE app and select "Create New."

[1319] How it works: The user clicks the "Create New" button to begin the AI ​​bot creation flow.

[1320] Step 2:

[1321] Terminal: Asks the user about the functions they want the bot to have and prompts them to enter personal and objective data.

[1322] What it does: The device displays the question, "What functionality do you want your bot to have?"

[1323] Step 3:

[1324] User: Enters the bot's functionality, basic data, and purpose.

[1325] Operation: The user specifically inputs, "I want to have a household accounting function. I want to visualize my monthly income and expenses in graphs."

[1326] Step 4:

[1327] Terminal: Asks you to enter detailed data (e.g. income, expenses).

[1328] How it works: The device asks the user to "Enter your monthly income and expenditure data."

[1329] Step 5:

[1330] User: Enters specific details.

[1331] How it works: The user enters something like "Income: 300,000 yen, Expenses: 200,000 yen."

[1332] Step 6:

[1333] Terminal: Sends collected data to the server.

[1334] How it works: The device sends all collected data to the server via API calls.

[1335] Step 7:

[1336] Server: Creates and customizes a generative AI model based on the received data.

[1337] How it works: The server analyzes the data, trains an AI model based on the user's business logic, and generates a customized model.

[1338] Step 8:

[1339] Server: Registers the completed AI model on the marketplace and notifies users.

[1340] Operation: The server sends a notification message to the user device saying "AI bot creation and registration completed."

[1341] Step 9:

[1342] Terminal: Display a notification to the user that the model has been registered.

[1343] What it does: The device will display a notification message saying "AI bot creation and registration complete."

[1344] Purchasing and Using AI Bots

[1345] Step 1:

[1346] User: Search for "Household Accounting Management AI" on the marketplace and select it.

[1347] How it works: A user uses the Marketplace search function to select "Household Accounting Management AI."

[1348] Step 2:

[1349] User: Clicks the purchase button and enters the required payment information.

[1350] How it works: The user presses the buy button and enters payment information to complete the purchase.

[1351] Step 3:

[1352] Server: Processes the purchase procedure and sends the purchase information to the terminal after approval.

[1353] How it works: The server processes the purchase information and, once approved, sends it to the device.

[1354] Step 4:

[1355] Terminal: Display a purchase completion notification to the user.

[1356] Action: The device displays a "Purchase Complete" message to the user.

[1357] Step 5:

[1358] Device: Download the purchased AI bot and integrate it into the chat screen.

[1359] How it works: The device downloads the AI ​​bot and adds it to the user's chat screen.

[1360] Step 6:

[1361] User: Uses an AI bot to give instructions on managing household finances.

[1362] How it works: The user types in the text "Visualize my spending this month."

[1363] Step 7:

[1364] Server: Receives user instructions, generates graphs based on income and expenditure data, and sends the results to the user's terminal.

[1365] Operation: The server analyzes the instructions, generates the graph, and then sends the results back to the user's terminal.

[1366] Step 8:

[1367] Terminal: displays the response to the user.

[1368] Action: The device displays a "This Month's Spending Graph" to the user.

[1369] Through these steps, users can create generative AI models that meet their needs and share or sell them with other users.

[1370] Example 1

[1371] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1372] Conventional generative AI models require users to have advanced technical knowledge to create them, making them difficult for general users to use. Furthermore, existing generative AI models often lack versatility and are unable to flexibly respond to the needs of individual users. Furthermore, there are limited ways to effectively share or sell generated models with other users, making it difficult to promote widespread use.

[1373] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1374] In this invention, the server includes means for collecting personal information and objective information input by a user, means for analyzing the collected information and creating a generative AI model customized based on the user's needs, means for registering the generative AI model on a marketplace, means for other users to purchase the generative AI model on the marketplace, means for the purchased generative AI model to operate within a user device and respond and generate data in accordance with user instructions, means for the user device to receive input from the user and transmit the input data to the server, and means for the server to generate graphs based on the user input data and transmit the results to the user terminal. This enables users, even without technical knowledge, to easily create, share, and sell generative AI models that meet their needs.

[1375] "Personal information" refers to specific data about a user, including individual information such as name, age, address, contact details, income and expenses.

[1376] "Objective information" refers to information that a user needs to accomplish a specific goal or task, such as household accounting, health management, or work efficiency improvement.

[1377] A "generative artificial intelligence model" is a customized artificial intelligence model created based on user input data and needs, and designed to perform a specific task.

[1378] "Marketplace" refers to an online platform or marketplace where generative artificial intelligence models are registered and available for purchase by other users.

[1379] A "user device" is a device used by a user to create, purchase, or use a generative artificial intelligence model, and includes electronic devices such as smartphones, tablets, and personal computers.

[1380] "Server" refers to a central computer that collects and analyzes data from users and creates, manages, and registers generative artificial intelligence models.

[1381] A "graph generation tool" is software or a library for creating visualizations based on collected data, including Chart.js and Matplotlib.

[1382] An "input form" is an interface for a user to input personal information or purpose information, and takes the form of, for example, a text box or a drop-down list.

[1383] "Payment System" means the payment processing system used when a user purchases a generative artificial intelligence model on the marketplace, including credit cards and online payment services.

[1384] This invention is a system that allows users to create their own generative AI models and share and sell them with other users. This system includes the means described in the claims and provides users with a simple and effective environment for customizing and using generative AI models.

[1385] System Configuration

[1386] The system includes the following elements:

[1387] 1. Server: A central computer that collects and analyzes data from users and creates, manages, and registers generative artificial intelligence models. Software used includes generation engines, natural language processing engines, payment systems, and graph generation tools (e.g., Chart.js and Matplotlib).

[1388] 2. Device: The device used by a user to create, purchase, or use a generative AI model. Specifically, this includes electronic devices such as smartphones, tablets, and PCs.

[1389] 3. User: A person who uses the system to create generative AI models and share or sell them with other users. Users input data using an interactive interface such as the LINE app.

[1390] Explanation of program processing

[1391] Creating an AI Bot

[1392] The user opens the "Create AI Bot" menu in the LINE app and selects "Create New." This starts the creation flow.

[1393] The terminal asks the user questions about the functions they want the bot to have and prompts them to enter personal information and purpose information. For example, the terminal displays a question such as, "What functions do you want the bot to have?"

[1394] The user inputs the bot's functions and detailed data. For example, they might input, "I want the bot to have a household accounting function. I want to visualize my monthly income and expenses in graphs."

[1395] The device collects the input data and sends it to the server, which sends the collected data as a POST request to the specified API endpoint.

[1396] The server analyzes the received data, launches the generation engine, and generates an AI model based on the user data. Once training is complete, the model is saved and registered in the marketplace.

[1397] Once the model registration is complete, the server will send a notification to the device stating, "AI bot creation and registration has been completed."

[1398] The terminal displays a notification to the user that the model registration has been completed.

[1399] Purchasing and Using AI Bots

[1400] Users search for "household accounting management AI" on the marketplace, select it, click the purchase button, and enter the required payment information to complete the purchase.

[1401] The server processes the purchase procedure and, after approval, sends the purchase information to the terminal.

[1402] The device will display a purchase completion notification to the user, download the purchased AI bot, and integrate it into the chat screen.

[1403] Users can use the AI ​​bot to give instructions for managing their household finances, such as "Visualize this month's expenses."

[1404] The server receives the user's instructions and generates a graph using a graph generation tool based on the income and expenditure data. The generated graph is sent to the user's terminal as image data.

[1405] The terminal displays the received graph image in the chat window.

[1406] Specific examples

[1407] For example, if a user were to create a household accounting management AI, the process would be as follows: The user would enter "I want a household accounting management function" through the LINE app and provide detailed information such as income and expenditure data. The server would then generate an AI model based on this data and register it on the marketplace. Other users could then purchase and use this AI model, improving the efficiency of their lives and work.

[1408] Prompt Sentence Examples

[1409] "Tell me your income and expenses this month."

[1410] "Set a budget for next month."

[1411] "Category my expenses and display them in a graph."

[1412] In this way, the present invention provides a system that allows users to easily create and use generative artificial intelligence models that meet their needs.

[1413] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1414] Step 1: User initiates bot creation

[1415] Input: The user opens the "Create AI Bot" menu in the LINE app and selects "Create New."

[1416] Data processing: Communicate to the terminal the information that the user selected to "create new."

[1417] Output: The terminal will display an interface to take you to the next step.

[1418] Specific actions: Launch the LINE app, select the appropriate menu, and tap the "Create New" button.

[1419] Step 2: Enter the bot's purpose and functionality

[1420] Input: The device asks the user about the capabilities they want the bot to have.

[1421] Data processing: Collect input data (text) received from the user.

[1422] Output: Text data entered by the user as a function or purpose.

[1423] Specific behavior: Display the question "What functionality do you want your bot to have?" on the terminal screen.

[1424] Step 3: User Enters Data

[1425] Input: The user enters the bot's functionality and detailed data.

[1426] Data processing: The entered data is temporarily stored on the device.

[1427] Output: Input data (e.g., household accounting function, income and expenditure data).

[1428] Specific actions: In the input form, write, "I want to have a household accounting function. I want to visualize my monthly income and expenses in graphs."

[1429] Step 4: Sending data

[1430] Input: Data collected by the device.

[1431] Data processing: Send a POST request to the server via the API.

[1432] Output: User input data sent to the server.

[1433] Specific behavior: The user completes the input and clicks the "Submit" button. The device sends the collected data to the specified API endpoint.

[1434] Step 5: The server receives and analyzes the data

[1435] Input: Data received by the server from the device.

[1436] Data processing: Validating, analyzing, and preparing incoming data for AI model generation.

[1437] Output: Data ready to generate an AI model.

[1438] What happens: The server validates the structure of the data and filters and cleanses it as needed.

[1439] Step 6: AI model generation

[1440] Input: Ready data.

[1441] Data processing: Train and customize AI models based on data.

[1442] Output: The completed AI model.

[1443] Specific operation: The server starts the generation engine, trains the AI ​​model based on the received data, and saves the model to storage once training is complete.

[1444] Step 7: Register your model on the Marketplace

[1445] Input: The completed AI model.

[1446] Data processing: Add metadata to the AI ​​model and publish it to the marketplace.

[1447] Output: An AI model registered in the marketplace.

[1448] Specific operation: The server registers and publishes information about the generated AI model in the model database.

[1449] Step 8: Registration completion notification

[1450] Input: Information about the AI ​​model registered in the marketplace.

[1451] Data processing: Generate a registration completion notice.

[1452] Output: A notification message that is displayed on the user's terminal.

[1453] Specific action: Send a notification to the device saying "AI bot creation and registration completed."

[1454] Step 9: User finds the bot

[1455] Input: User action.

[1456] Data Processing: Search for bots in the marketplace and view the list.

[1457] Output: Search results for "household accounting management AI".

[1458] What it does: Search for "household accounting management AI" in the marketplace and select the appropriate bot.

[1459] Step 10: Checkout the Bot

[1460] Input: User selected bot and payment information.

[1461] Data processing: Processing payment information and finalizing payments.

[1462] Output: Purchase complete message.

[1463] Specific operation: Enter payment information and click the purchase button. The server processes the payment through the payment system.

[1464] Step 11: Purchase completion notification

[1465] Input: Authorization information from payment system.

[1466] Data processing: Generates a notification of purchase completion.

[1467] Output: Messages that are displayed on the user's terminal.

[1468] Specific behavior: Display a notification message saying "Purchase completed."

[1469] Step 12: Download the AI ​​Bot

[1470] Input: Purchase information.

[1471] Data processing: Download data for the AI ​​bot.

[1472] Output: The downloaded AI bot.

[1473] Specific operation: Downloads the AI ​​bot's data from the server and integrates it into the user's chat screen.

[1474] Step 13: Users use the bot

[1475] Input: User instructions (prompt text).

[1476] Data processing: Analysis based on the expected task.

[1477] Output: Graph generation information.

[1478] Specific action: Enter "Visualize this month's expenses" and send the instruction to the server.

[1479] Step 14: Server processes the instruction

[1480] Input: User-specified data.

[1481] Data processing: instruction analysis, retrieval of income and expenditure data from database, graph generation.

[1482] Output: The generated graph image.

[1483] What it does: Parse instructions, get the necessary income and expenditure data, visualize it using a graph generation tool, and output it as image data.

[1484] Step 15: The terminal displays the response

[1485] Input: The generated graph image.

[1486] Data processing: Preparing received images for display.

[1487] Output: A graph that is displayed in the user's chat window.

[1488] Specific operation: The received graph image is displayed in the chat window and presented to the user in a visible form.

[1489] The above are the specific processing steps and details of this system.

[1490] (Application example 1)

[1491] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1492] Conventional generative AI model systems make it difficult for users to easily create and use AI models customized to their needs. In particular, content distribution services require personalized content recommendations based on users' viewing history and interests, but current systems are unable to effectively achieve this.

[1493] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1494] In this invention, the server includes means for collecting personal data and objective data input by a user, means for analyzing the collected data and creating a generative AI model customized based on user needs, means for registering the generative AI model in a marketplace, means for other users to purchase the generative AI model on the marketplace, means for the purchased generative AI model to operate within the user device and respond and generate data according to user instructions, means for collecting and analyzing the user's viewing history and interest data to recommend personalized content, and means for recommending content based on the user's interests. This allows users to easily create a customized AI model based on their needs and receive personalized content recommendations.

[1495] "User needs" refers to the individual requirements and expectations of users.

[1496] "Personal Data" is information about a user that is specific to that user and records that user's unique characteristics and preferences.

[1497] "Objective data" is information that a user inputs to achieve a specific objective.

[1498] A "generative artificial intelligence model" is an artificial intelligence program that is generated based on user input data and has the ability to perform specific tasks.

[1499] A "marketplace" is an online platform where users can publish their AI models and allow other users to purchase or share them.

[1500] A "viewing history" is a record of content that a user has viewed or listened to in the past.

[1501] "Interest data" is a collection of data that indicates the areas of interest and concerns of a user.

[1502] "Content recommendation" is the process of suggesting appropriate content based on a user's viewing history and interests.

[1503] "User device" refers to a terminal or device used by a user, such as a smartphone or tablet.

[1504] "Response and data generation" refers to the process of returning appropriate answers and generating necessary data in response to user instructions.

[1505] This invention is a system that allows users to create generative AI models and share or sell them with other users. The system includes the following elements:

[1506] First, the device used by the user (smartphone, tablet, PC, etc.) provides an interface for inputting personal data and objective data. By inputting this data interactively, the user can proceed to the next step.

[1507] The device sends the collected data to a server, which creates a generative AI model and registers it on the marketplace. Specifically, the server uses the following software and hardware:

[1508] For hardware, a server equipped with a high-performance processor and large memory capacity is required. Specifically, NVIDIA GPUs or Intel CPUs are recommended. For software, a programming language such as Python and a framework for training AI models such as TensorFlow or PyTorch are used.

[1509] The server analyzes the input data and creates a customized generative AI model based on the user's needs. To achieve this, it utilizes natural language processing and data analysis algorithms, such as vectorizing text data using TfidfVectorizer and comparing data using cosine similarity.

[1510] The generated AI model is registered in a marketplace. Other users can search for and purchase the generated AI model through this marketplace. Once the purchase procedure is complete, the server sends the purchased AI model to the user's device. The user's device downloads the received AI model and runs it within the application.

[1511] To collect and analyze a user's viewing history and interest data, the user's operation history and input data are used. For example, data on the content the user has viewed in the past and the fields in which the user has shown interest is collected. This enables personalized content recommendations.

[1512] For example, if a user is interested in rock music, information about rock-related videos they have watched in the past and artists they have shown an interest in can be collected, and the server can then use this data to recommend content that best suits the user's profile.

[1513] For example, the following prompt sentences are used:

[1514] "Recommend the latest rock videos suitable for users who are interested in rock music."

[1515] In this way, the present invention provides a system that allows users to easily create AI models customized to their needs and receive personalized content recommendations.

[1516] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1517] Step 1:

[1518] The user uses the terminal to input personal and objective data. The terminal interface provides a screen for interactively inputting this data. The input data is then stored in the terminal's memory.

[1519] Input: User's personal data and purpose data

[1520] Output: Data stored in the device's data storage area

[1521] Step 2:

[1522] The device sends the collected personal data and target data to the server, where the data is encrypted and securely transmitted via API.

[1523] Input: User data stored on the device

[1524] Output: User data sent to the server

[1525] Step 3:

[1526] The server analyzes the received user data and creates a customized generative AI model based on the user's needs. Specifically, it vectorizes the text data using TfidfVectorizer and calculates cosine similarity. It also trains the model using frameworks such as TensorFlow and PyTorch.

[1527] Input: User data sent to the server

[1528] Output: A customized generative AI model

[1529] Step 4:

[1530] The server registers the generated AI model on the marketplace, allowing other users to view and purchase the model.

[1531] Input: A customized generative AI model

[1532] Output: AI model registered in the marketplace

[1533] Step 5:

[1534] Other users search for and purchase generative AI models on the marketplace. Once the purchase process is complete, the server processes the purchase information and sends the AI ​​model to the buyer's device.

[1535] Input: Purchase procedure information

[1536] Output: The purchased AI model is sent.

[1537] Step 6:

[1538] The device receives the purchased AI model, installs it into the application, and runs it. The user gives the model instructions, which then generate data and respond based on those instructions.

[1539] Input: Submitted AI model

[1540] Output: The installed AI model runs and responds to the user.

[1541] Step 7:

[1542] The device collects and analyzes the user's viewing history and interest data to recommend personalized content. The viewing history and interest data are updated in real time based on the user's operations and input.

[1543] Input: User viewing history and interest data

[1544] Output: Recommended personalized content

[1545] Specifically, if a user inputs a prompt such as "Recommend the latest rock videos suitable for a user interested in rock music," the server will analyze the user's viewing history and interest data based on the prompt and recommend appropriate content to the user. This entire process is done in real time, improving the user experience.

[1546] The above is the processing steps of the application example and their specific explanation.

[1547] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1548] This invention is a system that allows users to create their own generative AI models and share and sell them with other users. In addition to conventional customization, this system combines an emotion engine that recognizes user emotions and responds and generates data based on those emotions to provide more advanced and personalized services.

[1549] System Configuration

[1550] The system includes the following elements:

[1551] 1. Server: Responsible for generating, registering, and managing AI models and operating the marketplace.

[1552] 2. Device: The device (e.g., smartphone, tablet) used by a user to create, purchase, or use a generative AI bot.

[1553] 3. User: A person who creates conversational AI bots and shares or sells them to other users.

[1554] 4. Emotion engine: A component that recognizes and analyzes emotions from user input data and text and voice during dialogue.

[1555] Explanation of program processing

[1556] Creating an AI Bot

[1557] User: Open the "Create AI Bot" menu in the LINE app and select "Create New."

[1558] User: Clicks the "Create New" button to begin the AI ​​bot creation flow.

[1559] Terminal: Ask the user questions about the functionality they want the bot to have and prompt them for personal and objective data.

[1560] Terminal: Display the question "What would you like your bot to do?"

[1561] User: Enters the bot's capabilities, basic data, and purpose.

[1562] User: Enter the following specific information: "I want to have a household accounting function. I want to be able to visualize my monthly income and expenses in graphs."

[1563] Terminal: Asks you to enter detailed data (e.g. income, expenses).

[1564] Terminal: Prompts the user to "Enter your monthly income and expenditure data."

[1565] User: Enter specific details.

[1566] User: Enter something like "Income: 300,000 yen, Expenses: 200,000 yen."

[1567] Terminal: Sends collected data to the server.

[1568] Device: Sends all collected data to the server via API calls.

[1569] Server: Creates and customizes a generative AI model based on the received data.

[1570] Server: Analyzes data, trains AI models based on the user's business logic, and generates customized models.

[1571] Server: Registers the completed AI model on the marketplace and notifies users.

[1572] Server: Registers the model in the marketplace and sends a notification message to the user's device stating that "AI bot creation and registration is complete."

[1573] On the device: Display a notification to the user that the model has been registered.

[1574] On your device: Display a notification message saying "AI bot creation and registration complete."

[1575] Use of Emotion Recognition in AI Bots

[1576] User: Also inputs emotional data to create an AI bot with an emotion engine.

[1577] User: When creating a bot, select "I want to include an emotion engine" and enter emotion data.

[1578] Terminal: Collects user input data and emotion data and sends them to the server.

[1579] Device: Sends collected data to the server via API calls.

[1580] Server: Analyzes the received emotion data, trains the emotion engine, and integrates it into a generative AI model.

[1581] Server: Analyzes emotion data, trains the emotion engine, and integrates it into the AI ​​model.

[1582] Server: Registers AI models equipped with emotion engines in the marketplace and notifies users.

[1583] Server: Registers and notifies models equipped with emotion engines on the marketplace.

[1584] Purchasing and Using AI Bots

[1585] User: Search for "Emotion Engine-powered Household Accounting Management AI" in the Marketplace and select it.

[1586] User: Use the Marketplace search function to select "Household accounting management AI with emotion engine."

[1587] User: Clicks the purchase button and enters the required payment information.

[1588] User: Clicks the purchase button and enters payment information to complete the purchase.

[1589] Server: Processes the purchase and sends the purchase information to the device after approval.

[1590] Server: Processes the purchase information and sends it to the device once authorization is complete.

[1591] On the device: Display a purchase completion notification to the user.

[1592] On the device: Display a "Purchase complete" message to the user.

[1593] Device: Download the AI ​​bot with the emotion engine you purchased and integrate it into the chat screen.

[1594] Device: Download the AI ​​bot and add it to the user's chat screen.

[1595] User: Uses an AI bot with an emotion engine to give instructions on managing household finances.

[1596] User: Texts in "Visualize my spending this month" and mentions feeling depressed.

[1597] Server: The emotion engine analyzes the user's emotions and generates a response accordingly.

[1598] Server: The emotion engine analyzes the "depressed" emotion from the user's input and generates a spending graph along with an encouraging message.

[1599] Terminal: Displays the response to the user.

[1600] Device: Display this month's spending graph along with a message like "Cheer up, you'll save more next month!"

[1601] In this way, a system integrating an emotion engine can provide personalized responses that reflect the user's emotions and assist the user more effectively than ever before. This provides a system that allows users to easily create and use customizable generative AI models that respond to their emotions as well as their needs.

[1602] The processing flow will be explained below.

[1603] Creating an AI Bot

[1604] Step 1:

[1605] User: Open the "Create AI Bot" menu in the LINE app and select "Create New."

[1606] How it works: The user clicks the "Create New" button to begin the AI ​​bot creation flow.

[1607] Step 2:

[1608] Terminal: Ask the user questions about the functionality they want the bot to have and prompt them for personal and objective data.

[1609] What it does: The device displays the question, "What functionality do you want your bot to have?"

[1610] Step 3:

[1611] User: Enters the bot's capabilities, basic data, and purpose.

[1612] Operation: The user specifically inputs, "I want to have a household accounting function. I want to visualize my monthly income and expenses in graphs."

[1613] Step 4:

[1614] Terminal: Asks you to enter detailed data (e.g. income, expenses).

[1615] How it works: The device asks the user to "Enter your monthly income and expenditure data."

[1616] Step 5:

[1617] User: Enter specific details.

[1618] How it works: The user enters something like "Income: 300,000 yen, Expenses: 200,000 yen."

[1619] Step 6:

[1620] Terminal: Sends collected data to the server.

[1621] How it works: The device sends all collected data to the server via API calls.

[1622] Step 7:

[1623] Server: Creates and customizes a generative AI model based on the received data.

[1624] How it works: The server analyzes the data, trains the AI ​​model based on the user's needs, and generates a customized model.

[1625] Step 8:

[1626] Server: Registers the completed AI model on the marketplace and notifies users.

[1627] Operation: The server registers the model in the marketplace and sends a notification message to the user's device saying "AI bot creation and registration completed."

[1628] Step 9:

[1629] On the device: Display a notification to the user that the model has been registered.

[1630] What it does: The device will display a notification message saying "AI bot creation and registration complete."

[1631] Use of Emotion Recognition in AI Bots

[1632] Step 1:

[1633] User: Also inputs emotional data to create an AI bot with an emotion engine.

[1634] How it works: The user selects the option "I want to include an emotion engine" and enters emotion data according to the format.

[1635] Step 2:

[1636] Terminal: Collects user input data and emotion data and sends them to the server.

[1637] How it works: The device collects all this data and sends it to the server via an API call.

[1638] Step 3:

[1639] Server: Analyzes the received emotion data, trains the emotion engine, and integrates it into a generative AI model.

[1640] How it works: The server analyzes emotion data and trains an emotion engine, which is then integrated into a generative AI model.

[1641] Step 4:

[1642] Server: Registers AI models equipped with emotion engines on the marketplace and notifies users.

[1643] Operation: The server registers the model integrating the emotion engine in the marketplace and sends a notification to the user's device.

[1644] Purchasing and Using AI Bots

[1645] Step 1:

[1646] User: Search for "Household accounting management AI with emotion engine" on the marketplace and select it.

[1647] How it works: The user uses the marketplace search function to select and choose "Household accounting management AI with emotion engine."

[1648] Step 2:

[1649] User: Clicks the purchase button and enters the required payment information.

[1650] What happens: The user clicks the buy button, enters payment information, and completes the purchase.

[1651] Step 3:

[1652] Server: Processes the purchase procedure and sends the purchase information to the terminal after approval.

[1653] Operation: The server processes the purchase information and, once approval is complete, sends the information to the user's terminal.

[1654] Step 4:

[1655] Terminal: Display a purchase completion notification to the user.

[1656] Action: The device displays a "Purchase Complete" message to the user.

[1657] Step 5:

[1658] Device: Download the AI ​​bot equipped with the purchased emotion engine and integrate it into the chat screen.

[1659] How it works: The device downloads the AI ​​bot and adds it to the user's chat screen.

[1660] Step 6:

[1661] User: Uses an AI bot equipped with an emotion engine to give instructions on managing household finances.

[1662] How it works: The user enters the text "Visualize my spending this month" and describes their emotional state.

[1663] Step 7:

[1664] Server: The emotion engine analyzes the user's emotions and generates appropriate responses accordingly.

[1665] Operation: The server launches the emotion engine, analyzes the user's emotion data, and generates emotion-matched response and expenditure graphs.

[1666] Step 8:

[1667] Server: Sends the generated response and expenditure graph to the user terminal.

[1668] Operation: The server sends an emotion-based response message and a spending graph to the user terminal.

[1669] Step 9:

[1670] Terminal: displays the response to the user.

[1671] What it does: Your device displays a graph of your spending this month along with an emotional message such as "Cheer up, you'll save more next month!"

[1672] In this way, a system integrating an emotion engine can provide personalized responses that reflect the user's emotions and assist the user more effectively than ever before. This provides a system that allows users to easily create and use customizable generative AI models that respond to their emotions as well as their needs.

[1673] Example 2

[1674] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1675] While conventional generative AI models were able to customize based on user needs, they lacked the ability to recognize and reflect user emotions, making it difficult to provide fully personalized responses. By solving this problem, there is a demand for systems that can improve the user experience and generate more effective responses and data.

[1676] The identification processing by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for collecting personal data and object data input by the user; means for analyzing the collected data and creating a generative AI model customized based on the user needs; means for registering the generative AI model in a marketplace; means for other users to purchase the generative AI model in the marketplace; means for the purchased generative AI model to operate in the user terminal and respond and generate data according to the user's instructions; means including an emotion analysis engine that recognizes and analyzes emotions from the user's input data and dialogue data; and means for responding and generating data using the emotion analysis engine based on the analyzed emotion data. This makes it possible to generate responses and data that reflect the user's emotions.

[1677] "Personal data" refers to information about an individual entered by a user, including the individual's attributes, preferences, behavioral history, and so on.

[1678] "Target data" refers to data that includes information about the intended use or function of the generated AI model.

[1679] A "generative artificial intelligence model" is a customized AI model that is generated based on the user's personal data and objective data.

[1680] A "marketplace" is an online platform where generative AI models can be registered and purchased by other users.

[1681] A "user device" is an electronic device used by a user to create, purchase, or use a generative AI model, including a smartphone or tablet.

[1682] An "emotion analysis engine" is a software component for recognizing and analyzing emotions from user input data and interaction data.

[1683] "Response and data generation" is the process by which a generative artificial intelligence model provides appropriate responses and information based on user instructions.

[1684] This invention relates to a system that allows users to create their own generative AI models and share or sell them with other users. In particular, by integrating an emotion analysis engine, it is possible to generate personalized responses and data that reflect the user's emotions. The system includes the following elements:

[1685] System Configuration

[1686] 1. Server:

[1687] Generates, registers, manages, and operates a marketplace for AI models.

[1688] The servers are located in a cloud environment, enabling high-speed processing and data analysis.

[1689] 2. Terminal:

[1690] A device used by a user to create, purchase, and use generative AI models, including smartphones and tablets.

[1691] The terminal is connected to the Internet and has a dedicated application installed for communicating with the server.

[1692] 3. User:

[1693] A person who interactively creates AI models and shares or sells them to other users.

[1694] Users operate the device to input the necessary data and customize the generative AI model.

[1695] 4. Sentiment Analysis Engine:

[1696] It is a software component that recognizes and analyzes emotions from user input data and text and voice during dialogue.

[1697] It is placed on a server and performs sentiment analysis in real time.

[1698] Overview of program processing

[1699] 1. Creating an AI Bot

[1700] The user accesses the "AI Bot Creation" menu using the LINE app on their device and selects "Create New." The device then asks the user what functions they would like the bot to have, and the user inputs their desired functions and purpose. For example, they can input "I want the bot to have a household accounting function." The device then prompts them to input specific data (e.g., monthly income and expenses). The input data is sent from the device to the server, which analyzes it and creates a generative AI model. The completed model is registered on the marketplace, and a notification that the model has been registered is sent to the user.

[1701] 2. Use of emotion recognition function

[1702] Users can choose whether to incorporate an emotion analysis engine when creating an AI bot. If emotion analysis is desired, the user also inputs emotion data, which is then sent to the server via the terminal. The server analyzes the received emotion data, trains the emotion engine, and integrates it into a generative AI model. The integrated model is then registered on the marketplace again and notified to the user.

[1703] 3. Purchasing and Using AI Bots

[1704] A user searches for and purchases a "household accounting management AI with an emotion engine" on the marketplace. After entering payment information and completing the purchase, the server processes the purchase information and sends it to the device. A notification is displayed indicating the purchase is complete, and the user downloads the purchased AI bot and integrates it into their chat screen. The user then types "Visualize this month's expenses" and conveys their emotional state. For example, if the user mentions that they are feeling depressed, the server uses the emotion analysis engine to generate an appropriate response and an expense graph, which are then sent to the device. The device then displays the generated response and graph to the user.

[1705] Specific examples

[1706] Example prompt sentence:

[1707] User: Clicks the "Create New" button to begin the AI ​​bot creation flow.

[1708] Terminal: Display the question "What would you like your bot to do?"

[1709] User: Enter the following specific information: "I want to have a household accounting function. I want to be able to visualize my monthly income and expenses in graphs."

[1710] Terminal: Prompts the user to "Enter your monthly income and expenditure data."

[1711] User: Enter something like "Income: 300,000 yen, Expenses: 200,000 yen."

[1712] This system provides a generative AI model that integrates an emotion analysis engine, enabling responses that reflect the user's emotions. Users can also use this to easily create and use customizable generative AI models, resulting in a highly effective user experience.

[1713] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1714] Step 1:

[1715] The user accesses the "Create AI Bot" menu in the LINE app on their device and selects "Create New."

[1716] (Input) User command: New creation

[1717] (Output) Display the next input prompt

[1718] (Operation) When the user clicks the "Create New" button, the system begins preparing to display the next input prompt.

[1719] Step 2:

[1720] The terminal asks questions about the features you want the bot to have.

[1721] (Input) "Create new" selected

[1722] (Output) The question "What functionality do you want your bot to have?"

[1723] (Action) The device displays the question on the screen: "What functionality do you want your bot to have?"

[1724] Step 3:

[1725] The user enters the bot's capabilities, basic data, and purpose.

[1726] (Input) User input: "I want to have a household accounting function. I want to visualize my monthly income and expenses in graphs."

[1727] (Output) Function and purpose information

[1728] (Operation) The user inputs specific functions (e.g., "I want to have a household accounting function") and purpose (e.g., "I want to visualize my monthly income and expenses in a graph").

[1729] Step 4:

[1730] The terminal will ask you to enter detailed data (e.g. monthly income, expenses).

[1731] (Input) Function and purpose information entered by the user

[1732] (Output) The question "Please enter your monthly income and expenditure data."

[1733] (Operation) The terminal asks the user to "Enter monthly income and expenditure data."

[1734] Step 5:

[1735] The user enters the details.

[1736] (Input) Specific data such as "Income: 300,000 yen, Expenses: 200,000 yen"

[1737] (Output) Detailed data

[1738] (Operation) The user enters specific figures such as "Income: 300,000 yen, Expenses: 200,000 yen." The device receives this and stores it as data.

[1739] Step 6:

[1740] The terminal transmits the collected data to the server.

[1741] (Input) All data entered by the user

[1742] (Output) API call sent to the server

[1743] (Operation) The device sends all collected data to the server via an API call.

[1744] Step 7:

[1745] The server creates and customizes a generative AI model based on the received data.

[1746] (Input) User data and detailed data sent from the terminal

[1747] (Output) Customized generative AI model

[1748] (Operation) The server analyzes the data, trains the AI ​​model based on the user's business logic, and generates a customized model.

[1749] Step 8:

[1750] The server registers the completed generative AI model on the marketplace and notifies the user.

[1751] (Input) Customized AI model generated by the server

[1752] (Output) Notification message "AI bot creation and registration completed."

[1753] (Operation) The server registers the generated AI model on the marketplace and sends a notification to the user device stating, "AI bot creation and registration has been completed."

[1754] Step 9:

[1755] The terminal displays a notification to the user that the model has been registered.

[1756] (Input) Notification message sent from the server

[1757] (Output) "AI bot creation and registration completed" message

[1758] (Operation) The device displays the message "AI bot creation and registration completed" on the screen.

[1759] Step 10:

[1760] Users also input emotional data to create AI bots with built-in emotion engines.

[1761] (Input) Input of selection and emotion data including emotion engine

[1762] (Output) Comprehensive emotion data

[1763] (Operation) The user selects to include the emotion engine and inputs emotion data. The device receives this and stores it as data.

[1764] Step 11:

[1765] The terminal collects the user's input data and emotion data and transmits them to the server.

[1766] (Input) Emotion data and user interaction data

[1767] (Output) API call sent to the server

[1768] (Operation) The device sends the collected data to the server via an API call.

[1769] Step 12:

[1770] The server analyzes the received emotion data, trains the emotion engine, and integrates it into a generative AI model.

[1771] (Input) Emotion data and user interaction data sent from the device

[1772] (Output) Generative AI model integrating emotion engine

[1773] (Operation) The server analyzes the emotion data, trains the emotion engine, and integrates it into a generative AI model.

[1774] Step 13:

[1775] The server registers the AI ​​model equipped with the emotion engine on the marketplace and notifies the user.

[1776] (Input) Generative AI model integrating emotion engine

[1777] (Output) Notification message: "AI model with emotion engine has been created."

[1778] (Operation) The server registers the AI ​​model equipped with the emotion engine in the marketplace and sends a completion notification to the user's device.

[1779] Step 14:

[1780] The device searches for and selects "household accounting management AI with emotion engine" in the marketplace.

[1781] (Input) Search criteria entered by the user

[1782] (Output) AI model list of search results

[1783] (Operation) The user searches for and selects a "household accounting management AI with an emotion engine" within the marketplace.

[1784] Step 15:

[1785] The user clicks the purchase button and enters the required payment information.

[1786] (Input) Payment information

[1787] (Output) Purchase completed status

[1788] (Action) The user presses the purchase button, enters payment information, and completes the purchase process.

[1789] Step 16:

[1790] The server processes the purchase procedure and, after approval, sends the purchase information to the terminal.

[1791] (Input) Payment Information Authorization

[1792] (Output) Purchase completion notification message

[1793] (Operation) The server processes the purchase information and, once approval is complete, sends the information to the terminal.

[1794] Step 17:

[1795] The terminal displays a purchase completion notification to the user.

[1796] (Input) Purchase completion notification message

[1797] (Output) "Purchase completed" message

[1798] (Operation) The device displays the message "Purchase completed."

[1799] Step 18:

[1800] The device downloads the AI ​​bot equipped with the purchased emotion engine and integrates it into the chat screen.

[1801] (Input) AI model download request

[1802] (Output) AI bot integrated into the chat screen

[1803] (Operation) The device downloads the AI ​​bot and adds it to the user's chat screen.

[1804] Step 19:

[1805] Users can use an AI bot equipped with an emotion engine to give instructions on managing their household finances.

[1806] (Input) Input of user instructions and emotions (e.g., "Visualize my expenses this month.")

[1807] (Output) Analysis request data and emotion data

[1808] (Action) The user gives a text prompt to describe their emotional state, for example, typing "I'm feeling depressed."

[1809] Step 20:

[1810] The server uses an emotion engine to analyze the user's emotions and generate a response accordingly.

[1811] (Input) User instructions and emotion data

[1812] (Output) Personalized responses and data

[1813] (Operation) The server uses an emotion engine to analyze the user's emotions and generates an appropriate response (e.g., an "encouraging message") and expenditure graph based on those emotions.

[1814] Step 21:

[1815] The terminal displays the response from the server to the user.

[1816] (Input) Response data from the server

[1817] (Output) Display of analysis results

[1818] (Operation) The terminal displays the generated responses and expenditure graph to the user, providing feedback adapted to the user's situation.

[1819] (Application example 2)

[1820] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1821] Many users today desire artificial intelligence models that they can customize themselves, but conventional systems have struggled to provide personalized services based on user emotions. Furthermore, providing appropriate service based on customer emotions in brick-and-mortar stores has been difficult, hindering customer satisfaction. To address these challenges, a system capable of recognizing user emotions and generating responses based on those emotions is needed.

[1822] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for collecting personal data and object data input by the user; means for analyzing the collected data and creating a generative AI model customized based on the user needs; means for registering the generative AI model in a marketplace; means for other users to purchase the generative AI model on the marketplace; means for the purchased generative AI model to operate in the user device and respond and generate data according to the user's instructions; means for analyzing the user's emotions and generating responses based thereon; and means for generating response data based on the emotions and providing personalized information to the user. This enables users to easily create their own generative AI models, share and sell them with other users, and further enables personalized services based on emotions to be provided.

[1823] "Personal data" refers to personal information about a user, including, for example, name, address, phone number, email address, lifestyle data, and the like.

[1824] "Purpose data" refers to data about the specific goals or objectives that a user wants to achieve with the generated AI model. For example, this could be for purposes such as household accounting, health management, or learning support.

[1825] A "generative artificial intelligence model" is an artificial intelligence model that is customized based on a user's personal data and objective data and is generated to perform a specific task or response.

[1826] A "marketplace" is an online platform where generative AI models are registered and can be searched, purchased, and used by other users.

[1827] "Analysis" is the act of processing collected data to extract and use information that meets user needs and objectives. This includes the application of data mining and machine learning algorithms.

[1828] "Analyzing emotions" refers to the process of identifying emotions from user input data, text during a conversation, voice, etc., and generating emotion data.

[1829] "Personalized information" refers to customized information provided according to a user's specific feelings and needs, and provides responses and services that are most appropriate for the user.

[1830] "Response data" is data that includes specific information or messages that are generated based on the user's instructions or feelings.

[1831] "User device" refers to a hardware device that allows a user to use a generative AI model, such as a smartphone, tablet, or smart glasses.

[1832] An "instruction" is an operation or command given by a user to a generative AI model, including a command to perform a specific task or response.

[1833] This invention is a system that allows users to create generative AI models and share and sell them with other users. This system incorporates an emotion engine that recognizes users' emotions and responds and generates data based on those emotions, thereby providing more advanced and personalized services. Components of this system include a server, a terminal, a user, and an emotion engine.

[1834] The server has the following features:

[1835] 1. Data collection function: Collects personal and purpose data entered by users. The collected data is used to create a generative artificial intelligence model customized based on the user's needs.

[1836] 2. Data analysis function: Analyzes collected data and creates customized generative AI models based on user needs. This is done using data mining and machine learning algorithms. Specific software examples include TensorFlow and PyTorch.

[1837] 3. Marketplace management function: The generated AI model is registered in the marketplace so that other users can search for, purchase, and use it. Purchased models are downloaded from the server to user devices.

[1838] 4. Emotion Recognition and Response Generation: Analyzes the user's emotions and generates responses based on them. The emotion engine uses an emotion recognition library such as Affectiva. Response generation uses a generative AI model such as OpenAI GPT-4.

[1839] The terminal has the following features:

[1840] 1. Data entry and transmission function: The user interactively enters personal data and objective data, which is then transmitted to the server.

[1841] 2. Emotional data capture function: Uses the camera and microphone of smart glasses or smartphones to capture emotional data such as the user's facial expressions and tone of voice.

[1842] 3. Response display function: The response data sent from the server is displayed to the user. The display device can be the display of smart glasses or the screen of a smartphone.

[1843] The user does the following:

[1844] 1. Data entry: Enter your personal data and purpose data into the terminal.

[1845] 2. Emotional Data Input: Use the emotion engine to input emotional data such as facial expressions and tone of voice.

[1846] 3. Response confirmation: Confirm and use the responses and data generation results provided by the generative AI model.

[1847] As a concrete example, consider a scenario in which smart glasses are used in a brick-and-mortar store. When a salesperson wears the smart glasses and selects a product using their gaze or voice, the customer's emotions are analyzed from their facial expressions and tone of voice. Based on the analysis results, an appropriate customer service script and product description are generated in real time and displayed on the glasses' display.

[1848] Specific examples of prompts are as follows:

[1849] "User's face shows a frown, and their voice tone is low."

[1850] The prompts for the generative AI model are:

[1851] Generate an appropriate customer response based on the following user sentiment data:

[1852] Facial expression: raised eyebrows, downturned corners of the mouth

[1853] Voice tone: low

[1854] "This product looks difficult to use, can you tell?"

[1855] This will enable the provision of personalized services to customers in physical stores, contributing to improved customer satisfaction.

[1856] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1857] Step 1:

[1858] The user uses the device to input personal data and purpose data, such as name, age, areas of interest, and purpose of use (e.g., household accounting) through the screen of smart glasses or a smartphone. This input data becomes the initial value of the system.

[1859] Step 2:

[1860] The device collects the personal and objective data entered and sends it to a server, which receives it via a secure protocol via an API call. The input data includes the user's identified goals and needs.

[1861] Step 3:

[1862] The server analyzes the received personal data and objective data to create a generative AI model customized based on the user's needs. Specifically, it uses data mining and machine learning algorithms, leveraging libraries such as TensorFlow and PyTorch. This analysis generates an AI model optimized for the user.

[1863] Step 4:

[1864] The server registers the generated generative AI model in the marketplace. This registration is added to the database within the system and becomes searchable by other users. The marketplace displays a description and features of the generative AI model.

[1865] Step 5:

[1866] When other users purchase a generative AI model on the marketplace, the server processes the purchase and makes the model available for download. The purchase process includes verifying and authenticating payment information. Once the purchase is complete, the model is downloaded to the user's device.

[1867] Step 6:

[1868] The purchased generative AI model runs within the user's device, responding to and generating data in response to user instructions. The device receives user instructions in the form of text or voice and sends them to a server.

[1869] Step 7:

[1870] The server analyzes the user's emotions, and a generative AI model generates a response based on that. An emotion recognition library (e.g., Affectiva) is used to determine emotions from the user's facial expressions and voice, and the generated emotion data is incorporated. A generative AI model such as OpenAI GPT-4 is used to generate responses.

[1871] Step 8:

[1872] The server generates personalized response data for the user and sends it to the device. An appropriate message is generated based on the user's emotions. This message may include encouragement or specific advice.

[1873] Step 9:

[1874] The device displays the response data sent from the server to the user, and the generated response message and related information are displayed on the smart glasses display or the smartphone screen, allowing the user to review it and decide on the next action.

[1875] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1876] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1877] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1878] [Fourth embodiment]

[1879] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1880] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1881] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1882] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1883] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1884] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1885] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1886] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1887] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1888] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1889] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1890] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1891] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1892] The present invention is a system that allows users to create their own generative AI models and share and sell them with other users. This system includes the means described in the claims and provides users with a simple and effective environment for customizing and using generative AI models.

[1893] System Configuration

[1894] The system includes the following elements:

[1895] 1. Server: Responsible for generating, registering, and managing AI models and operating the marketplace.

[1896] 2. Device: The device (e.g., smartphone, tablet) used by a user to create, purchase, or use a generative AI bot.

[1897] 3. User: A person who creates conversational AI bots and shares or sells them to other users.

[1898] Explanation of program processing

[1899] Creating an AI Bot

[1900] User: Open the "Create AI Bot" menu in the LINE app and select "Create New."

[1901] User: Start the creation flow by selecting "Create New" on the AI ​​bot creation screen.

[1902] Terminal: Ask the user questions about the functionality they want the bot to have and prompt them for personal and objective data.

[1903] Terminal: Display the question "What would you like your bot to do?"

[1904] User: Enters the bot's functionality and detailed data.

[1905] User: Enter "I want to have a household accounting function. I want to visualize my monthly income and expenses in graphs."

[1906] Terminal: Collects input data and sends it to the server.

[1907] Terminal: Sends collected data to the server via API.

[1908] Server: Creates and customizes a generative AI model based on the received data.

[1909] Server: Runs the generation engine, trains the AI ​​model based on user data, and saves the model once customization is complete.

[1910] Server: Registers the completed AI model on the marketplace and notifies the user that registration is complete.

[1911] Server: Registers the model on the marketplace and sends a notification to the device saying "AI bot creation and registration completed."

[1912] On the device: Display a notification to the user that the model has been registered.

[1913] On your device: Display a notification that says "AI bot creation and registration complete."

[1914] Purchasing and Using AI Bots

[1915] User: Search for "Household Accounting Management AI" in the Marketplace and select it.

[1916] User: Use the Marketplace search function to find and select "Household Accounting Management AI."

[1917] User: Clicks the purchase button and enters the required payment information.

[1918] User: Clicks the purchase button and enters payment information to complete the purchase.

[1919] Server: Processes the purchase and sends the purchase information to the device after approval.

[1920] Server: Processes the purchase information and, once authorization is complete, sends the information to the device.

[1921] On the device: Display a purchase completion notification to the user.

[1922] On your device: Display a "Purchase complete" notification to the user.

[1923] Device: Download the purchased AI bot and integrate it into the chat screen.

[1924] Device: Download the AI ​​bot and add it to the user's chat screen.

[1925] User: Uses an AI bot to give instructions on managing household finances.

[1926] User: Texts "Visualize my spending this month."

[1927] Server: Receives user instructions, generates graphs based on income and expenditure data, and sends the results to the user's device.

[1928] Server: Analyzes the instructions and returns the results to the user's device.

[1929] Terminal: Displays the response to the user.

[1930] Terminal: Shows the user a "This Month's Spending Graph."

[1931] Specific examples

[1932] For example, if a user were to create a household accounting management AI, the process would be as follows: The user would input "I want a household accounting management function" and provide detailed income and expenditure data. The server would generate an AI model based on this data and register it on the marketplace. Other users could then purchase and use this AI model, improving the efficiency of their lives and work.

[1933] In this way, the present invention provides a system that allows users to easily create and use generative AI models that meet their needs, thereby effectively resolving conventional problems.

[1934] The processing flow will be explained below.

[1935] Creating an AI Bot

[1936] Step 1:

[1937] User: Open the "Create AI Bot" menu in the LINE app and select "Create New."

[1938] How it works: The user clicks the "Create New" button to begin the AI ​​bot creation flow.

[1939] Step 2:

[1940] Terminal: Asks the user about the functions they want the bot to have and prompts them to enter personal and objective data.

[1941] What it does: The device displays the question, "What functionality do you want your bot to have?"

[1942] Step 3:

[1943] User: Enters the bot's functionality, basic data, and purpose.

[1944] Operation: The user specifically inputs, "I want to have a household accounting function. I want to visualize my monthly income and expenses in graphs."

[1945] Step 4:

[1946] Terminal: Asks you to enter detailed data (e.g. income, expenses).

[1947] How it works: The device asks the user to "Enter your monthly income and expenditure data."

[1948] Step 5:

[1949] User: Enters specific details.

[1950] How it works: The user enters something like "Income: 300,000 yen, Expenses: 200,000 yen."

[1951] Step 6:

[1952] Terminal: Sends collected data to the server.

[1953] How it works: The device sends all collected data to the server via API calls.

[1954] Step 7:

[1955] Server: Creates and customizes a generative AI model based on the received data.

[1956] How it works: The server analyzes the data, trains an AI model based on the user's business logic, and generates a customized model.

[1957] Step 8:

[1958] Server: Registers the completed AI model on the marketplace and notifies users.

[1959] Operation: The server sends a notification message to the user device saying "AI bot creation and registration completed."

[1960] Step 9:

[1961] Terminal: Display a notification to the user that the model has been registered.

[1962] What it does: The device will display a notification message saying "AI bot creation and registration complete."

[1963] Purchasing and Using AI Bots

[1964] Step 1:

[1965] User: Search for "Household Accounting Management AI" on the marketplace and select it.

[1966] How it works: A user uses the Marketplace search function to select "Household Accounting Management AI."

[1967] Step 2:

[1968] User: Clicks the purchase button and enters the required payment information.

[1969] How it works: The user presses the buy button and enters payment information to complete the purchase.

[1970] Step 3:

[1971] Server: Processes the purchase procedure and sends the purchase information to the terminal after approval.

[1972] How it works: The server processes the purchase information and, once approved, sends it to the device.

[1973] Step 4:

[1974] Terminal: Display a purchase completion notification to the user.

[1975] Action: The device displays a "Purchase Complete" message to the user.

[1976] Step 5:

[1977] Device: Download the purchased AI bot and integrate it into the chat screen.

[1978] How it works: The device downloads the AI ​​bot and adds it to the user's chat screen.

[1979] Step 6:

[1980] User: Uses an AI bot to give instructions on managing household finances.

[1981] How it works: The user types in the text "Visualize my spending this month."

[1982] Step 7:

[1983] Server: Receives user instructions, generates graphs based on income and expenditure data, and sends the results to the user's terminal.

[1984] Operation: The server analyzes the instructions, generates the graph, and then sends the results back to the user's terminal.

[1985] Step 8:

[1986] Terminal: displays the response to the user.

[1987] Action: The device displays a "This Month's Spending Graph" to the user.

[1988] Through these steps, users can create generative AI models that meet their needs and share or sell them with other users.

[1989] Example 1

[1990] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1991] Conventional generative AI models require users to have advanced technical knowledge to create them, making them difficult for general users to use. Furthermore, existing generative AI models often lack versatility and are unable to flexibly respond to the needs of individual users. Furthermore, there are limited ways to effectively share or sell generated models with other users, making it difficult to promote widespread use.

[1992] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1993] In this invention, the server includes means for collecting personal information and objective information input by a user, means for analyzing the collected information and creating a generative AI model customized based on the user's needs, means for registering the generative AI model on a marketplace, means for other users to purchase the generative AI model on the marketplace, means for the purchased generative AI model to operate within a user device and respond and generate data in accordance with user instructions, means for the user device to receive input from the user and transmit the input data to the server, and means for the server to generate graphs based on the user input data and transmit the results to the user terminal. This enables users, even without technical knowledge, to easily create, share, and sell generative AI models that meet their needs.

[1994] "Personal information" refers to specific data about a user, including individual information such as name, age, address, contact details, income and expenses.

[1995] "Objective information" refers to information that a user needs to accomplish a specific goal or task, such as household accounting, health management, or work efficiency improvement.

[1996] A "generative artificial intelligence model" is a customized artificial intelligence model created based on user input data and needs, and designed to perform a specific task.

[1997] "Marketplace" refers to an online platform or marketplace where generative artificial intelligence models are registered and available for purchase by other users.

[1998] A "user device" is a device used by a user to create, purchase, or use a generative artificial intelligence model, and includes electronic devices such as smartphones, tablets, and personal computers.

[1999] "Server" refers to a central computer that collects and analyzes data from users and creates, manages, and registers generative artificial intelligence models.

[2000] A "graph generation tool" is software or a library for creating visualizations based on collected data, including Chart.js and Matplotlib.

[2001] An "input form" is an interface for a user to input personal information or purpose information, and takes the form of, for example, a text box or a drop-down list.

[2002] "Payment System" means the payment processing system used when a user purchases a generative artificial intelligence model on the marketplace, including credit cards and online payment services.

[2003] This invention is a system that allows users to create their own generative AI models and share and sell them with other users. This system includes the means described in the claims and provides users with a simple and effective environment for customizing and using generative AI models.

[2004] System Configuration

[2005] The system includes the following elements:

[2006] 1. Server: A central computer that collects and analyzes data from users and creates, manages, and registers generative artificial intelligence models. Software used includes generation engines, natural language processing engines, payment systems, and graph generation tools (e.g., Chart.js and Matplotlib).

[2007] 2. Device: The device used by a user to create, purchase, or use a generative AI model. Specifically, this includes electronic devices such as smartphones, tablets, and PCs.

[2008] 3. User: A person who uses the system to create generative AI models and share or sell them with other users. Users input data using an interactive interface such as the LINE app.

[2009] Explanation of program processing

[2010] Creating an AI Bot

[2011] The user opens the "Create AI Bot" menu in the LINE app and selects "Create New." This starts the creation flow.

[2012] The terminal asks the user questions about the functions they want the bot to have and prompts them to enter personal information and purpose information. For example, the terminal displays a question such as, "What functions do you want the bot to have?"

[2013] The user inputs the bot's functions and detailed data. For example, they might input, "I want the bot to have a household accounting function. I want to visualize my monthly income and expenses in graphs."

[2014] The device collects the input data and sends it to the server, which sends the collected data as a POST request to the specified API endpoint.

[2015] The server analyzes the received data, launches the generation engine, and generates an AI model based on the user data. Once training is complete, the model is saved and registered in the marketplace.

[2016] Once the model registration is complete, the server will send a notification to the device stating, "AI bot creation and registration has been completed."

[2017] The terminal displays a notification to the user that the model registration has been completed.

[2018] Purchasing and Using AI Bots

[2019] Users search for "household accounting management AI" on the marketplace, select it, click the purchase button, and enter the required payment information to complete the purchase.

[2020] The server processes the purchase procedure and, after approval, sends the purchase information to the terminal.

[2021] The device will display a purchase completion notification to the user, download the purchased AI bot, and integrate it into the chat screen.

[2022] Users can use the AI ​​bot to give instructions for managing their household finances, such as "Visualize this month's expenses."

[2023] The server receives the user's instructions and generates a graph using a graph generation tool based on the income and expenditure data. The generated graph is sent to the user's terminal as image data.

[2024] The terminal displays the received graph image in the chat window.

[2025] Specific examples

[2026] For example, if a user were to create a household accounting management AI, the process would be as follows: The user would enter "I want a household accounting management function" through the LINE app and provide detailed information such as income and expenditure data. The server would then generate an AI model based on this data and register it on the marketplace. Other users could then purchase and use this AI model, improving the efficiency of their lives and work.

[2027] Prompt Sentence Examples

[2028] "Tell me your income and expenses this month."

[2029] "Set a budget for next month."

[2030] "Category my expenses and display them in a graph."

[2031] In this way, the present invention provides a system that allows users to easily create and use generative artificial intelligence models that meet their needs.

[2032] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2033] Step 1: User initiates bot creation

[2034] Input: The user opens the "Create AI Bot" menu in the LINE app and selects "Create New."

[2035] Data processing: Communicate to the terminal the information that the user selected to "create new."

[2036] Output: The terminal will display an interface to take you to the next step.

[2037] Specific actions: Launch the LINE app, select the appropriate menu, and tap the "Create New" button.

[2038] Step 2: Enter the bot's purpose and functionality

[2039] Input: The device asks the user about the capabilities they want the bot to have.

[2040] Data processing: Collect input data (text) received from the user.

[2041] Output: Text data entered by the user as a function or purpose.

[2042] Specific behavior: Display the question "What functionality do you want your bot to have?" on the terminal screen.

[2043] Step 3: User Enters Data

[2044] Input: The user enters the bot's functionality and detailed data.

[2045] Data processing: The entered data is temporarily stored on the device.

[2046] Output: Input data (e.g., household accounting function, income and expenditure data).

[2047] Specific actions: In the input form, write, "I want to have a household accounting function. I want to visualize my monthly income and expenses in graphs."

[2048] Step 4: Sending data

[2049] Input: Data collected by the device.

[2050] Data processing: Send a POST request to the server via the API.

[2051] Output: User input data sent to the server.

[2052] Specific behavior: The user completes the input and clicks the "Submit" button. The device sends the collected data to the specified API endpoint.

[2053] Step 5: The server receives and analyzes the data

[2054] Input: Data received by the server from the device.

[2055] Data processing: Validating, analyzing, and preparing incoming data for AI model generation.

[2056] Output: Data ready to generate an AI model.

[2057] What happens: The server validates the structure of the data and filters and cleanses it as needed.

[2058] Step 6: AI model generation

[2059] Input: Ready data.

[2060] Data processing: Train and customize AI models based on data.

[2061] Output: The completed AI model.

[2062] Specific operation: The server starts the generation engine, trains the AI ​​model based on the received data, and saves the model to storage once training is complete.

[2063] Step 7: Register your model on the Marketplace

[2064] Input: The completed AI model.

[2065] Data processing: Add metadata to the AI ​​model and publish it to the marketplace.

[2066] Output: An AI model registered in the marketplace.

[2067] Specific operation: The server registers and publishes information about the generated AI model in the model database.

[2068] Step 8: Registration completion notification

[2069] Input: Information about the AI ​​model registered in the marketplace.

[2070] Data processing: Generate a registration completion notice.

[2071] Output: A notification message that is displayed on the user's terminal.

[2072] Specific action: Send a notification to the device saying "AI bot creation and registration completed."

[2073] Step 9: User finds the bot

[2074] Input: User action.

[2075] Data Processing: Search for bots in the marketplace and view the list.

[2076] Output: Search results for "household accounting management AI".

[2077] What it does: Search for "household accounting management AI" in the marketplace and select the appropriate bot.

[2078] Step 10: Checkout the Bot

[2079] Input: User selected bot and payment information.

[2080] Data processing: Processing payment information and finalizing payments.

[2081] Output: Purchase complete message.

[2082] Specific operation: Enter payment information and click the purchase button. The server processes the payment through the payment system.

[2083] Step 11: Purchase completion notification

[2084] Input: Authorization information from payment system.

[2085] Data processing: Generates a notification of purchase completion.

[2086] Output: Messages that are displayed on the user's terminal.

[2087] Specific behavior: Display a notification message saying "Purchase completed."

[2088] Step 12: Download the AI ​​Bot

[2089] Input: Purchase information.

[2090] Data processing: Download data for the AI ​​bot.

[2091] Output: The downloaded AI bot.

[2092] Specific operation: Downloads the AI ​​bot's data from the server and integrates it into the user's chat screen.

[2093] Step 13: Users use the bot

[2094] Input: User instructions (prompt text).

[2095] Data processing: Analysis based on the expected task.

[2096] Output: Graph generation information.

[2097] Specific action: Enter "Visualize this month's expenses" and send the instruction to the server.

[2098] Step 14: Server processes the instruction

[2099] Input: User-specified data.

[2100] Data processing: instruction analysis, retrieval of income and expenditure data from database, graph generation.

[2101] Output: The generated graph image.

[2102] What it does: Parse instructions, get the necessary income and expenditure data, visualize it using a graph generation tool, and output it as image data.

[2103] Step 15: The terminal displays the response

[2104] Input: The generated graph image.

[2105] Data processing: Preparing received images for display.

[2106] Output: A graph that is displayed in the user's chat window.

[2107] Specific operation: The received graph image is displayed in the chat window and presented to the user in a visible form.

[2108] The above are the specific processing steps and details of this system.

[2109] (Application example 1)

[2110] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2111] Conventional generative AI model systems make it difficult for users to easily create and use AI models customized to their needs. In particular, content distribution services require personalized content recommendations based on users' viewing history and interests, but current systems are unable to effectively achieve this.

[2112] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2113] In this invention, the server includes means for collecting personal data and objective data input by a user, means for analyzing the collected data and creating a generative AI model customized based on user needs, means for registering the generative AI model in a marketplace, means for other users to purchase the generative AI model on the marketplace, means for the purchased generative AI model to operate within the user device and respond and generate data according to user instructions, means for collecting and analyzing the user's viewing history and interest data to recommend personalized content, and means for recommending content based on the user's interests. This allows users to easily create a customized AI model based on their needs and receive personalized content recommendations.

[2114] "User needs" refers to the individual requirements and expectations of users.

[2115] "Personal Data" is information about a user that is specific to that user and records that user's unique characteristics and preferences.

[2116] "Objective data" is information that a user inputs to achieve a specific objective.

[2117] A "generative artificial intelligence model" is an artificial intelligence program that is generated based on user input data and has the ability to perform specific tasks.

[2118] A "marketplace" is an online platform where users can publish their AI models and allow other users to purchase or share them.

[2119] A "viewing history" is a record of content that a user has viewed or listened to in the past.

[2120] "Interest data" is a collection of data that indicates the areas of interest and concerns of a user.

[2121] "Content recommendation" is the process of suggesting appropriate content based on a user's viewing history and interests.

[2122] "User device" refers to a terminal or device used by a user, such as a smartphone or tablet.

[2123] "Response and data generation" refers to the process of returning appropriate answers and generating necessary data in response to user instructions.

[2124] This invention is a system that allows users to create generative AI models and share or sell them with other users. The system includes the following elements:

[2125] First, the device used by the user (smartphone, tablet, PC, etc.) provides an interface for inputting personal data and objective data. By inputting this data interactively, the user can proceed to the next step.

[2126] The device sends the collected data to a server, which creates a generative AI model and registers it on the marketplace. Specifically, the server uses the following software and hardware:

[2127] For hardware, a server equipped with a high-performance processor and large memory capacity is required. Specifically, NVIDIA GPUs or Intel CPUs are recommended. For software, a programming language such as Python and a framework for training AI models such as TensorFlow or PyTorch are used.

[2128] The server analyzes the input data and creates a customized generative AI model based on the user's needs. To achieve this, it utilizes natural language processing and data analysis algorithms, such as vectorizing text data using TfidfVectorizer and comparing data using cosine similarity.

[2129] The generated AI model is registered in a marketplace. Other users can search for and purchase the generated AI model through this marketplace. Once the purchase procedure is complete, the server sends the purchased AI model to the user's device. The user's device downloads the received AI model and runs it within the application.

[2130] To collect and analyze a user's viewing history and interest data, the user's operation history and input data are used. For example, data on the content the user has viewed in the past and the fields in which the user has shown interest is collected. This enables personalized content recommendations.

[2131] For example, if a user is interested in rock music, information about rock-related videos they have watched in the past and artists they have shown an interest in can be collected, and the server can then use this data to recommend content that best suits the user's profile.

[2132] For example, the following prompt sentences are used:

[2133] "Recommend the latest rock videos suitable for users who are interested in rock music."

[2134] In this way, the present invention provides a system that allows users to easily create AI models customized to their needs and receive personalized content recommendations.

[2135] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2136] Step 1:

[2137] The user uses the terminal to input personal and objective data. The terminal interface provides a screen for interactively inputting this data. The input data is then stored in the terminal's memory.

[2138] Input: User's personal data and purpose data

[2139] Output: Data stored in the device's data storage area

[2140] Step 2:

[2141] The device sends the collected personal data and target data to the server, where the data is encrypted and securely transmitted via API.

[2142] Input: User data stored on the device

[2143] Output: User data sent to the server

[2144] Step 3:

[2145] The server analyzes the received user data and creates a customized generative AI model based on the user's needs. Specifically, it vectorizes the text data using TfidfVectorizer and calculates cosine similarity. It also trains the model using frameworks such as TensorFlow and PyTorch.

[2146] Input: User data sent to the server

[2147] Output: A customized generative AI model

[2148] Step 4:

[2149] The server registers the generated AI model on the marketplace, allowing other users to view and purchase the model.

[2150] Input: A customized generative AI model

[2151] Output: AI model registered in the marketplace

[2152] Step 5:

[2153] Other users search for and purchase generative AI models on the marketplace. Once the purchase process is complete, the server processes the purchase information and sends the AI ​​model to the buyer's device.

[2154] Input: Purchase procedure information

[2155] Output: The purchased AI model is sent.

[2156] Step 6:

[2157] The device receives the purchased AI model, installs it into the application, and runs it. The user gives the model instructions, which then generate data and respond based on those instructions.

[2158] Input: Submitted AI model

[2159] Output: The installed AI model runs and responds to the user.

[2160] Step 7:

[2161] The device collects and analyzes the user's viewing history and interest data to recommend personalized content. The viewing history and interest data are updated in real time based on the user's operations and input.

[2162] Input: User viewing history and interest data

[2163] Output: Recommended personalized content

[2164] Specifically, if a user inputs a prompt such as "Recommend the latest rock videos suitable for a user interested in rock music," the server will analyze the user's viewing history and interest data based on the prompt and recommend appropriate content to the user. This entire process is done in real time, improving the user experience.

[2165] The above is the processing steps of the application example and their specific explanation.

[2166] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2167] This invention is a system that allows users to create their own generative AI models and share and sell them with other users. In addition to conventional customization, this system combines an emotion engine that recognizes user emotions and responds and generates data based on those emotions to provide more advanced and personalized services.

[2168] System Configuration

[2169] The system includes the following elements:

[2170] 1. Server: Responsible for generating, registering, and managing AI models and operating the marketplace.

[2171] 2. Device: The device (e.g., smartphone, tablet) used by a user to create, purchase, or use a generative AI bot.

[2172] 3. User: A person who creates conversational AI bots and shares or sells them to other users.

[2173] 4. Emotion engine: A component that recognizes and analyzes emotions from user input data and text and voice during dialogue.

[2174] Explanation of program processing

[2175] Creating an AI Bot

[2176] User: Open the "Create AI Bot" menu in the LINE app and select "Create New."

[2177] User: Clicks the "Create New" button to begin the AI ​​bot creation flow.

[2178] Terminal: Ask the user questions about the functionality they want the bot to have and prompt them for personal and objective data.

[2179] Terminal: Display the question "What would you like your bot to do?"

[2180] User: Enters the bot's capabilities, basic data, and purpose.

[2181] User: Enter the following specific information: "I want to have a household accounting function. I want to be able to visualize my monthly income and expenses in graphs."

[2182] Terminal: Asks you to enter detailed data (e.g. income, expenses).

[2183] Terminal: Prompts the user to "Enter your monthly income and expenditure data."

[2184] User: Enter specific details.

[2185] User: Enter something like "Income: 300,000 yen, Expenses: 200,000 yen."

[2186] Terminal: Sends collected data to the server.

[2187] Device: Sends all collected data to the server via API calls.

[2188] Server: Creates and customizes a generative AI model based on the received data.

[2189] Server: Analyzes data, trains AI models based on the user's business logic, and generates customized models.

[2190] Server: Registers the completed AI model on the marketplace and notifies users.

[2191] Server: Registers the model in the marketplace and sends a notification message to the user's device stating that "AI bot creation and registration is complete."

[2192] On the device: Display a notification to the user that the model has been registered.

[2193] On your device: Display a notification message saying "AI bot creation and registration complete."

[2194] Use of Emotion Recognition in AI Bots

[2195] User: Also inputs emotional data to create an AI bot with an emotion engine.

[2196] User: When creating a bot, select "I want to include an emotion engine" and enter emotion data.

[2197] Terminal: Collects user input data and emotion data and sends them to the server.

[2198] Device: Sends collected data to the server via API calls.

[2199] Server: Analyzes the received emotion data, trains the emotion engine, and integrates it into a generative AI model.

[2200] Server: Analyzes emotion data, trains the emotion engine, and integrates it into the AI ​​model.

[2201] Server: Registers AI models equipped with emotion engines in the marketplace and notifies users.

[2202] Server: Registers and notifies models equipped with emotion engines on the marketplace.

[2203] Purchasing and Using AI Bots

[2204] User: Search for "Emotion Engine-powered Household Accounting Management AI" in the Marketplace and select it.

[2205] User: Use the Marketplace search function to select "Household accounting management AI with emotion engine."

[2206] User: Clicks the purchase button and enters the required payment information.

[2207] User: Clicks the purchase button and enters payment information to complete the purchase.

[2208] Server: Processes the purchase and sends the purchase information to the device after approval.

[2209] Server: Processes the purchase information and sends it to the device once authorization is complete.

[2210] On the device: Display a purchase completion notification to the user.

[2211] On the device: Display a "Purchase complete" message to the user.

[2212] Device: Download the AI ​​bot with the emotion engine you purchased and integrate it into the chat screen.

[2213] Device: Download the AI ​​bot and add it to the user's chat screen.

[2214] User: Uses an AI bot with an emotion engine to give instructions on managing household finances.

[2215] User: Texts in "Visualize my spending this month" and mentions feeling depressed.

[2216] Server: The emotion engine analyzes the user's emotions and generates a response accordingly.

[2217] Server: The emotion engine analyzes the "depressed" emotion from the user's input and generates a spending graph along with an encouraging message.

[2218] Terminal: Displays the response to the user.

[2219] Device: Display this month's spending graph along with a message like "Cheer up, you'll save more next month!"

[2220] In this way, a system integrating an emotion engine can provide personalized responses that reflect the user's emotions and assist the user more effectively than ever before. This provides a system that allows users to easily create and use customizable generative AI models that respond to their emotions as well as their needs.

[2221] The processing flow will be explained below.

[2222] Creating an AI Bot

[2223] Step 1:

[2224] User: Open the "Create AI Bot" menu in the LINE app and select "Create New."

[2225] How it works: The user clicks the "Create New" button to begin the AI ​​bot creation flow.

[2226] Step 2:

[2227] Terminal: Ask the user questions about the functionality they want the bot to have and prompt them for personal and objective data.

[2228] What it does: The device displays the question, "What functionality do you want your bot to have?"

[2229] Step 3:

[2230] User: Enters the bot's capabilities, basic data, and purpose.

[2231] Operation: The user specifically inputs, "I want to have a household accounting function. I want to visualize my monthly income and expenses in graphs."

[2232] Step 4:

[2233] Terminal: Asks you to enter detailed data (e.g. income, expenses).

[2234] How it works: The device asks the user to "Enter your monthly income and expenditure data."

[2235] Step 5:

[2236] User: Enter specific details.

[2237] How it works: The user enters something like "Income: 300,000 yen, Expenses: 200,000 yen."

[2238] Step 6:

[2239] Terminal: Sends collected data to the server.

[2240] How it works: The device sends all collected data to the server via API calls.

[2241] Step 7:

[2242] Server: Creates and customizes a generative AI model based on the received data.

[2243] How it works: The server analyzes the data, trains the AI ​​model based on the user's needs, and generates a customized model.

[2244] Step 8:

[2245] Server: Registers the completed AI model on the marketplace and notifies users.

[2246] Operation: The server registers the model in the marketplace and sends a notification message to the user's device saying "AI bot creation and registration completed."

[2247] Step 9:

[2248] On the device: Display a notification to the user that the model has been registered.

[2249] What it does: The device will display a notification message saying "AI bot creation and registration complete."

[2250] Use of Emotion Recognition in AI Bots

[2251] Step 1:

[2252] User: Also inputs emotional data to create an AI bot with an emotion engine.

[2253] How it works: The user selects the option "I want to include an emotion engine" and enters emotion data according to the format.

[2254] Step 2:

[2255] Terminal: Collects user input data and emotion data and sends them to the server.

[2256] How it works: The device collects all this data and sends it to the server via an API call.

[2257] Step 3:

[2258] Server: Analyzes the received emotion data, trains the emotion engine, and integrates it into a generative AI model.

[2259] How it works: The server analyzes emotion data and trains an emotion engine, which is then integrated into a generative AI model.

[2260] Step 4:

[2261] Server: Registers AI models equipped with emotion engines on the marketplace and notifies users.

[2262] Operation: The server registers the model integrating the emotion engine in the marketplace and sends a notification to the user's device.

[2263] Purchasing and Using AI Bots

[2264] Step 1:

[2265] User: Search for "Household accounting management AI with emotion engine" on the marketplace and select it.

[2266] How it works: The user uses the marketplace search function to select and choose "Household accounting management AI with emotion engine."

[2267] Step 2:

[2268] User: Clicks the purchase button and enters the required payment information.

[2269] What happens: The user clicks the buy button, enters payment information, and completes the purchase.

[2270] Step 3:

[2271] Server: Processes the purchase procedure and sends the purchase information to the terminal after approval.

[2272] Operation: The server processes the purchase information and, once approval is complete, sends the information to the user's terminal.

[2273] Step 4:

[2274] Terminal: Display a purchase completion notification to the user.

[2275] Action: The device displays a "Purchase Complete" message to the user.

[2276] Step 5:

[2277] Device: Download the AI ​​bot equipped with the purchased emotion engine and integrate it into the chat screen.

[2278] How it works: The device downloads the AI ​​bot and adds it to the user's chat screen.

[2279] Step 6:

[2280] User: Uses an AI bot equipped with an emotion engine to give instructions on managing household finances.

[2281] How it works: The user enters the text "Visualize my spending this month" and describes their emotional state.

[2282] Step 7:

[2283] Server: The emotion engine analyzes the user's emotions and generates appropriate responses accordingly.

[2284] Operation: The server launches the emotion engine, analyzes the user's emotion data, and generates emotion-matched response and expenditure graphs.

[2285] Step 8:

[2286] Server: Sends the generated response and expenditure graph to the user terminal.

[2287] Operation: The server sends an emotion-based response message and a spending graph to the user terminal.

[2288] Step 9:

[2289] Terminal: displays the response to the user.

[2290] What it does: Your device displays a graph of your spending this month along with an emotional message such as "Cheer up, you'll save more next month!"

[2291] In this way, a system integrating an emotion engine can provide personalized responses that reflect the user's emotions and assist the user more effectively than ever before. This provides a system that allows users to easily create and use customizable generative AI models that respond to their emotions as well as their needs.

[2292] Example 2

[2293] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2294] While conventional generative AI models were able to customize based on user needs, they lacked the ability to recognize and reflect user emotions, making it difficult to provide fully personalized responses. By solving this problem, there is a demand for systems that can improve the user experience and generate more effective responses and data.

[2295] The identification processing by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for collecting personal data and object data input by the user; means for analyzing the collected data and creating a generative AI model customized based on the user needs; means for registering the generative AI model in a marketplace; means for other users to purchase the generative AI model in the marketplace; means for the purchased generative AI model to operate in the user terminal and respond and generate data according to the user's instructions; means including an emotion analysis engine that recognizes and analyzes emotions from the user's input data and dialogue data; and means for responding and generating data using the emotion analysis engine based on the analyzed emotion data. This makes it possible to generate responses and data that reflect the user's emotions.

[2296] "Personal data" refers to information about an individual entered by a user, including the individual's attributes, preferences, behavioral history, and so on.

[2297] "Target data" refers to data that includes information about the intended use or function of the generated AI model.

[2298] A "generative artificial intelligence model" is a customized AI model that is generated based on the user's personal data and objective data.

[2299] A "marketplace" is an online platform where generative AI models can be registered and purchased by other users.

[2300] A "user device" is an electronic device used by a user to create, purchase, or use a generative AI model, including a smartphone or tablet.

[2301] An "emotion analysis engine" is a software component for recognizing and analyzing emotions from user input data and interaction data.

[2302] "Response and data generation" is the process by which a generative artificial intelligence model provides appropriate responses and information based on user instructions.

[2303] This invention relates to a system that allows users to create their own generative AI models and share or sell them with other users. In particular, by integrating an emotion analysis engine, it is possible to generate personalized responses and data that reflect the user's emotions. The system includes the following elements:

[2304] System Configuration

[2305] 1. Server:

[2306] Generates, registers, manages, and operates a marketplace for AI models.

[2307] The servers are located in a cloud environment, enabling high-speed processing and data analysis.

[2308] 2. Terminal:

[2309] A device used by a user to create, purchase, and use generative AI models, including smartphones and tablets.

[2310] The terminal is connected to the Internet and has a dedicated application installed for communicating with the server.

[2311] 3. User:

[2312] A person who interactively creates AI models and shares or sells them to other users.

[2313] Users operate the device to input the necessary data and customize the generative AI model.

[2314] 4. Sentiment Analysis Engine:

[2315] It is a software component that recognizes and analyzes emotions from user input data and text and voice during dialogue.

[2316] It is placed on a server and performs sentiment analysis in real time.

[2317] Overview of program processing

[2318] 1. Creating an AI Bot

[2319] The user accesses the "AI Bot Creation" menu using the LINE app on their device and selects "Create New." The device then asks the user what functions they would like the bot to have, and the user inputs their desired functions and purpose. For example, they can input "I want the bot to have a household accounting function." The device then prompts them to input specific data (e.g., monthly income and expenses). The input data is sent from the device to the server, which analyzes it and creates a generative AI model. The completed model is registered on the marketplace, and a notification that the model has been registered is sent to the user.

[2320] 2. Use of emotion recognition function

[2321] Users can choose whether to incorporate an emotion analysis engine when creating an AI bot. If emotion analysis is desired, the user also inputs emotion data, which is then sent to the server via the terminal. The server analyzes the received emotion data, trains the emotion engine, and integrates it into a generative AI model. The integrated model is then registered on the marketplace again and notified to the user.

[2322] 3. Purchasing and Using AI Bots

[2323] A user searches for and purchases a "household accounting management AI with an emotion engine" on the marketplace. After entering payment information and completing the purchase, the server processes the purchase information and sends it to the device. A notification is displayed indicating the purchase is complete, and the user downloads the purchased AI bot and integrates it into their chat screen. The user then types "Visualize this month's expenses" and conveys their emotional state. For example, if the user mentions that they are feeling depressed, the server uses the emotion analysis engine to generate an appropriate response and an expense graph, which are then sent to the device. The device then displays the generated response and graph to the user.

[2324] Specific examples

[2325] Example prompt sentence:

[2326] User: Clicks the "Create New" button to begin the AI ​​bot creation flow.

[2327] Terminal: Display the question "What would you like your bot to do?"

[2328] User: Enter the following specific information: "I want to have a household accounting function. I want to be able to visualize my monthly income and expenses in graphs."

[2329] Terminal: Prompts the user to "Enter your monthly income and expenditure data."

[2330] User: Enter something like "Income: 300,000 yen, Expenses: 200,000 yen."

[2331] This system provides a generative AI model that integrates an emotion analysis engine, enabling responses that reflect the user's emotions. Users can also use this to easily create and use customizable generative AI models, resulting in a highly effective user experience.

[2332] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2333] Step 1:

[2334] The user accesses the "Create AI Bot" menu in the LINE app on their device and selects "Create New."

[2335] (Input) User command: New creation

[2336] (Output) Display the next input prompt

[2337] (Operation) When the user clicks the "Create New" button, the system begins preparing to display the next input prompt.

[2338] Step 2:

[2339] The terminal asks questions about the features you want the bot to have.

[2340] (Input) "Create new" selected

[2341] (Output) The question "What functionality do you want your bot to have?"

[2342] (Action) The device displays the question on the screen: "What functionality do you want your bot to have?"

[2343] Step 3:

[2344] The user enters the bot's capabilities, basic data, and purpose.

[2345] (Input) User input: "I want to have a household accounting function. I want to visualize my monthly income and expenses in graphs."

[2346] (Output) Function and purpose information

[2347] (Operation) The user inputs specific functions (e.g., "I want to have a household accounting function") and purpose (e.g., "I want to visualize my monthly income and expenses in a graph").

[2348] Step 4:

[2349] The terminal will ask you to enter detailed data (e.g. monthly income, expenses).

[2350] (Input) Function and purpose information entered by the user

[2351] (Output) The question "Please enter your monthly income and expenditure data."

[2352] (Operation) The terminal asks the user to "Enter monthly income and expenditure data."

[2353] Step 5:

[2354] The user enters the details.

[2355] (Input) Specific data such as "Income: 300,000 yen, Expenses: 200,000 yen"

[2356] (Output) Detailed data

[2357] (Operation) The user enters specific figures such as "Income: 300,000 yen, Expenses: 200,000 yen." The device receives this and stores it as data.

[2358] Step 6:

[2359] The terminal transmits the collected data to the server.

[2360] (Input) All data entered by the user

[2361] (Output) API call sent to the server

[2362] (Operation) The device sends all collected data to the server via an API call.

[2363] Step 7:

[2364] The server creates and customizes a generative AI model based on the received data.

[2365] (Input) User data and detailed data sent from the terminal

[2366] (Output) Customized generative AI model

[2367] (Operation) The server analyzes the data, trains the AI ​​model based on the user's business logic, and generates a customized model.

[2368] Step 8:

[2369] The server registers the completed generative AI model on the marketplace and notifies the user.

[2370] (Input) Customized AI model generated by the server

[2371] (Output) Notification message "AI bot creation and registration completed."

[2372] (Operation) The server registers the generated AI model on the marketplace and sends a notification to the user device stating, "AI bot creation and registration has been completed."

[2373] Step 9:

[2374] The terminal displays a notification to the user that the model has been registered.

[2375] (Input) Notification message sent from the server

[2376] (Output) "AI bot creation and registration completed" message

[2377] (Operation) The device displays the message "AI bot creation and registration completed" on the screen.

[2378] Step 10:

[2379] Users also input emotional data to create AI bots with built-in emotion engines.

[2380] (Input) Input of selection and emotion data including emotion engine

[2381] (Output) Comprehensive emotion data

[2382] (Operation) The user selects to include the emotion engine and inputs emotion data. The device receives this and stores it as data.

[2383] Step 11:

[2384] The terminal collects the user's input data and emotion data and transmits them to the server.

[2385] (Input) Emotion data and user interaction data

[2386] (Output) API call sent to the server

[2387] (Operation) The device sends the collected data to the server via an API call.

[2388] Step 12:

[2389] The server analyzes the received emotion data, trains the emotion engine, and integrates it into a generative AI model.

[2390] (Input) Emotion data and user interaction data sent from the device

[2391] (Output) Generative AI model integrating emotion engine

[2392] (Operation) The server analyzes the emotion data, trains the emotion engine, and integrates it into a generative AI model.

[2393] Step 13:

[2394] The server registers the AI ​​model equipped with the emotion engine on the marketplace and notifies the user.

[2395] (Input) Generative AI model integrating emotion engine

[2396] (Output) Notification message: "AI model with emotion engine has been created."

[2397] (Operation) The server registers the AI ​​model equipped with the emotion engine in the marketplace and sends a completion notification to the user's device.

[2398] Step 14:

[2399] The device searches for and selects "household accounting management AI with emotion engine" in the marketplace.

[2400] (Input) Search criteria entered by the user

[2401] (Output) AI model list of search results

[2402] (Operation) The user searches for and selects a "household accounting management AI with an emotion engine" within the marketplace.

[2403] Step 15:

[2404] The user clicks the purchase button and enters the required payment information.

[2405] (Input) Payment information

[2406] (Output) Purchase completed status

[2407] (Action) The user presses the purchase button, enters payment information, and completes the purchase process.

[2408] Step 16:

[2409] The server processes the purchase procedure and, after approval, sends the purchase information to the terminal.

[2410] (Input) Payment Information Authorization

[2411] (Output) Purchase completion notification message

[2412] (Operation) The server processes the purchase information and, once approval is complete, sends the information to the terminal.

[2413] Step 17:

[2414] The terminal displays a purchase completion notification to the user.

[2415] (Input) Purchase completion notification message

[2416] (Output) "Purchase completed" message

[2417] (Operation) The device displays the message "Purchase completed."

[2418] Step 18:

[2419] The device downloads the AI ​​bot equipped with the purchased emotion engine and integrates it into the chat screen.

[2420] (Input) AI model download request

[2421] (Output) AI bot integrated into the chat screen

[2422] (Operation) The device downloads the AI ​​bot and adds it to the user's chat screen.

[2423] Step 19:

[2424] Users can use an AI bot equipped with an emotion engine to give instructions on managing their household finances.

[2425] (Input) Input of user instructions and emotions (e.g., "Visualize my expenses this month.")

[2426] (Output) Analysis request data and emotion data

[2427] (Action) The user gives a text prompt to describe their emotional state, for example, typing "I'm feeling depressed."

[2428] Step 20:

[2429] The server uses an emotion engine to analyze the user's emotions and generate a response accordingly.

[2430] (Input) User instructions and emotion data

[2431] (Output) Personalized responses and data

[2432] (Operation) The server uses an emotion engine to analyze the user's emotions and generates an appropriate response (e.g., an "encouraging message") and expenditure graph based on those emotions.

[2433] Step 21:

[2434] The terminal displays the response from the server to the user.

[2435] (Input) Response data from the server

[2436] (Output) Display of analysis results

[2437] (Operation) The terminal displays the generated responses and expenditure graph to the user, providing feedback adapted to the user's situation.

[2438] (Application example 2)

[2439] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2440] Many users today desire artificial intelligence models that they can customize themselves, but conventional systems have struggled to provide personalized services based on user emotions. Furthermore, providing appropriate service based on customer emotions in brick-and-mortar stores has been difficult, hindering customer satisfaction. To address these challenges, a system capable of recognizing user emotions and generating responses based on those emotions is needed.

[2441] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for collecting personal data and object data input by the user; means for analyzing the collected data and creating a generative AI model customized based on the user needs; means for registering the generative AI model in a marketplace; means for other users to purchase the generative AI model on the marketplace; means for the purchased generative AI model to operate in the user device and respond and generate data according to the user's instructions; means for analyzing the user's emotions and generating responses based thereon; and means for generating response data based on the emotions and providing personalized information to the user. This enables users to easily create their own generative AI models, share and sell them with other users, and further enables personalized services based on emotions to be provided.

[2442] "Personal data" refers to personal information about a user, including, for example, name, address, phone number, email address, lifestyle data, and the like.

[2443] "Purpose data" refers to data about the specific goals or objectives that a user wants to achieve with the generated AI model. For example, this could be for purposes such as household accounting, health management, or learning support.

[2444] A "generative artificial intelligence model" is an artificial intelligence model that is customized based on a user's personal data and objective data and is generated to perform a specific task or response.

[2445] A "marketplace" is an online platform where generative AI models are registered and can be searched, purchased, and used by other users.

[2446] "Analysis" is the act of processing collected data to extract and use information that meets user needs and objectives. This includes the application of data mining and machine learning algorithms.

[2447] "Analyzing emotions" refers to the process of identifying emotions from user input data, text during a conversation, voice, etc., and generating emotion data.

[2448] "Personalized information" refers to customized information provided according to a user's specific feelings and needs, and provides responses and services that are most appropriate for the user.

[2449] "Response data" is data that includes specific information or messages that are generated based on the user's instructions or feelings.

[2450] "User device" refers to a hardware device that allows a user to use a generative AI model, such as a smartphone, tablet, or smart glasses.

[2451] An "instruction" is an operation or command given by a user to a generative AI model, including a command to perform a specific task or response.

[2452] This invention is a system that ...

Claims

1. means for collecting personal data and purpose data entered by the user; means for analyzing the collected data and creating a customized generative artificial intelligence model based on user needs; A means for registering the generative artificial intelligence model in a marketplace; A means for other users to purchase the generative artificial intelligence model on the marketplace; A means for the purchased generative artificial intelligence model to operate within the user device and respond and generate data in accordance with user instructions; A system including:

2. 10. The system of claim 1, further comprising means for a user to interactively input personal data and objective data.

3. The system of claim 1 , wherein the generative artificial intelligence model further comprises means for processing a variety of media inputs (images, audio, text, etc.).

Images