System

Abstract

A system is provided.SOLUTION: A system, comprising: means for a user to upload their data and list artificial intelligence models generated based on the data; means for other users to search and view the listed artificial intelligence models; means for transacting artificial intelligence models between users; and means for providing a download link after purchasing an artificial intelligence model.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Currently, creating and trading AI models requires highly advanced technical knowledge and specialized equipment, making it difficult for general users and small and medium-sized enterprises to easily access. Furthermore, existing platforms lack reliability and security due to a lack of formal data validation and accurate trading processes. Therefore, there is a need for an environment where diverse users can easily and safely trade their own AI models. [Means for solving the problem]

[0005] The present invention solves the above-mentioned problems by providing the following means: A system is provided that includes a means for a user to upload their own data and list AI models generated based on that data, a means for other users to search for and view the listed AI models, a means for trading AI models between users, and a means for providing a download link after purchasing an AI model. The system also includes a means for verifying the format of the uploaded AI model and confirming that it is in an appropriate format, a means for processing payment information entered by the user and generating a download link if successful, and a means for recording purchase history in a database, thereby realizing a highly reliable and secure trading environment.

[0006] "User" refers to any individual or legal entity that uses the System to create, upload, search, trade, and download artificial intelligence models.

[0007] "Data" refers to the collection of information used to generate an artificial intelligence model, and can include various formats such as images, audio, and text.

[0008] "Artificial intelligence model" refers to a program or system that is generated using machine learning algorithms based on uploaded data.

[0009] "Listing" refers to publishing a user-generated AI model in a searchable format on the marketplace.

[0010] "Search" refers to the use of keywords and filters to find specific AI models on the Marketplace.

[0011] "Transaction" refers to the buying and selling of artificial intelligence models between users.

[0012] "Download Link" refers to the link used by a User to save the purchased AI model to their own device.

[0013] "Formal verification" refers to the process of verifying that an uploaded artificial intelligence model is in the correct format.

[0014] "Payment Information" refers to credit card information or other payment method information entered by a User when conducting a Transaction.

[0015] "Purchase history" refers to information stored in a database that records past transactions made by a user.

[0016] "Database" refers to an electronic information repository that systematically stores and manages data such as user information, artificial intelligence models, and transaction history within the system. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10]1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] MODE FOR CARRYING OUT THE INVENTION

[0039] The present invention provides a system for providing a marketplace where users can buy and sell their own artificial intelligence models. This system includes the following functions:

[0040] User Registration and Login

[0041] 1. Device: The user accesses the marketplace website and enters information such as name, email address, and password on the new registration page.

[0042] 2. Server: The server stores the entered information in a database and sends a confirmation email to the user, who clicks on a link in the email to activate their account.

[0043] 3. Device: Then, log in by entering your email address and password on the login page.

[0044] Uploading and listing AI

[0045] 1. User: After logging in, access the dashboard and select "Upload AI Model."

[0046] 2. Device: The user enters the required information in the upload form (AI model file, description, price information, etc.) and clicks the upload button.

[0047] 3. Server: The server validates the received AI model file format to ensure it is in the correct format. If there are no problems, it stores the file and related information in a database and lists it on the marketplace.

[0048] Search and browse AI models

[0049] 1. User: Other users enter keywords into the marketplace search bar to find AI models that meet their criteria.

[0050] 2. Server: The server searches the database based on the entered keywords and returns a list of matching AI models to the user.

[0051] 3. Device: The user selects an AI model of interest from the displayed list and views detailed information.

[0052] Purchase and Download

[0053] 1. User: Click the "Purchase" button on the details page of the AI ​​model you want to purchase and enter your payment information.

[0054] 2. Server: The server processes the entered payment information, generates a download link if the payment is successful, and records the purchase history in a database.

[0055] 3. User: The user clicks the download link to download the purchased AI model.

[0056] Specific examples

[0057] A specific example of this system is shown below.

[0058] Example 1: User A uploads a facial recognition AI model developed as a hobby to the marketplace.

[0059] 1. Device: User A logs in to the marketplace and accesses the upload page for the facial recognition AI model.

[0060] 2. Device: Enter the AI ​​model file, a brief description of the model, and the price in the form, then click the "Upload" button.

[0061] 3. Server: The server verifies the format of the received AI model and, if there are no problems, stores it in a database and lists it on the marketplace.

[0062] 4. User B: User B types "face recognition" into the search bar and finds User A's AI model in the search results.

[0063] 5. User B: Checks the details page, clicks the "Purchase" button, enters payment information, and completes the purchase.

[0064] 6. Server: If the payment is successful, the server generates a download link and provides it to User B.

[0065] 7. User B: Clicks the download link to get the facial recognition AI model.

[0066] This allows User A to sell the AI ​​model he or she developed, and User B to purchase the AI ​​model they need. This system enables efficient and secure trading of AI models between users.

[0067] The processing flow will be explained below.

[0068] User Registration and Login

[0069] Step 1:

[0070] Device: The user visits the marketplace website and clicks the "Sign Up" button.

[0071] Step 2:

[0072] Device: Enter your name, email address, and password in the registration form and click the "Register" button.

[0073] Step 3:

[0074] Server: Receives the form data and searches a database to ensure the entered email address is unique.

[0075] Step 4:

[0076] Server: If the email address is unique, store the entered user information in a database along with the hashed password.

[0077] Step 5:

[0078] Server: Send the user a confirmation email that their registration is complete.

[0079] Step 6:

[0080] Users: Receive a confirmation email and click the link in the email to activate their account.

[0081] Step 7:

[0082] On the device: The user accesses the login page and logs in by entering their email address and password.

[0083] Step 8:

[0084] Server: Validates the login information and, if successful, starts the user session.

[0085] Uploading and listing AI

[0086] Step 1:

[0087] User: After logging in, select "Upload AI Model" from the dashboard.

[0088] Step 2:

[0089] Device: Enter the AI ​​model file, description, and pricing information in the upload form.

[0090] Step 3:

[0091] On the device: Click the upload button to send the form data to the server.

[0092] Step 4:

[0093] Server: Receives the form data and validates the file format for the AI ​​model.

[0094] Step 5:

[0095] Server: If the verification is successful, the AI ​​model file is saved in storage.

[0096] Step 6:

[0097] Server: Stores the AI ​​model metadata (description, category, pricing information, etc.) in a database.

[0098] Step 7:

[0099] Server: Lists the AI ​​model on the marketplace and notifies the user when the upload is complete.

[0100] Search and browse AI models

[0101] Step 1:

[0102] User: Enter keywords into the Marketplace search bar and click the search button.

[0103] Step 2:

[0104] Server: Receives search queries and extracts corresponding AI models from the database.

[0105] Step 3:

[0106] Server: Returns the list of extracted AI models to the user device.

[0107] Step 4:

[0108] Terminal: Shows the user the list of AI models.

[0109] Step 5:

[0110] User: Select the AI ​​model of interest from the displayed list and view its detailed information.

[0111] Purchase and Download

[0112] Step 1:

[0113] User: Click the "Purchase" button on the details page of the AI ​​model you want to purchase.

[0114] Step 2:

[0115] Device: Enter your credit card and payment information into the purchase form.

[0116] Step 3:

[0117] Terminal: Check the input and send.

[0118] Step 4:

[0119] Server: Receives payment information and sends it to the payment gateway to process the payment.

[0120] Step 5:

[0121] Server: If payment is successful, generate the download link.

[0122] Step 6:

[0123] Server: Sends the user a purchase confirmation email and provides a download link.

[0124] Step 7:

[0125] Server: Records purchase history in a database.

[0126] Step 8:

[0127] User: Receives purchase confirmation email and clicks download link to download the AI ​​model.

[0128] This will allow users to trade the AI ​​models they have created on the marketplace.

[0129] Example 1

[0130] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0131] Conventional AI model trading systems face the challenge of requiring users to upload models properly and effectively list, search, purchase, and download them through cumbersome procedures. In particular, complex registration and authentication procedures, as well as insufficient formal model validation and payment processing, detract from the user experience. Another problem is the inability to properly manage purchase history.

[0132] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0133] In this invention, the server includes means for users to upload their own data and list artificial intelligence models generated based on that data, means for other users to search for and view the listed artificial intelligence models, means for users to trade artificial intelligence models, means for providing a download link after purchasing an artificial intelligence model, means for new users to enter personal information, receive a registration confirmation email, and activate their account, means for registered users to complete login authentication and access the dashboard, means for verifying and listing artificial intelligence models after uploading, means for processing payment information after purchase and generating a download link when successful payment is confirmed, and means for recording purchase history in a database. This makes it possible to streamline the entire process from uploading to trading, purchasing, and downloading artificial intelligence models, improving the user experience.

[0134] "User" means an individual or legal entity that uses the system to upload their own data and trade artificial intelligence models.

[0135] A "server" is a computer system that processes requests sent by users and stores, retrieves, and transacts data, generates download links, and so on.

[0136] A "terminal" is a device such as a PC, smartphone, or tablet that a user uses to access the system.

[0137] An "artificial intelligence model" is a program or algorithm generated by a user and uploaded, listed, traded, purchased, or downloaded through the system.

[0138] "Listing" is the process of storing an uploaded AI model in a database within the system, making it available for other users to search and view.

[0139] "Search" is the act of a user entering specific keywords or conditions to find an artificial intelligence model stored within the system.

[0140] "Viewing" refers to the act of displaying detailed information about an artificial intelligence model selected from the search results.

[0141] "Transaction" refers to the act of buying and selling artificial intelligence models between users.

[0142] A "download link" is a URL that allows a user to save the purchased AI model to their own device.

[0143] A "Registration Confirmation Email" is an email containing a confirmation link required by a New User to complete their Account registration.

[0144] "Account Activation" is the process of activating a new user's account on the system by clicking on a link in a confirmation email.

[0145] "Login authentication" is the process by which a user logs in to their account using an email address and password when accessing a system.

[0146] The "dashboard" is the main screen of the system that can be accessed by logged-in users, and is an interface that allows various operations and confirmation of information.

[0147] "Formal verification" is the process of verifying that the file format of an uploaded artificial intelligence model meets the standards required by the system.

[0148] "Payment Information" is data relating to a payment method, such as credit card information, that a user provides to complete a transaction.

[0149] "Payment processing" is the process of charging the transaction amount based on the payment information entered by the user and confirming whether the payment was successful.

[0150] "Purchase history" is data that records transaction information for AI models that a user has purchased in the past.

[0151] MODE FOR CARRYING OUT THE INVENTION

[0152] The present invention is a system that provides a marketplace where users can buy and sell their own generative AI models. This system includes various functions to efficiently perform a series of processes, such as user registration, login, uploading, listing, searching, viewing, trading, purchasing, and downloading AI models.

[0153] First, users access the system through devices such as PCs, smartphones, and tablets. The system is used through a web browser, and users operate the website's UI. The server processes these requests, storing, searching, and trading the necessary data, generating download links, and so on.

[0154] User Registration and Login

[0155] User Registration

[0156] 1. On the device: The user opens the marketplace website and accesses the sign-up page. The user enters their name, email address, and password.

[0157] 2. Server: The server receives the entered information, stores it in a database, and then sends the user a confirmation email containing a link to activate their account.

[0158] 3. On the device: The user clicks on the link in the confirmation email and the account is activated.

[0159] User Login

[0160] 1. Device: The user accesses the login page, enters their email address and password, and clicks the "Login" button.

[0161] 2. Server: The server validates the entered information and redirects the user to their dashboard if it is correct, or returns an error message if invalid information is entered.

[0162] Uploading and listing AI

[0163] Uploading an AI model

[0164] 1. User: After logging in, the user accesses the dashboard and selects "Upload AI model."

[0165] 2. On the device: An upload form will appear, and the user will enter the AI ​​model file, description, and pricing information, then click the "Upload" button.

[0166] 3. Server: The server checks the format of the uploaded AI model file. If the format is incorrect, it returns an error message to the user. If the format is correct, it stores the file and related information in a database and lists the AI ​​model on the marketplace.

[0167] Search and browse AI models

[0168] AI Model Search

[0169] 1. User: Another user enters a specific keyword (e.g., "facial recognition") into the Marketplace search bar and clicks the search button.

[0170] 2. Server: The server searches the database based on the entered keywords, creates a list of relevant AI models, and returns it.

[0171] 3. Device: The user's device will display a list of applicable AI models, and they can click on links to view more information about each model.

[0172] Purchase and Download

[0173] AI model purchase

[0174] 1. User: Click the "Purchase" button on the details page of the AI ​​model you want to purchase and enter your payment information.

[0175] 2. Server: The server processes the entered payment information, generates a download link and provides it to the user if the payment is successful, and records the purchase history in a database.

[0176] AI model download

[0177] 1. User: Click the download link to download the purchased AI model. The file will be saved to your local device.

[0178] Specific examples

[0179] Example: Steps for User A to upload a facial recognition AI model

[0180] 1. Device: User A logs in to the marketplace website and goes to the dashboard.

[0181] 2. On your device: Go to the "Upload AI Model" page, enter the AI ​​model file (Facial Recognition Model.zip), a description of the model ("This model is specialized for facial recognition"), and a price ($100), then click the "Upload" button.

[0182] 3. Server: The server checks the file format, for example to make sure it's in zip format. It then saves the file, description, and pricing information to a database, lists it on the marketplace, and sends a success message back to User A.

[0183] Example: User B's procedure for purchasing an AI model

[0184] 1. User B: Enter "face recognition" in the search bar and click the search button.

[0185] 2. Server: The server lists the relevant AI models (including User A's model) and returns them to User B.

[0186] 3. Device: User B selects User A's model from the list and checks the details page.

[0187] 4. User B: Clicks the "Purchase" button and enters payment information. For example, enters credit card information and clicks the "Pay" button.

[0188] 5. Server: Once payment is successful, generate a download link and provide it to User B. Also record the purchase history in the database.

[0189] 6. User B: Clicks the download link to download the purchased facial recognition AI model and save it to their local device.

[0190] Prompt Sentence Examples

[0191] By entering the prompt "What are the steps to upload a new AI model to the marketplace?", User A can obtain specific instructions on how to upload and list their facial recognition AI model.

[0192] This makes the system's usage and flow clearer, allowing users to effectively contribute their AI models to the marketplace.

[0193] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0194] Step 1:

[0195] User: A user opens your marketplace website and visits the sign-up page.

[0196] Input: Name, Email Address, Password

[0197] What happens: The user enters this information and clicks the "Register" button.

[0198] Step 2:

[0199] Server: The server receives the entered information and stores it in a database.

[0200] Input: Name, Email Address, Password

[0201] What it does: Checks that the input data is in the correct format, and if so, saves it to the database. It then generates a confirmation email and sends it to the user.

[0202] Output: Confirmation email sending status

[0203] Step 3:

[0204] Device: User clicks on the link in the confirmation email.

[0205] Input: Link in confirmation email

[0206] What it does: When you click the link, a request is sent to the server to access the account and activate it.

[0207] Output: Account activation status

[0208] Step 4:

[0209] Device: The user visits the login page, enters their email address and password, and clicks the "Login" button.

[0210] Input: Email address, Password

[0211] Action: A login request is sent to the server.

[0212] Step 5:

[0213] Server: The server validates the information entered.

[0214] Input: Email address, Password

[0215] What it does: Looks up the database and verifies that the email address and password match. If they are correct, it redirects the user to their dashboard. If invalid information is entered, it generates and returns an error message.

[0216] Output: Login authentication status, redirect URL or error message

[0217] Step 6:

[0218] Users: After logging in, go to the dashboard and select "Upload AI Model."

[0219] What it does: Operate the dashboard to display the AI ​​model upload form.

[0220] Step 7:

[0221] Device: Enter the required information in the upload form.

[0222] Input: AI model file, description, pricing information

[0223] How it works: Clicking the "Upload" button sends the information to the server.

[0224] Step 8:

[0225] Server: Validates the format of the uploaded AI model file.

[0226] Input: AI model file, description, pricing information

[0227] What it does: Checks whether the file format is valid, generates and returns an error message if it is not valid, saves the file and related information to a database, and lists the AI ​​model on the marketplace.

[0228] Output: File format validation status, list display status

[0229] Step 9:

[0230] User: Another user types a keyword into the Marketplace search bar and clicks the search button.

[0231] Input: Search keyword

[0232] Action: A search request is sent to the server.

[0233] Step 10:

[0234] Server: Searches the database based on the entered keywords.

[0235] Input: Search keyword

[0236] What it does: Creates a list of AI models that match the keywords and returns it to the user.

[0237] Output: Search result list

[0238] Step 11:

[0239] On the device: The user selects an AI model of interest from the displayed list and views detailed information.

[0240] Input: Search result list

[0241] Action: Displays detailed information about each AI model.

[0242] Step 12:

[0243] User: Click the "Purchase" button on the details page of the AI ​​model they want to purchase and enter their payment information.

[0244] Input: Payment information (e.g., credit card information)

[0245] What it does: Sends payment information to the server.

[0246] Step 13:

[0247] Server: Processes payment information.

[0248] Input: Payment Information

[0249] What it does: It connects to a payment service to process payments. If payment is successful, it generates a download link and provides it to the user. It also records the purchase history in a database.

[0250] Output: Payment processing status, download link, purchase history record

[0251] Step 14:

[0252] User: Click the download link to download the purchased AI model.

[0253] Input: Download link

[0254] What happens: The file is saved to the user's local device.

[0255] Output: Download completion status

[0256] (Application example 1)

[0257] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0258] In conventional AI model marketplaces, users often operate them web-based, and there is a lack of convenient systems that can be used with smartphones. This makes it difficult for users to easily upload, search, purchase, and download AI models. Furthermore, there are issues with the reliability and security of transactions. Therefore, there is a need for a reliable AI model trading system that is easy for users to use.

[0259] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0260] In this invention, the server includes means for allowing users to upload their own data and list artificial intelligence models generated based on that data, means for other users to search for and view the listed artificial intelligence models, means for trading artificial intelligence models between users, means for providing a download link after purchasing an artificial intelligence model, and means for uploading, searching, purchasing, and downloading artificial intelligence models from a user interface using a smartphone. This enables users to easily trade artificial intelligence models using their smartphones, realizing a highly reliable trading environment.

[0261] "User" refers to an individual user of the system.

[0262] "Data" refers to information and files uploaded by Users.

[0263] "Artificial intelligence model" refers to a machine learning algorithm or program generated by a user based on data.

[0264] "Listing" refers to creating a list of uploaded AI models so that they can be visually checked.

[0265] "Search" refers to the act of searching for a list of AI models based on specific keywords or criteria.

[0266] "Viewing" refers to the act of checking detailed information about an AI model selected from the search results.

[0267] "Trading" refers to the process of buying and selling artificial intelligence models.

[0268] "Purchase" refers to the act of another user paying a fee to acquire a listed artificial intelligence model.

[0269] "Download Link" refers to a specific URL for a User to download the purchased AI model.

[0270] A "smartphone" is a type of mobile phone that is a multi-function device that can connect to the Internet and use applications.

[0271] "User interface" refers to the screen and operating means that allow the user to directly interact with the system.

[0272] "Payment Information" refers to credit card information or other payment method information required for purchase.

[0273] "Database" refers to a component that systematically stores and manages various data handled by the system.

[0274] MODE FOR CARRYING OUT THE INVENTION

[0275] The present invention provides a system that provides a marketplace where users can buy and sell their own AI models. This system is designed to allow users to easily upload, search, purchase, and download AI models using their smartphones.

[0276] System Program

[0277] This system consists of both a front-end and a back-end. The front-end is mainly a smartphone application, and the back-end consists of a cloud server and database.

[0278] Front-end (smartphone app)

[0279] Framework: Cross-platform development using React Native.

[0280] function:

[0281] User Registration and Login: A user creates an account by entering information such as name, email address, and password, and then verifies the email address to activate the account.

[0282] Dashboard: After logging in, you can upload, search, and purchase AI models from the dashboard.

[0283] Upload form: The user enters the AI ​​model file, description, and pricing information, and clicks the upload button.

[0284] Search bar and results display: Users can search for AI models by entering keywords.

[0285] Purchase page and payment input form: Review the details of the AI ​​model you want to purchase and enter your payment information to complete your purchase.

[0286] Download link displayed: After purchase, the download link will be displayed.

[0287] Backend (server and database)

[0288] Framework: Node.js + Express.

[0289] Database: MongoDB is used for cloud-based, scalable data management.

[0290] function:

[0291] User information storage and authentication: User registration information is stored in a database and a confirmation email is sent.

[0292] Validate and save AI model file format: Validate the uploaded file format and save it to ensure it is in the correct format.

[0293] Processing search queries: Searching the database based on keywords entered by the user and returning results.

[0294] Payment processing: Process the user's payment information using the Stripe API, etc., and generate a download link if successful.

[0295] Download link management: Provide the generated download link to the user and record the purchase history in the database.

[0296] Specific examples

[0297] Below are some specific examples of how the system can be used.

[0298] Example of input prompt for generative AI model

[0299] The following prompts can be used to generate specific use cases for AI models:

[0300] markdown

[0301] This section provides a detailed description of a system that provides a marketplace where users can buy and sell their own artificial intelligence models. Please create a specific usage scenario in which users upload, purchase, and download AI models. Marketplace functionality includes user registration, login, and the ability to search, view, purchase, and download AI models.

[0302] By utilizing this prompt, users can create specific scenarios and demonstrate how other users can obtain AI models.

[0303] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0304] Step 1:

[0305] User Registration and Login

[0306] User: Create a new account by entering your name, email address and password.

[0307] Input: Name, Email Address, Password

[0308] Output: Send account creation confirmation email

[0309] Server: Stores this information in a database and sends a confirmation email to the user.

[0310] How it works: Click the confirmation link in the email to activate your account.

[0311] Step 2:

[0312] Log in

[0313] User: Log in with your email address and password.

[0314] Input: Email address, Password

[0315] Output: Dashboard access rights

[0316] Server: Checks credentials and redirects user to dashboard.

[0317] Behavior: If authentication is successful, the user is able to access the dashboard.

[0318] Step 3:

[0319] Uploading an AI model

[0320] User: Select "Upload AI Model" on the dashboard.

[0321] Input: AI model file, description, pricing information

[0322] Output: Upload completion notification

[0323] Device: Fill in the required information in the input form and click the upload button.

[0324] Server: Validates the file format, ensures it is in the correct format, and saves it to the database.

[0325] How it works: After the file format is validated, the model information will be listed on the Marketplace.

[0326] Step 4:

[0327] Searching for AI models

[0328] User: Enter keywords in the search bar to find AI models that meet your criteria.

[0329] Input: keyword

[0330] Output: A list of search results

[0331] Server: Sends the search query to the database and lists the corresponding AI models.

[0332] Behavior: Returns a list of matching AI models to the user.

[0333] Step 5:

[0334] Viewing AI models

[0335] User: Select an AI model of interest from the search results and view detailed information.

[0336] Input: Select search result

[0337] Output: Detailed information about the AI ​​model

[0338] On your device: View detailed information about the selected AI model.

[0339] What it does: The details page for the AI ​​model selected by the user is displayed.

[0340] Step 6:

[0341] Purchasing AI models

[0342] User: Click the "Purchase" button on the details page of the AI ​​model they want to purchase and enter their payment information.

[0343] Input: Payment Information

[0344] Output: Purchase confirmation and download link

[0345] Server: Processes payment information and generates a download link for the AI ​​model if payment is successful.

[0346] How it works: After the payment is processed, the purchase history is recorded in a database and the user is provided with a download link.

[0347] Step 7:

[0348] Downloading the AI ​​model

[0349] User: Click the download link to download the purchased AI model.

[0350] Input: Click on the download link

[0351] Output: AI model file

[0352] Device: Use the download link to get the AI ​​model.

[0353] Operation: The purchased AI model is downloaded to the user's device.

[0354] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0355] MODE FOR CARRYING OUT THE INVENTION

[0356] The present invention provides a more personalized trading environment by combining a marketplace where users can buy and sell their AI models with an emotion engine that recognizes user emotions. This system includes the following functions:

[0357] User Registration and Login

[0358] 1. Device: The user accesses the marketplace website and enters information such as name, email address, and password on the new registration page.

[0359] 2. Server: The server stores the entered information in a database and sends a confirmation email to the user, who clicks on a link in the email to activate their account.

[0360] 3. Device: Then, log in by entering your email address and password on the login page.

[0361] Uploading and listing AI

[0362] 1. User: After logging in, access the dashboard and select "Upload AI Model."

[0363] 2. Device: Enter the required information in the upload form (AI model file, description, price information, etc.) and click the Upload button.

[0364] 3. Server: The server validates the received AI model file format to ensure it is in the correct format. If there are no problems, it stores the file and related information in a database and lists it on the marketplace.

[0365] Search and browse AI models

[0366] 1. User: Enter keywords in the Marketplace search bar to find AI models that meet your criteria.

[0367] 2. Server: The server searches the database based on the entered keywords and returns a list of matching AI models to the user.

[0368] 3. Device: The user selects an AI model of interest from the displayed list and views detailed information.

[0369] Purchase and Download

[0370] 1. User: Click the "Purchase" button on the details page of the AI ​​model you want to purchase and enter your payment information.

[0371] 2. Server: The server processes the entered payment information, generates a download link if the payment is successful, and records the purchase history in a database.

[0372] 3. User: The user clicks the download link to download the purchased AI model.

[0373] Additional features of the Emotion Engine

[0374] 1. Server: The data uploaded by the user is embedded with an emotion engine that recognizes the user's emotions.

[0375] 2. Server: Based on the recognized emotion, analyze the state, such as "excited" or "anxious."

[0376] 3. Device: Recommends AI models based on the emotional information recognized by the emotion engine. For example, if the user is excited, it will recommend an entertainment-oriented AI model, and if the user is calm, it will recommend an educational AI model.

[0377] 4. Terminal: Dynamically change the interface of the transaction page based on emotional information. For example, if the user is feeling anxious, a more subdued color scheme and fonts can be used to provide a sense of security.

[0378] Specific examples

[0379] Below is a concrete example of incorporating an emotion engine.

[0380] Example 1: User C uploads a facial recognition AI model to the marketplace

[0381] 1. Device: User C logs in to the marketplace and accesses the upload page for the facial recognition AI model.

[0382] 2. Device: Enter the AI ​​model file, a brief description of the model, and the price in the form, then click the "Upload" button.

[0383] 3. Server: The server verifies the format of the received AI model and, if there are no problems, stores it in a database and lists it on the marketplace.

[0384] 4. Server: The emotion engine recognizes User C's emotions from their facial expressions and voice data, and analyzes them as, for example, "excited."

[0385] 5. User D: User D types "face recognition" into the search bar and finds User C's AI model in the search results.

[0386] 6. Server: Recognizes that User D's emotion is "anxiety" and changes the design of the transaction page to a calmer color scheme.

[0387] 7. User D: Completes the purchase process, enters payment information, and clicks the "Purchase" button.

[0388] 8. Server: The payment process is successful and a download link is generated and provided to User D.

[0389] 9. User D: Clicks the download link to get the facial recognition AI model.

[0390] This system can provide a personalized trading environment that responds to users' emotions, improving trading reliability and user experience.

[0391] The processing flow will be explained below.

[0392] User Registration and Login

[0393] Step 1:

[0394] Device: The user visits the marketplace website and clicks the "Sign Up" button.

[0395] Step 2:

[0396] Device: Enter your name, email address, and password in the registration form and click the "Register" button.

[0397] Step 3:

[0398] Server: Receives the form data and searches a database to ensure the entered email address is unique.

[0399] Step 4:

[0400] Server: If the email address is unique, store the entered user information in a database along with the hashed password.

[0401] Step 5:

[0402] Server: Send the user a confirmation email that their registration is complete.

[0403] Step 6:

[0404] Users: Receive a confirmation email and click the link in the email to activate their account.

[0405] Step 7:

[0406] On the device: The user accesses the login page and logs in by entering their email address and password.

[0407] Step 8:

[0408] Server: Validates the login information and, if successful, starts the user session.

[0409] Uploading and listing AI

[0410] Step 1:

[0411] User: After logging in, select "Upload AI Model" from the dashboard.

[0412] Step 2:

[0413] Device: Enter the AI ​​model file, description, and pricing information in the upload form.

[0414] Step 3:

[0415] On the device: Click the upload button to send the form data to the server.

[0416] Step 4:

[0417] Server: Receives the form data and validates the file format for the AI ​​model.

[0418] Step 5:

[0419] Server: If the verification is successful, the AI ​​model file is saved in storage.

[0420] Step 6:

[0421] Server: Stores the AI ​​model metadata (description, category, pricing information, etc.) in a database.

[0422] Step 7:

[0423] Server: Lists the AI ​​model on the marketplace and notifies the user when the upload is complete.

[0424] Search and browse AI models

[0425] Step 1:

[0426] User: Enter keywords into the Marketplace search bar and click the search button.

[0427] Step 2:

[0428] Server: Receives search queries and extracts corresponding AI models from the database.

[0429] Step 3:

[0430] Server: Returns the list of extracted AI models to the user device.

[0431] Step 4:

[0432] Terminal: Shows the user the list of AI models.

[0433] Step 5:

[0434] User: Select the AI ​​model of interest from the displayed list and view its detailed information.

[0435] Purchase and Download

[0436] Step 1:

[0437] User: Click the "Purchase" button on the details page of the AI ​​model you want to purchase.

[0438] Step 2:

[0439] Device: Enter your credit card and payment information into the purchase form.

[0440] Step 3:

[0441] Terminal: Check the input and send.

[0442] Step 4:

[0443] Server: Receives payment information and sends it to the payment gateway to process the payment.

[0444] Step 5:

[0445] Server: If payment is successful, generate the download link.

[0446] Step 6:

[0447] Server: Sends the user a purchase confirmation email and provides a download link.

[0448] Step 7:

[0449] Server: Records purchase history in a database.

[0450] Step 8:

[0451] User: Receives purchase confirmation email and clicks download link to download the AI ​​model.

[0452] Additional features of the Emotion Engine

[0453] Step 1:

[0454] Server: The data uploaded by the user has an emotion engine built in that recognizes the user's emotions.

[0455] Step 2:

[0456] Server: Based on the recognized emotion, analyze the state, such as "excited" or "anxious."

[0457] Step 3:

[0458] Device: Recommends AI models based on the emotional information recognized by the emotion engine. For example, if the user is excited, it will recommend an entertainment-oriented AI model, and if the user is calm, it will recommend an educational AI model.

[0459] Step 4:

[0460] Terminal: Dynamically change the interface of the transaction page based on emotional information. For example, if the user is feeling anxious, a more subdued color scheme and fonts can be used to provide a sense of security.

[0461] Specific examples

[0462] Example 1: User C uploads a facial recognition AI model to the marketplace

[0463] Step 1:

[0464] Device: User C logs in to the marketplace and accesses the upload page for the facial recognition AI model.

[0465] Step 2:

[0466] Device: Enter the AI ​​model file, a brief description of the model, and the price in the form, then click the "Upload" button.

[0467] Step 3:

[0468] Server: The server verifies the format of the received AI model and, if there are no problems, stores it in a database and lists it on the marketplace.

[0469] Step 4:

[0470] Server: The emotion engine recognizes User C's emotions from their facial expressions and voice data, and analyzes them as "excited," for example.

[0471] Step 5:

[0472] User D: User D types "face recognition" into the search bar and finds User C's AI model in the search results.

[0473] Step 6:

[0474] Server: Recognizes that User D's emotion is "anxiety" and changes the design of the trading page to a more subdued color scheme.

[0475] Step 7:

[0476] User D: Completes the checkout process, enters payment information and clicks the "Purchase" button.

[0477] Step 8:

[0478] Server: Payment processing is successful, and a download link is generated and provided to User D.

[0479] Step 9:

[0480] User D: Clicks the download link to get the facial recognition AI model.

[0481] Example 2

[0482] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0483] Conventional AI model marketplaces do not personalize the trading environment according to the user's emotional state, which leads to a problem that the user experience tends to remain at a constant quality.In addition, since recommendations and interface adjustments are not made based on the user's emotional state, it is difficult to optimize trading, and improving user satisfaction has been an issue.

[0484] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for a user to upload his / her own data and list AI models generated based on the data; means for other users to search for and view the listed AI models; means for trading AI models between users; means for providing a download link after purchasing an AI model; means for an emotion analysis engine to recognize the emotional state of the user when uploading an AI model and adjust operation based on the emotional state; means for dynamically changing the AI ​​model recommended to the user based on the emotional state recognized by the emotion analysis engine; and means for dynamically changing the design of the user interface based on the emotional state recognized by the emotion analysis engine. This provides a trading environment personalized according to the user's emotional state, enabling optimization of trading and improved user satisfaction.

[0485] "User" means any person or entity that uses the System to upload, search, purchase, or download AI models.

[0486] "Data" refers to various information uploaded by users, including the AI ​​model itself, descriptions, pricing information, etc.

[0487] An "artificial intelligence model" is a user-created machine learning algorithm or software that operates based on specific data.

[0488] A "marketplace" is an online platform for buying and selling artificial intelligence models generated by multiple users.

[0489] An "emotion analysis engine" is software or hardware that recognizes and analyzes a user's emotional state from facial expressions and voice data.

[0490] "Listing" refers to organizing uploaded AI models and making them available for viewing on the marketplace.

[0491] "Search" refers to the act of finding a specific AI model within the marketplace using keywords and filters.

[0492] "Trading" is the process by which users buy and sell artificial intelligence models.

[0493] A "download link" is a URL or access means for a user to save the AI ​​model they purchased to their device via the Internet.

[0494] "Adjusting behavior" means dynamically changing the system's behavior and recommendations based on the user's emotional state recognized by the emotion analysis engine.

[0495] "Recommendation" is the act of presenting an appropriate artificial intelligence model to a user based on the user's emotional state and past operation history.

[0496] "User interface" refers to the screens and methods of operation that allow a user to interact with a system.

[0497] MODE FOR CARRYING OUT THE INVENTION

[0498] The present invention provides a more personalized trading environment by combining a marketplace where users can buy and sell their artificial intelligence models with an emotion analysis engine that recognizes user emotions. An embodiment of this system is described in detail below.

[0499] System Configuration

[0500] The system includes the following elements:

[0501] 1. Terminal: A device used by a user to access the site, such as a PC, tablet, or smartphone. A web browser runs on the terminal, providing the user interface.

[0502] 2. Server: This is the core of the system and performs functions such as database management, sentiment analysis, and transaction processing. It includes web servers such as Apache (registered trademark) and Nginx, and database servers such as MySQL (registered trademark).

[0503] 3. Emotion analysis engine: Software for recognizing the user's emotional state. For example, Amazon Rekognition or Microsoft® Azure® Cognitive Services can be used.

[0504] Key Features

[0505] The system has the following main functions:

[0506] User Registration and Login

[0507] Terminal: The user accesses the marketplace registration page on a web browser and enters the required information.

[0508] Server: Stores the entered information in a database and sends a confirmation email. The user activates their account by clicking the link in the confirmation email and then logs in.

[0509] Uploading and validating the AI ​​model

[0510] User: After logging in, access the dashboard and select "Upload AI model."

[0511] Device: Enter the required information (AI model file, description, price information, etc.) and click the upload button.

[0512] Server: Validates the file format of the received AI model to ensure it is in the correct format. If there are no problems, it is saved in the database and listed on the marketplace.

[0513] Search and browse AI models

[0514] Users: Enter keywords into the Marketplace search bar to find AI models that meet their criteria.

[0515] Server: Queries the database based on the search keywords and returns a list of relevant AI models.

[0516] Terminal: Displays search results and allows users to view detailed information about AI models of interest.

[0517] Purchase and download AI models

[0518] User: Click the "Purchase" button on the details page of the AI ​​model they want to purchase and enter their payment information.

[0519] Server: Processes payment information, generates download links if payment is successful, and records purchase history in a database.

[0520] User: Click the download link to get the AI ​​model.

[0521] Personalization with sentiment analysis

[0522] Server: The emotion analysis engine recognizes the user's emotional state based on facial expressions and voice data. For example, it analyzes states such as "excited" or "anxious."

[0523] Device: Recommend appropriate AI models to users based on their emotional state, for example, entertainment or education models.

[0524] Terminal: Dynamically change the interface design based on emotions, for example by using muted color schemes to improve the user experience.

[0525] Specific examples

[0526] Here are some examples of how sentiment analysis engines can be used:

[0527] Example 1: User A uploads a facial recognition AI model to the marketplace

[0528] Device: User A logs in to the marketplace and accesses the upload page for the facial recognition AI model.

[0529] Device: Enter the AI ​​model file, a brief description, and pricing information into the form and click the "Upload" button.

[0530] Server: Validates the format of the AI ​​model and stores it in the database if there are no problems.

[0531] Server: The emotion analysis engine analyzes User A's emotion and recognizes that he is "excited."

[0532] Example 2: User B searches for a face recognition AI model

[0533] User B: Enters "face recognition" in the search bar and finds User A's model in the search results.

[0534] Server: The emotion analysis engine analyzes User B's emotions and recognizes "anxiety."

[0535] Terminal: The design of the trading page is changed to a more subdued color scheme, providing an environment where User B can trade with peace of mind.

[0536] Prompt Sentence Examples

[0537] Below are some example prompts to input to a generative AI model:

[0538] "Please recommend the best educational AI model for a calm user."

[0539] "Please suggest entertainment AI models to users who are in an excited state."

[0540] "Design a reassuring interface for anxious users."

[0541] The system of the present invention makes it possible to provide a personalized trading environment that corresponds to the user's emotional state, improving the user experience and increasing the reliability of transactions.

[0542] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0543] Step 1:

[0544] User: Visits the marketplace website and enters information such as name, email address, and password on the sign-up page.

[0545] Input: Personal information (name, email address, password)

[0546] Output: Submit the registration form

[0547] Specific actions: The user enters their information and clicks the "Register" button.

[0548] Step 2:

[0549] Server: Stores the entered information in a database and sends a confirmation email to the user.

[0550] Input: Registration form data

[0551] Output: Database record, confirmation email

[0552] What it does: Receives registration information, stores it in a MySQL database, and then sends a confirmation email using an SMTP server.

[0553] Step 3:

[0554] Users: Click the link in the confirmation email to activate their account.

[0555] Input: Link from confirmation email

[0556] Output: Account activation confirmation

[0557] Specific actions: Open the email and click the link to go to the account activation page.

[0558] Step 4:

[0559] User: Log in by entering your email address and password on the login page.

[0560] Input: Email address, Password

[0561] Output: Login request

[0562] Specific action: The user enters their email address and password and clicks the "Login" button.

[0563] Step 5:

[0564] Server: Checks database to see if the entered email address and password are correct. If so, creates a session and redirects to the dashboard.

[0565] Input: Login request data

[0566] Output: Session ID, Dashboard screen display

[0567] What it does: Generates a session ID and stores it as a cookie in the user's browser, then redirects the user to the dashboard.

[0568] Step 6:

[0569] User: Go to the dashboard and select "Upload AI Model."

[0570] Input: User action

[0571] Output: Upload form displayed

[0572] Specific actions: Click the "Upload AI model" link on the dashboard.

[0573] Step 7:

[0574] Device: Enter the required information in the upload form (AI model file, description, price information, etc.) and click the Upload button.

[0575] Input: AI model file, description, price information

[0576] Output: Upload request

[0577] Specific actions: Enter the required information into the form and click the "Upload" button.

[0578] Step 8:

[0579] Server: Validates the file format of the received AI model to ensure it is in the correct format. If there are no problems, it stores it in the database and storage, and lists it on the marketplace.

[0580] Input: Upload request data

[0581] Output: Database records, storage saves, marketplace listings

[0582] Specific behavior: Checks the file format and performs error checking. Passed files are saved to storage and the database. Then, they are added to the marketplace listing.

[0583] Step 9:

[0584] Users: Enter keywords into the Marketplace search bar to find AI models that meet their criteria.

[0585] Input: Search keyword

[0586] Output: Search result list

[0587] Specific actions: Enter keywords in the search bar and click the "Search" button.

[0588] Step 10:

[0589] Server: Searches the database based on the entered keywords and returns a list of matching AI models to the user.

[0590] Input: Search keyword

[0591] Output: Search result data

[0592] What it does: Executes a database query and returns the results in JSON format.

[0593] Step 11:

[0594] On the device: The user selects an AI model of interest from the displayed list and views detailed information.

[0595] Input: Search results

[0596] Output: Detailed information about the AI ​​model

[0597] Specific actions: Click on an AI model from the list to go to its details page.

[0598] Step 12:

[0599] User: Click the "Purchase" button on the details page of the AI ​​model they want to purchase and enter their payment information.

[0600] Input: Payment Information

[0601] Output: Purchase request

[0602] Specific actions: Enter your credit card information on the purchase page and click the "Purchase" button.

[0603] Step 13:

[0604] Server: Processes payment information, generates download links if payment is successful, and records purchase history in a database.

[0605] Input: Purchase request, payment information

[0606] Output: Download links, purchase history

[0607] What it does: Processes the payment through a payment gateway, generates and stores a download link if successful, and records the purchase history in a database.

[0608] Step 14:

[0609] User: Click the download link to download the purchased AI model.

[0610] Input: Download link

[0611] Output: AI model file

[0612] Specific actions: Click the download link and save the file to your device.

[0613] Step 15:

[0614] Server: The emotion analysis engine recognizes the user's emotional state based on facial expressions and voice data.

[0615] Input: facial expression data, voice data

[0616] Output: Emotional state data

[0617] Specific behavior: Analyze facial expressions and voice data and assign emotional status such as "excited" or "anxious."

[0618] Step 16:

[0619] On-device: Recommend appropriate AI models to users based on their emotional state.

[0620] Input: Emotional state data

[0621] Output: Recommended AI model list

[0622] Specific behavior: Display a list of appropriate AI models on the screen depending on the emotional status.

[0623] Step 17:

[0624] Terminal: Dynamically change interface design based on emotions.

[0625] Input: Emotional state data

[0626] Output: A customized user interface

[0627] What it does: Dynamically change the CSS styles of the page to optimize the design depending on the emotional status.

[0628] (Application example 2)

[0629] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0630] Conventional automated driving systems provide a uniform driving pattern without considering the emotional state of the driver, which results in a lack of safety and comfort due to the lack of driving control according to the driver's psychological state. The present invention aims to solve this problem and optimize automated driving according to the driver's emotions.

[0631] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0632] In this invention, the server includes means for allowing users to upload their own data and for listing artificial intelligence models generated based on the data, means for other users to search for and view the listed artificial intelligence models, means for trading artificial intelligence models between users, means for providing a download link after purchasing an artificial intelligence model, means for recognizing the driver's emotions in real time, means for adjusting the automated driving pattern based on the emotions, and means for changing the content of suggestions based on the emotions, thereby enabling optimization of automated driving according to the driver's emotional state.

[0633] "User" means any individual or legal entity that uses the system to upload their own data and generate and trade artificial intelligence models.

[0634] "Data" refers to the information and files that users upload to the system and are the raw material for generating artificial intelligence models.

[0635] An "artificial intelligence model" is a machine learning model or algorithm generated based on user data, and is a program for performing specific tasks.

[0636] "Listing" is the process of displaying uploaded AI models in a list on the system, making them easier for other users to search and view.

[0637] "Search" is the process by which a user finds an AI model of interest using specific keywords or criteria.

[0638] "Viewing" refers to the act of a user checking detailed information about an artificial intelligence model displayed as a search result.

[0639] "Trading" is the process of buying, selling, or exchanging AI models between users.

[0640] "Purchase" refers to the act of another user paying money to acquire a listed artificial intelligence model.

[0641] A "download link" is a URL generated by the server that allows a user to download an AI model to their device after purchase.

[0642] "Emotion recognition" is the process of identifying a driver's emotional state by analyzing their facial expressions and voice.

[0643] "Adjusting automated driving patterns" is the process of changing the driving mode or operation method of the automated driving system based on the driver's emotional state.

[0644] "Change suggestions" means adjusting infotainment content such as music and route guidance based on the driver's emotions.

[0645] This invention relates to a system that controls driving in an autonomous vehicle based on the emotional state of the driver, thereby providing a safe and comfortable driving experience.

[0646] Configuration and Operation

[0647] The system includes a means for recognizing drivers' emotions while driving, a marketplace for trading artificial intelligence models, a means for adjusting autonomous driving patterns based on emotion recognition, and a database for managing user data.

[0648] Hardware and software used

[0649] To realize this system, the following hardware and software are used.

[0650] Hardware: Cameras (for facial recognition), microphones (for voice recognition), and control units installed in autonomous vehicles

[0651] Software: OpenCV (facial expression recognition library), pyAudioAnalysis (audio analysis library), ROS (Robot Operating System), database (MySQL, etc.)

[0652] Program processing

[0653] 1. Emotion recognition:

[0654] The server captures the driver's face with a camera and analyzes his facial expressions using OpenCV.

[0655] Additionally, audio data collected by the microphone is analyzed with pyAudioAnalysis to identify the driver's emotional state (e.g., tension, relaxation, stress).

[0656] 2. Emotion-based autonomous driving control:

[0657] Once emotional information is recognized, the server uses this information to adjust the autonomous driving pattern.

[0658] For example, if the driver is feeling stressed, the vehicle's control unit will reduce the driving speed and switch to a safety-focused driving mode.

[0659] 3. User interface adjustments:

[0660] Based on emotional information, the content and display method of the infotainment system will also change dynamically.

[0661] For example, if the driver is feeling nervous, the system will suggest relaxing music and change the screen color to a calming tone.

[0662] Specific examples and program processing

[0663] As a concrete example, consider a scenario in which a driver is operating an autonomous vehicle. After the driver starts driving, the system monitors the driver's face and voice for signs of tension. If the emotion recognition library analyzes this information and determines that the emotional state is "tension," the vehicle's autonomous driving system switches to "relaxed driving mode."

[0664] At this time, the autonomous driving speed is set to a slightly slower speed, and the infotainment system starts playing relaxing background music and changes the screen color to calming shades of blue and green to reduce the driver's psychological stress.

[0665] Prompt Sentence Examples

[0666] "Design a system for an autonomous vehicle that recognizes the facial expressions and voice of a nervous driver in real time and switches to safe driving mode. Please provide details of the APIs and logic used."

[0667] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0668] Step 1:

[0669] Acquiring emotion data

[0670] Input: Image data of the driver's facial expressions captured by a camera, and audio data of the driver's voice captured by a microphone.

[0671] Specific operation:

[0672] The device uses a camera installed inside the vehicle to capture a photo of the driver's face at regular intervals and records their voice with a microphone.

[0673] The acquired image and audio data is instantly transmitted to the system.

[0674] Output: Collected facial expression image data and audio data.

[0675] Step 2:

[0676] emotion recognition

[0677] Input: Collected facial image data and audio data.

[0678] Specific operation:

[0679] The device uses facial expression recognition software (OpenCV) to analyze facial expression data and infer emotional states.

[0680] The audio data is analyzed using an audio analysis library (pyAudioAnalysis) to estimate the emotional state from the audio.

[0681] Output: The resulting emotional state (e.g., tense, relaxed, stressed).

[0682] Step 3:

[0683] Integration of emotional states

[0684] Input: Facial expression recognition results and voice analysis results.

[0685] Specific operation:

[0686] The server runs an algorithm to determine the overall emotional state based on the results of facial expression analysis and voice analysis.

[0687] Each emotion result is weighted, and the most dominant emotion is determined as the final emotion state.

[0688] Output: Integrated emotional state information.

[0689] Step 4:

[0690] Adjusting autonomous driving patterns

[0691] Input: Integrated emotional state information.

[0692] Specific operation:

[0693] The server generates a command to change the driving pattern based on the emotional state information.

[0694] For example, if a state of tension is detected, a command to switch to "safe driving mode" is issued.

[0695] Output: Command to change driving pattern (e.g. "Safe driving mode").

[0696] Step 5:

[0697] Executing a driving pattern

[0698] Input: Command to change driving pattern.

[0699] Specific operation:

[0700] The autonomous vehicle's control unit automatically adjusts its driving patterns based on the received instructions.

[0701] For example, when switching to "safe driving mode," the speed is set low and careful driving behavior is adopted.

[0702] Output: Actual driving pattern (e.g. slower speed, more cautious operation).

[0703] Step 6:

[0704] Infotainment system adjustments

[0705] Input: Integrated emotional state information.

[0706] Specific operation:

[0707] The server changes the suggestions and display methods of the infotainment system based on the emotional state.

[0708] For example, if you're feeling nervous, it will suggest relaxing music and change the screen color to a calming tone.

[0709] Output: Tailored infotainment content and screen display.

[0710] Step 7:

[0711] User Feedback

[0712] Input: adjusted infotainment content and driving patterns.

[0713] Specific operation:

[0714] The terminal provides real-time feedback to the user.

[0715] If the driver is nervous, a message such as "Switched to relaxation driving mode" will be displayed.

[0716] Output: Notification and feedback display to the user.

[0717] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0718] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0719] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0720] [Second embodiment]

[0721] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0722] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0723] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0724] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0725] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0726] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0727] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0728] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0729] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0730] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0731] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0732] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0733] MODE FOR CARRYING OUT THE INVENTION

[0734] The present invention provides a system for providing a marketplace where users can buy and sell their own artificial intelligence models. This system includes the following functions:

[0735] User Registration and Login

[0736] 1. Device: The user accesses the marketplace website and enters information such as name, email address, and password on the new registration page.

[0737] 2. Server: The server stores the entered information in a database and sends a confirmation email to the user, who clicks on a link in the email to activate their account.

[0738] 3. Device: Then, log in by entering your email address and password on the login page.

[0739] Uploading and listing AI

[0740] 1. User: After logging in, access the dashboard and select "Upload AI Model."

[0741] 2. Device: The user enters the required information in the upload form (AI model file, description, price information, etc.) and clicks the upload button.

[0742] 3. Server: The server validates the received AI model file format to ensure it is in the correct format. If there are no problems, it stores the file and related information in a database and lists it on the marketplace.

[0743] Search and browse AI models

[0744] 1. User: Other users enter keywords into the marketplace search bar to find AI models that meet their criteria.

[0745] 2. Server: The server searches the database based on the entered keywords and returns a list of matching AI models to the user.

[0746] 3. Device: The user selects an AI model of interest from the displayed list and views detailed information.

[0747] Purchase and Download

[0748] 1. User: Click the "Purchase" button on the details page of the AI ​​model you want to purchase and enter your payment information.

[0749] 2. Server: The server processes the entered payment information, generates a download link if the payment is successful, and records the purchase history in a database.

[0750] 3. User: The user clicks the download link to download the purchased AI model.

[0751] Specific examples

[0752] A specific example of this system is shown below.

[0753] Example 1: User A uploads a facial recognition AI model developed as a hobby to the marketplace.

[0754] 1. Device: User A logs in to the marketplace and accesses the upload page for the facial recognition AI model.

[0755] 2. Device: Enter the AI ​​model file, a brief description of the model, and the price in the form, then click the "Upload" button.

[0756] 3. Server: The server verifies the format of the received AI model and, if there are no problems, stores it in a database and lists it on the marketplace.

[0757] 4. User B: User B types "face recognition" into the search bar and finds User A's AI model in the search results.

[0758] 5. User B: Checks the details page, clicks the "Purchase" button, enters payment information, and completes the purchase.

[0759] 6. Server: If the payment is successful, the server generates a download link and provides it to User B.

[0760] 7. User B: Clicks the download link to get the facial recognition AI model.

[0761] This allows User A to sell the AI ​​model he or she developed, and User B to purchase the AI ​​model they need. This system enables efficient and secure trading of AI models between users.

[0762] The processing flow will be explained below.

[0763] User Registration and Login

[0764] Step 1:

[0765] Device: The user visits the marketplace website and clicks the "Sign Up" button.

[0766] Step 2:

[0767] Device: Enter your name, email address, and password in the registration form and click the "Register" button.

[0768] Step 3:

[0769] Server: Receives the form data and searches a database to ensure the entered email address is unique.

[0770] Step 4:

[0771] Server: If the email address is unique, store the entered user information in a database along with the hashed password.

[0772] Step 5:

[0773] Server: Send the user a confirmation email that their registration is complete.

[0774] Step 6:

[0775] Users: Receive a confirmation email and click the link in the email to activate their account.

[0776] Step 7:

[0777] On the device: The user accesses the login page and logs in by entering their email address and password.

[0778] Step 8:

[0779] Server: Validates the login information and, if successful, starts the user session.

[0780] Uploading and listing AI

[0781] Step 1:

[0782] User: After logging in, select "Upload AI Model" from the dashboard.

[0783] Step 2:

[0784] Device: Enter the AI ​​model file, description, and pricing information in the upload form.

[0785] Step 3:

[0786] On the device: Click the upload button to send the form data to the server.

[0787] Step 4:

[0788] Server: Receives the form data and validates the file format for the AI ​​model.

[0789] Step 5:

[0790] Server: If the verification is successful, the AI ​​model file is saved in storage.

[0791] Step 6:

[0792] Server: Stores the AI ​​model metadata (description, category, pricing information, etc.) in a database.

[0793] Step 7:

[0794] Server: Lists the AI ​​model on the marketplace and notifies the user when the upload is complete.

[0795] Search and browse AI models

[0796] Step 1:

[0797] User: Enter keywords into the Marketplace search bar and click the search button.

[0798] Step 2:

[0799] Server: Receives search queries and extracts corresponding AI models from the database.

[0800] Step 3:

[0801] Server: Returns the list of extracted AI models to the user device.

[0802] Step 4:

[0803] Terminal: Shows the user the list of AI models.

[0804] Step 5:

[0805] User: Select the AI ​​model of interest from the displayed list and view its detailed information.

[0806] Purchase and Download

[0807] Step 1:

[0808] User: Click the "Purchase" button on the details page of the AI ​​model you want to purchase.

[0809] Step 2:

[0810] Device: Enter your credit card and payment information into the purchase form.

[0811] Step 3:

[0812] Terminal: Check the input and send.

[0813] Step 4:

[0814] Server: Receives payment information and sends it to the payment gateway to process the payment.

[0815] Step 5:

[0816] Server: If payment is successful, generate the download link.

[0817] Step 6:

[0818] Server: Sends the user a purchase confirmation email and provides a download link.

[0819] Step 7:

[0820] Server: Records purchase history in a database.

[0821] Step 8:

[0822] User: Receives purchase confirmation email and clicks download link to download the AI ​​model.

[0823] This will allow users to trade the AI ​​models they have created on the marketplace.

[0824] Example 1

[0825] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0826] Conventional AI model trading systems face the challenge of requiring users to upload models properly and effectively list, search, purchase, and download them through cumbersome procedures. In particular, complex registration and authentication procedures, as well as insufficient formal model validation and payment processing, detract from the user experience. Another problem is the inability to properly manage purchase history.

[0827] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0828] In this invention, the server includes means for users to upload their own data and list artificial intelligence models generated based on that data, means for other users to search for and view the listed artificial intelligence models, means for users to trade artificial intelligence models, means for providing a download link after purchasing an artificial intelligence model, means for new users to enter personal information, receive a registration confirmation email, and activate their account, means for registered users to complete login authentication and access the dashboard, means for verifying and listing artificial intelligence models after uploading, means for processing payment information after purchase and generating a download link when successful payment is confirmed, and means for recording purchase history in a database. This makes it possible to streamline the entire process from uploading to trading, purchasing, and downloading artificial intelligence models, improving the user experience.

[0829] "User" means an individual or legal entity that uses the system to upload their own data and trade artificial intelligence models.

[0830] A "server" is a computer system that processes requests sent by users and stores, retrieves, and transacts data, generates download links, and so on.

[0831] A "terminal" is a device such as a PC, smartphone, or tablet that a user uses to access the system.

[0832] An "artificial intelligence model" is a program or algorithm generated by a user and uploaded, listed, traded, purchased, or downloaded through the system.

[0833] "Listing" is the process of storing an uploaded AI model in a database within the system, making it available for other users to search and view.

[0834] "Search" is the act of a user entering specific keywords or conditions to find an artificial intelligence model stored within the system.

[0835] "Viewing" refers to the act of displaying detailed information about an artificial intelligence model selected from the search results.

[0836] "Transaction" refers to the act of buying and selling artificial intelligence models between users.

[0837] A "download link" is a URL that allows a user to save the purchased AI model to their own device.

[0838] A "Registration Confirmation Email" is an email containing a confirmation link required by a New User to complete their Account registration.

[0839] "Account Activation" is the process of activating a new user's account on the system by clicking on a link in a confirmation email.

[0840] "Login authentication" is the process by which a user logs in to their account using an email address and password when accessing a system.

[0841] The "dashboard" is the main screen of the system that can be accessed by logged-in users, and is an interface that allows various operations and confirmation of information.

[0842] "Formal verification" is the process of verifying that the file format of an uploaded artificial intelligence model meets the standards required by the system.

[0843] "Payment Information" is data relating to a payment method, such as credit card information, that a user provides to complete a transaction.

[0844] "Payment processing" is the process of charging the transaction amount based on the payment information entered by the user and confirming whether the payment was successful.

[0845] "Purchase history" is data that records transaction information for AI models that a user has purchased in the past.

[0846] MODE FOR CARRYING OUT THE INVENTION

[0847] The present invention is a system that provides a marketplace where users can buy and sell their own generative AI models. This system includes various functions to efficiently perform a series of processes, such as user registration, login, uploading, listing, searching, viewing, trading, purchasing, and downloading AI models.

[0848] First, users access the system through devices such as PCs, smartphones, and tablets. The system is used through a web browser, and users operate the website's UI. The server processes these requests, storing, searching, and trading the necessary data, generating download links, and so on.

[0849] User Registration and Login

[0850] User Registration

[0851] 1. On the device: The user opens the marketplace website and accesses the sign-up page. The user enters their name, email address, and password.

[0852] 2. Server: The server receives the entered information, stores it in a database, and then sends the user a confirmation email containing a link to activate their account.

[0853] 3. On the device: The user clicks on the link in the confirmation email and the account is activated.

[0854] User Login

[0855] 1. Device: The user accesses the login page, enters their email address and password, and clicks the "Login" button.

[0856] 2. Server: The server validates the entered information and redirects the user to their dashboard if it is correct, or returns an error message if invalid information is entered.

[0857] Uploading and listing AI

[0858] Uploading an AI model

[0859] 1. User: After logging in, the user accesses the dashboard and selects "Upload AI model."

[0860] 2. On the device: An upload form will appear, and the user will enter the AI ​​model file, description, and pricing information, then click the "Upload" button.

[0861] 3. Server: The server checks the format of the uploaded AI model file. If the format is incorrect, it returns an error message to the user. If the format is correct, it stores the file and related information in a database and lists the AI ​​model on the marketplace.

[0862] Search and browse AI models

[0863] AI Model Search

[0864] 1. User: Another user enters a specific keyword (e.g., "facial recognition") into the Marketplace search bar and clicks the search button.

[0865] 2. Server: The server searches the database based on the entered keywords, creates a list of relevant AI models, and returns it.

[0866] 3. Device: The user's device will display a list of applicable AI models, and they can click on links to view more information about each model.

[0867] Purchase and Download

[0868] AI model purchase

[0869] 1. User: Click the "Purchase" button on the details page of the AI ​​model you want to purchase and enter your payment information.

[0870] 2. Server: The server processes the entered payment information, generates a download link and provides it to the user if the payment is successful, and records the purchase history in a database.

[0871] AI model download

[0872] 1. User: Click the download link to download the purchased AI model. The file will be saved to your local device.

[0873] Specific examples

[0874] Example: Steps for User A to upload a facial recognition AI model

[0875] 1. Device: User A logs in to the marketplace website and goes to the dashboard.

[0876] 2. On your device: Go to the "Upload AI Model" page, enter the AI ​​model file (Facial Recognition Model.zip), a description of the model ("This model is specialized for facial recognition"), and a price ($100), then click the "Upload" button.

[0877] 3. Server: The server checks the file format, for example to make sure it's in zip format. It then saves the file, description, and pricing information to a database, lists it on the marketplace, and sends a success message back to User A.

[0878] Example: User B's procedure for purchasing an AI model

[0879] 1. User B: Enter "face recognition" in the search bar and click the search button.

[0880] 2. Server: The server lists the relevant AI models (including User A's model) and returns them to User B.

[0881] 3. Device: User B selects User A's model from the list and checks the details page.

[0882] 4. User B: Clicks the "Purchase" button and enters payment information. For example, enters credit card information and clicks the "Pay" button.

[0883] 5. Server: Once payment is successful, generate a download link and provide it to User B. Also record the purchase history in the database.

[0884] 6. User B: Clicks the download link to download the purchased facial recognition AI model and save it to their local device.

[0885] Prompt Sentence Examples

[0886] By entering the prompt "What are the steps to upload a new AI model to the marketplace?", User A can obtain specific instructions on how to upload and list their facial recognition AI model.

[0887] This makes the system's usage and flow clearer, allowing users to effectively contribute their AI models to the marketplace.

[0888] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0889] Step 1:

[0890] User: A user opens your marketplace website and visits the sign-up page.

[0891] Input: Name, Email Address, Password

[0892] What happens: The user enters this information and clicks the "Register" button.

[0893] Step 2:

[0894] Server: The server receives the entered information and stores it in a database.

[0895] Input: Name, Email Address, Password

[0896] What it does: Checks that the input data is in the correct format, and if so, saves it to the database. It then generates a confirmation email and sends it to the user.

[0897] Output: Confirmation email sending status

[0898] Step 3:

[0899] Device: User clicks on the link in the confirmation email.

[0900] Input: Link in confirmation email

[0901] What it does: When you click the link, a request is sent to the server to access the account and activate it.

[0902] Output: Account activation status

[0903] Step 4:

[0904] Device: The user visits the login page, enters their email address and password, and clicks the "Login" button.

[0905] Input: Email address, Password

[0906] Action: A login request is sent to the server.

[0907] Step 5:

[0908] Server: The server validates the information entered.

[0909] Input: Email address, Password

[0910] What it does: Looks up the database and verifies that the email address and password match. If they are correct, it redirects the user to their dashboard. If invalid information is entered, it generates and returns an error message.

[0911] Output: Login authentication status, redirect URL or error message

[0912] Step 6:

[0913] Users: After logging in, go to the dashboard and select "Upload AI Model."

[0914] What it does: Operate the dashboard to display the AI ​​model upload form.

[0915] Step 7:

[0916] Device: Enter the required information in the upload form.

[0917] Input: AI model file, description, pricing information

[0918] How it works: Clicking the "Upload" button sends the information to the server.

[0919] Step 8:

[0920] Server: Validates the format of the uploaded AI model file.

[0921] Input: AI model file, description, pricing information

[0922] What it does: Checks whether the file format is valid, generates and returns an error message if it is not valid, saves the file and related information to a database, and lists the AI ​​model on the marketplace.

[0923] Output: File format validation status, list display status

[0924] Step 9:

[0925] User: Another user types a keyword into the Marketplace search bar and clicks the search button.

[0926] Input: Search keyword

[0927] Action: A search request is sent to the server.

[0928] Step 10:

[0929] Server: Searches the database based on the entered keywords.

[0930] Input: Search keyword

[0931] What it does: Creates a list of AI models that match the keywords and returns it to the user.

[0932] Output: Search result list

[0933] Step 11:

[0934] On the device: The user selects an AI model of interest from the displayed list and views detailed information.

[0935] Input: Search result list

[0936] Action: Displays detailed information about each AI model.

[0937] Step 12:

[0938] User: Click the "Purchase" button on the details page of the AI ​​model they want to purchase and enter their payment information.

[0939] Input: Payment information (e.g., credit card information)

[0940] What it does: Sends payment information to the server.

[0941] Step 13:

[0942] Server: Processes payment information.

[0943] Input: Payment Information

[0944] What it does: It connects to a payment service to process payments. If payment is successful, it generates a download link and provides it to the user. It also records the purchase history in a database.

[0945] Output: Payment processing status, download link, purchase history record

[0946] Step 14:

[0947] User: Click the download link to download the purchased AI model.

[0948] Input: Download link

[0949] What happens: The file is saved to the user's local device.

[0950] Output: Download completion status

[0951] (Application example 1)

[0952] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0953] In conventional AI model marketplaces, users often operate them web-based, and there is a lack of convenient systems that can be used with smartphones. This makes it difficult for users to easily upload, search, purchase, and download AI models. Furthermore, there are issues with the reliability and security of transactions. Therefore, there is a need for a reliable AI model trading system that is easy for users to use.

[0954] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0955] In this invention, the server includes means for allowing users to upload their own data and list artificial intelligence models generated based on that data, means for other users to search for and view the listed artificial intelligence models, means for trading artificial intelligence models between users, means for providing a download link after purchasing an artificial intelligence model, and means for uploading, searching, purchasing, and downloading artificial intelligence models from a user interface using a smartphone. This enables users to easily trade artificial intelligence models using their smartphones, realizing a highly reliable trading environment.

[0956] "User" refers to an individual user of the system.

[0957] "Data" refers to information and files uploaded by Users.

[0958] "Artificial intelligence model" refers to a machine learning algorithm or program generated by a user based on data.

[0959] "Listing" refers to creating a list of uploaded AI models so that they can be visually checked.

[0960] "Search" refers to the act of searching for a list of AI models based on specific keywords or criteria.

[0961] "Viewing" refers to the act of checking detailed information about an AI model selected from the search results.

[0962] "Trading" refers to the process of buying and selling artificial intelligence models.

[0963] "Purchase" refers to the act of another user paying a fee to acquire a listed artificial intelligence model.

[0964] "Download Link" refers to a specific URL for a User to download the purchased AI model.

[0965] A "smartphone" is a type of mobile phone that is a multi-function device that can connect to the Internet and use applications.

[0966] "User interface" refers to the screen and operating means that allow the user to directly interact with the system.

[0967] "Payment Information" refers to credit card information or other payment method information required for purchase.

[0968] "Database" refers to a component that systematically stores and manages various data handled by the system.

[0969] MODE FOR CARRYING OUT THE INVENTION

[0970] The present invention provides a system that provides a marketplace where users can buy and sell their own AI models. This system is designed to allow users to easily upload, search, purchase, and download AI models using their smartphones.

[0971] System Program

[0972] This system consists of both a front-end and a back-end. The front-end is mainly a smartphone application, and the back-end consists of a cloud server and database.

[0973] Front-end (smartphone app)

[0974] Framework: Cross-platform development using React Native.

[0975] function:

[0976] User Registration and Login: A user creates an account by entering information such as name, email address, and password, and then verifies the email address to activate the account.

[0977] Dashboard: After logging in, you can upload, search, and purchase AI models from the dashboard.

[0978] Upload form: The user enters the AI ​​model file, description, and pricing information, and clicks the upload button.

[0979] Search bar and results display: Users can search for AI models by entering keywords.

[0980] Purchase page and payment input form: Review the details of the AI ​​model you want to purchase and enter your payment information to complete your purchase.

[0981] Download link displayed: After purchase, the download link will be displayed.

[0982] Backend (server and database)

[0983] Framework: Node.js + Express.

[0984] Database: MongoDB is used for cloud-based, scalable data management.

[0985] function:

[0986] User information storage and authentication: User registration information is stored in a database and a confirmation email is sent.

[0987] Validate and save AI model file format: Validate the uploaded file format and save it to ensure it is in the correct format.

[0988] Processing search queries: Searching the database based on keywords entered by the user and returning results.

[0989] Payment processing: Process the user's payment information using the Stripe API, etc., and generate a download link if successful.

[0990] Download link management: Provide the generated download link to the user and record the purchase history in the database.

[0991] Specific examples

[0992] Below are some specific examples of how the system can be used.

[0993] Example of input prompt for generative AI model

[0994] The following prompts can be used to generate specific use cases for AI models:

[0995] markdown

[0996] This section provides a detailed description of a system that provides a marketplace where users can buy and sell their own artificial intelligence models. Please create a specific usage scenario in which users upload, purchase, and download AI models. Marketplace functionality includes user registration, login, and the ability to search, view, purchase, and download AI models.

[0997] By utilizing this prompt, users can create specific scenarios and demonstrate how other users can obtain AI models.

[0998] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0999] Step 1:

[1000] User Registration and Login

[1001] User: Create a new account by entering your name, email address and password.

[1002] Input: Name, Email Address, Password

[1003] Output: Send account creation confirmation email

[1004] Server: Stores this information in a database and sends a confirmation email to the user.

[1005] How it works: Click the confirmation link in the email to activate your account.

[1006] Step 2:

[1007] Log in

[1008] User: Log in with your email address and password.

[1009] Input: Email address, Password

[1010] Output: Dashboard access rights

[1011] Server: Checks credentials and redirects user to dashboard.

[1012] Behavior: If authentication is successful, the user is able to access the dashboard.

[1013] Step 3:

[1014] Uploading an AI model

[1015] User: Select "Upload AI Model" on the dashboard.

[1016] Input: AI model file, description, pricing information

[1017] Output: Upload completion notification

[1018] Device: Fill in the required information in the input form and click the upload button.

[1019] Server: Validates the file format, ensures it is in the correct format, and saves it to the database.

[1020] How it works: After the file format is validated, the model information will be listed on the Marketplace.

[1021] Step 4:

[1022] Searching for AI models

[1023] User: Enter keywords in the search bar to find AI models that meet your criteria.

[1024] Input: keyword

[1025] Output: A list of search results

[1026] Server: Sends the search query to the database and lists the corresponding AI models.

[1027] Behavior: Returns a list of matching AI models to the user.

[1028] Step 5:

[1029] Viewing AI models

[1030] User: Select an AI model of interest from the search results and view detailed information.

[1031] Input: Select search result

[1032] Output: Detailed information about the AI ​​model

[1033] On your device: View detailed information about the selected AI model.

[1034] What it does: The details page for the AI ​​model selected by the user is displayed.

[1035] Step 6:

[1036] Purchasing AI models

[1037] User: Click the "Purchase" button on the details page of the AI ​​model they want to purchase and enter their payment information.

[1038] Input: Payment Information

[1039] Output: Purchase confirmation and download link

[1040] Server: Processes payment information and generates a download link for the AI ​​model if payment is successful.

[1041] How it works: After the payment is processed, the purchase history is recorded in a database and the user is provided with a download link.

[1042] Step 7:

[1043] Downloading the AI ​​model

[1044] User: Click the download link to download the purchased AI model.

[1045] Input: Click on the download link

[1046] Output: AI model file

[1047] Device: Use the download link to get the AI ​​model.

[1048] Operation: The purchased AI model is downloaded to the user's device.

[1049] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1050] MODE FOR CARRYING OUT THE INVENTION

[1051] The present invention provides a more personalized trading environment by combining a marketplace where users can buy and sell their AI models with an emotion engine that recognizes user emotions. This system includes the following functions:

[1052] User Registration and Login

[1053] 1. Device: The user accesses the marketplace website and enters information such as name, email address, and password on the new registration page.

[1054] 2. Server: The server stores the entered information in a database and sends a confirmation email to the user, who clicks on a link in the email to activate their account.

[1055] 3. Device: Then, log in by entering your email address and password on the login page.

[1056] Uploading and listing AI

[1057] 1. User: After logging in, access the dashboard and select "Upload AI Model."

[1058] 2. Device: Enter the required information in the upload form (AI model file, description, price information, etc.) and click the Upload button.

[1059] 3. Server: The server validates the received AI model file format to ensure it is in the correct format. If there are no problems, it stores the file and related information in a database and lists it on the marketplace.

[1060] Search and browse AI models

[1061] 1. User: Enter keywords in the Marketplace search bar to find AI models that meet your criteria.

[1062] 2. Server: The server searches the database based on the entered keywords and returns a list of matching AI models to the user.

[1063] 3. Device: The user selects an AI model of interest from the displayed list and views detailed information.

[1064] Purchase and Download

[1065] 1. User: Click the "Purchase" button on the details page of the AI ​​model you want to purchase and enter your payment information.

[1066] 2. Server: The server processes the entered payment information, generates a download link if the payment is successful, and records the purchase history in a database.

[1067] 3. User: The user clicks the download link to download the purchased AI model.

[1068] Additional features of the Emotion Engine

[1069] 1. Server: The data uploaded by the user is embedded with an emotion engine that recognizes the user's emotions.

[1070] 2. Server: Based on the recognized emotion, analyze the state, such as "excited" or "anxious."

[1071] 3. Device: Recommends AI models based on the emotional information recognized by the emotion engine. For example, if the user is excited, it will recommend an entertainment-oriented AI model, and if the user is calm, it will recommend an educational AI model.

[1072] 4. Terminal: Dynamically change the interface of the transaction page based on emotional information. For example, if the user is feeling anxious, a more subdued color scheme and fonts can be used to provide a sense of security.

[1073] Specific examples

[1074] Below is a concrete example of incorporating an emotion engine.

[1075] Example 1: User C uploads a facial recognition AI model to the marketplace

[1076] 1. Device: User C logs in to the marketplace and accesses the upload page for the facial recognition AI model.

[1077] 2. Device: Enter the AI ​​model file, a brief description of the model, and the price in the form, then click the "Upload" button.

[1078] 3. Server: The server verifies the format of the received AI model and, if there are no problems, stores it in a database and lists it on the marketplace.

[1079] 4. Server: The emotion engine recognizes User C's emotions from their facial expressions and voice data, and analyzes them as, for example, "excited."

[1080] 5. User D: User D types "face recognition" into the search bar and finds User C's AI model in the search results.

[1081] 6. Server: Recognizes that User D's emotion is "anxiety" and changes the design of the transaction page to a calmer color scheme.

[1082] 7. User D: Completes the purchase process, enters payment information, and clicks the "Purchase" button.

[1083] 8. Server: The payment process is successful and a download link is generated and provided to User D.

[1084] 9. User D: Clicks the download link to get the facial recognition AI model.

[1085] This system can provide a personalized trading environment that responds to users' emotions, improving trading reliability and user experience.

[1086] The processing flow will be explained below.

[1087] User Registration and Login

[1088] Step 1:

[1089] Device: The user visits the marketplace website and clicks the "Sign Up" button.

[1090] Step 2:

[1091] Device: Enter your name, email address, and password in the registration form and click the "Register" button.

[1092] Step 3:

[1093] Server: Receives the form data and searches a database to ensure the entered email address is unique.

[1094] Step 4:

[1095] Server: If the email address is unique, store the entered user information in a database along with the hashed password.

[1096] Step 5:

[1097] Server: Send the user a confirmation email that their registration is complete.

[1098] Step 6:

[1099] Users: Receive a confirmation email and click the link in the email to activate their account.

[1100] Step 7:

[1101] On the device: The user accesses the login page and logs in by entering their email address and password.

[1102] Step 8:

[1103] Server: Validates the login information and, if successful, starts the user session.

[1104] Uploading and listing AI

[1105] Step 1:

[1106] User: After logging in, select "Upload AI Model" from the dashboard.

[1107] Step 2:

[1108] Device: Enter the AI ​​model file, description, and pricing information in the upload form.

[1109] Step 3:

[1110] On the device: Click the upload button to send the form data to the server.

[1111] Step 4:

[1112] Server: Receives the form data and validates the file format for the AI ​​model.

[1113] Step 5:

[1114] Server: If the verification is successful, the AI ​​model file is saved in storage.

[1115] Step 6:

[1116] Server: Stores the AI ​​model metadata (description, category, pricing information, etc.) in a database.

[1117] Step 7:

[1118] Server: Lists the AI ​​model on the marketplace and notifies the user when the upload is complete.

[1119] Search and browse AI models

[1120] Step 1:

[1121] User: Enter keywords into the Marketplace search bar and click the search button.

[1122] Step 2:

[1123] Server: Receives search queries and extracts corresponding AI models from the database.

[1124] Step 3:

[1125] Server: Returns the list of extracted AI models to the user device.

[1126] Step 4:

[1127] Terminal: Shows the user the list of AI models.

[1128] Step 5:

[1129] User: Select the AI ​​model of interest from the displayed list and view its detailed information.

[1130] Purchase and Download

[1131] Step 1:

[1132] User: Click the "Purchase" button on the details page of the AI ​​model you want to purchase.

[1133] Step 2:

[1134] Device: Enter your credit card and payment information into the purchase form.

[1135] Step 3:

[1136] Terminal: Check the input and send.

[1137] Step 4:

[1138] Server: Receives payment information and sends it to the payment gateway to process the payment.

[1139] Step 5:

[1140] Server: If payment is successful, generate the download link.

[1141] Step 6:

[1142] Server: Sends the user a purchase confirmation email and provides a download link.

[1143] Step 7:

[1144] Server: Records purchase history in a database.

[1145] Step 8:

[1146] User: Receives purchase confirmation email and clicks download link to download the AI ​​model.

[1147] Additional features of the Emotion Engine

[1148] Step 1:

[1149] Server: The data uploaded by the user has an emotion engine built in that recognizes the user's emotions.

[1150] Step 2:

[1151] Server: Based on the recognized emotion, analyze the state, such as "excited" or "anxious."

[1152] Step 3:

[1153] Device: Recommends AI models based on the emotional information recognized by the emotion engine. For example, if the user is excited, it will recommend an entertainment-oriented AI model, and if the user is calm, it will recommend an educational AI model.

[1154] Step 4:

[1155] Terminal: Dynamically change the interface of the transaction page based on emotional information. For example, if the user is feeling anxious, a more subdued color scheme and fonts can be used to provide a sense of security.

[1156] Specific examples

[1157] Example 1: User C uploads a facial recognition AI model to the marketplace

[1158] Step 1:

[1159] Device: User C logs in to the marketplace and accesses the upload page for the facial recognition AI model.

[1160] Step 2:

[1161] Device: Enter the AI ​​model file, a brief description of the model, and the price in the form, then click the "Upload" button.

[1162] Step 3:

[1163] Server: The server verifies the format of the received AI model and, if there are no problems, stores it in a database and lists it on the marketplace.

[1164] Step 4:

[1165] Server: The emotion engine recognizes User C's emotions from their facial expressions and voice data, and analyzes them as "excited," for example.

[1166] Step 5:

[1167] User D: User D types "face recognition" into the search bar and finds User C's AI model in the search results.

[1168] Step 6:

[1169] Server: Recognizes that User D's emotion is "anxiety" and changes the design of the trading page to a more subdued color scheme.

[1170] Step 7:

[1171] User D: Completes the checkout process, enters payment information and clicks the "Purchase" button.

[1172] Step 8:

[1173] Server: Payment processing is successful, and a download link is generated and provided to User D.

[1174] Step 9:

[1175] User D: Clicks the download link to get the facial recognition AI model.

[1176] Example 2

[1177] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1178] Conventional AI model marketplaces do not personalize the trading environment according to the user's emotional state, which leads to a problem that the user experience tends to remain at a constant quality.In addition, since recommendations and interface adjustments are not made based on the user's emotional state, it is difficult to optimize trading, and improving user satisfaction has been an issue.

[1179] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for a user to upload his / her own data and list AI models generated based on the data; means for other users to search for and view the listed AI models; means for trading AI models between users; means for providing a download link after purchasing an AI model; means for an emotion analysis engine to recognize the emotional state of the user when uploading an AI model and adjust operation based on the emotional state; means for dynamically changing the AI ​​model recommended to the user based on the emotional state recognized by the emotion analysis engine; and means for dynamically changing the design of the user interface based on the emotional state recognized by the emotion analysis engine. This provides a trading environment personalized according to the user's emotional state, enabling optimization of trading and improved user satisfaction.

[1180] "User" means any person or entity that uses the System to upload, search, purchase, or download AI models.

[1181] "Data" refers to various information uploaded by users, including the AI ​​model itself, descriptions, pricing information, etc.

[1182] An "artificial intelligence model" is a user-created machine learning algorithm or software that operates based on specific data.

[1183] A "marketplace" is an online platform for buying and selling artificial intelligence models generated by multiple users.

[1184] An "emotion analysis engine" is software or hardware that recognizes and analyzes a user's emotional state from facial expressions and voice data.

[1185] "Listing" refers to organizing uploaded AI models and making them available for viewing on the marketplace.

[1186] "Search" refers to the act of finding a specific AI model within the marketplace using keywords and filters.

[1187] "Trading" is the process by which users buy and sell artificial intelligence models.

[1188] A "download link" is a URL or access means for a user to save the AI ​​model they purchased to their device via the Internet.

[1189] "Adjusting behavior" means dynamically changing the system's behavior and recommendations based on the user's emotional state recognized by the emotion analysis engine.

[1190] "Recommendation" is the act of presenting an appropriate artificial intelligence model to a user based on the user's emotional state and past operation history.

[1191] "User interface" refers to the screens and methods of operation that allow a user to interact with a system.

[1192] MODE FOR CARRYING OUT THE INVENTION

[1193] The present invention provides a more personalized trading environment by combining a marketplace where users can buy and sell their artificial intelligence models with an emotion analysis engine that recognizes user emotions. An embodiment of this system is described in detail below.

[1194] System Configuration

[1195] The system includes the following elements:

[1196] 1. Terminal: A device used by a user to access the site, such as a PC, tablet, or smartphone. A web browser runs on the terminal, providing the user interface.

[1197] 2. Server: The core of the system, performing functions such as database management, sentiment analysis, and transaction processing. This includes web servers such as Apache and Nginx, and database servers such as MySQL.

[1198] 3. Sentiment analysis engine: Software for recognizing the user's emotional state. For example, Amazon Rekognition or Microsoft Azure Cognitive Services can be used.

[1199] Key Features

[1200] The system has the following main functions:

[1201] User Registration and Login

[1202] Terminal: The user accesses the marketplace registration page on a web browser and enters the required information.

[1203] Server: Stores the entered information in a database and sends a confirmation email. The user activates their account by clicking the link in the confirmation email and then logs in.

[1204] Uploading and validating the AI ​​model

[1205] User: After logging in, access the dashboard and select "Upload AI model."

[1206] Device: Enter the required information (AI model file, description, price information, etc.) and click the upload button.

[1207] Server: Validates the file format of the received AI model to ensure it is in the correct format. If there are no problems, it is saved in the database and listed on the marketplace.

[1208] Search and browse AI models

[1209] Users: Enter keywords into the Marketplace search bar to find AI models that meet their criteria.

[1210] Server: Queries the database based on the search keywords and returns a list of relevant AI models.

[1211] Terminal: Displays search results and allows users to view detailed information about AI models of interest.

[1212] Purchase and download AI models

[1213] User: Click the "Purchase" button on the details page of the AI ​​model they want to purchase and enter their payment information.

[1214] Server: Processes payment information, generates download links if payment is successful, and records purchase history in a database.

[1215] User: Click the download link to get the AI ​​model.

[1216] Personalization with sentiment analysis

[1217] Server: The emotion analysis engine recognizes the user's emotional state based on facial expressions and voice data. For example, it analyzes states such as "excited" or "anxious."

[1218] Device: Recommend appropriate AI models to users based on their emotional state, for example, entertainment or education models.

[1219] Terminal: Dynamically change the interface design based on emotions, for example by using muted color schemes to improve the user experience.

[1220] Specific examples

[1221] Here are some examples of how sentiment analysis engines can be used:

[1222] Example 1: User A uploads a facial recognition AI model to the marketplace

[1223] Device: User A logs in to the marketplace and accesses the upload page for the facial recognition AI model.

[1224] Device: Enter the AI ​​model file, a brief description, and pricing information into the form and click the "Upload" button.

[1225] Server: Validates the format of the AI ​​model and stores it in the database if there are no problems.

[1226] Server: The emotion analysis engine analyzes User A's emotion and recognizes that he is "excited."

[1227] Example 2: User B searches for a face recognition AI model

[1228] User B: Enters "face recognition" in the search bar and finds User A's model in the search results.

[1229] Server: The emotion analysis engine analyzes User B's emotions and recognizes "anxiety."

[1230] Terminal: The design of the trading page is changed to a more subdued color scheme, providing an environment where User B can trade with peace of mind.

[1231] Prompt Sentence Examples

[1232] Below are some example prompts to input to a generative AI model:

[1233] "Please recommend the best educational AI model for a calm user."

[1234] "Please suggest entertainment AI models to users who are in an excited state."

[1235] "Design a reassuring interface for anxious users."

[1236] The system of the present invention makes it possible to provide a personalized trading environment that corresponds to the user's emotional state, improving the user experience and increasing the reliability of transactions.

[1237] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1238] Step 1:

[1239] User: Visits the marketplace website and enters information such as name, email address, and password on the sign-up page.

[1240] Input: Personal information (name, email address, password)

[1241] Output: Submit the registration form

[1242] Specific actions: The user enters their information and clicks the "Register" button.

[1243] Step 2:

[1244] Server: Stores the entered information in a database and sends a confirmation email to the user.

[1245] Input: Registration form data

[1246] Output: Database record, confirmation email

[1247] What it does: Receives registration information, stores it in a MySQL database, and then sends a confirmation email using an SMTP server.

[1248] Step 3:

[1249] Users: Click the link in the confirmation email to activate their account.

[1250] Input: Link from confirmation email

[1251] Output: Account activation confirmation

[1252] Specific actions: Open the email and click the link to go to the account activation page.

[1253] Step 4:

[1254] User: Log in by entering your email address and password on the login page.

[1255] Input: Email address, Password

[1256] Output: Login request

[1257] Specific action: The user enters their email address and password and clicks the "Login" button.

[1258] Step 5:

[1259] Server: Checks database to see if the entered email address and password are correct. If so, creates a session and redirects to the dashboard.

[1260] Input: Login request data

[1261] Output: Session ID, Dashboard screen display

[1262] What it does: Generates a session ID and stores it as a cookie in the user's browser, then redirects the user to the dashboard.

[1263] Step 6:

[1264] User: Go to the dashboard and select "Upload AI Model."

[1265] Input: User action

[1266] Output: Upload form displayed

[1267] Specific actions: Click the "Upload AI model" link on the dashboard.

[1268] Step 7:

[1269] Device: Enter the required information in the upload form (AI model file, description, price information, etc.) and click the Upload button.

[1270] Input: AI model file, description, price information

[1271] Output: Upload request

[1272] Specific actions: Enter the required information into the form and click the "Upload" button.

[1273] Step 8:

[1274] Server: Validates the file format of the received AI model to ensure it is in the correct format. If there are no problems, it stores it in the database and storage, and lists it on the marketplace.

[1275] Input: Upload request data

[1276] Output: Database records, storage saves, marketplace listings

[1277] Specific behavior: Checks the file format and performs error checking. Passed files are saved to storage and the database. Then, they are added to the marketplace listing.

[1278] Step 9:

[1279] Users: Enter keywords into the Marketplace search bar to find AI models that meet their criteria.

[1280] Input: Search keyword

[1281] Output: Search result list

[1282] Specific actions: Enter keywords in the search bar and click the "Search" button.

[1283] Step 10:

[1284] Server: Searches the database based on the entered keywords and returns a list of matching AI models to the user.

[1285] Input: Search keyword

[1286] Output: Search result data

[1287] What it does: Executes a database query and returns the results in JSON format.

[1288] Step 11:

[1289] On the device: The user selects an AI model of interest from the displayed list and views detailed information.

[1290] Input: Search results

[1291] Output: Detailed information about the AI ​​model

[1292] Specific actions: Click on an AI model from the list to go to its details page.

[1293] Step 12:

[1294] User: Click the "Purchase" button on the details page of the AI ​​model they want to purchase and enter their payment information.

[1295] Input: Payment Information

[1296] Output: Purchase request

[1297] Specific actions: Enter your credit card information on the purchase page and click the "Purchase" button.

[1298] Step 13:

[1299] Server: Processes payment information, generates download links if payment is successful, and records purchase history in a database.

[1300] Input: Purchase request, payment information

[1301] Output: Download links, purchase history

[1302] What it does: Processes the payment through a payment gateway, generates and stores a download link if successful, and records the purchase history in a database.

[1303] Step 14:

[1304] User: Click the download link to download the purchased AI model.

[1305] Input: Download link

[1306] Output: AI model file

[1307] Specific actions: Click the download link and save the file to your device.

[1308] Step 15:

[1309] Server: The emotion analysis engine recognizes the user's emotional state based on facial expressions and voice data.

[1310] Input: facial expression data, voice data

[1311] Output: Emotional state data

[1312] Specific behavior: Analyze facial expressions and voice data and assign emotional status such as "excited" or "anxious."

[1313] Step 16:

[1314] On-device: Recommend appropriate AI models to users based on their emotional state.

[1315] Input: Emotional state data

[1316] Output: Recommended AI model list

[1317] Specific behavior: Display a list of appropriate AI models on the screen depending on the emotional status.

[1318] Step 17:

[1319] Terminal: Dynamically change interface design based on emotions.

[1320] Input: Emotional state data

[1321] Output: A customized user interface

[1322] What it does: Dynamically change the CSS styles of the page to optimize the design depending on the emotional status.

[1323] (Application example 2)

[1324] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1325] Conventional automated driving systems provide a uniform driving pattern without considering the emotional state of the driver, which results in a lack of safety and comfort due to the lack of driving control according to the driver's psychological state. The present invention aims to solve this problem and optimize automated driving according to the driver's emotions.

[1326] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1327] In this invention, the server includes means for allowing users to upload their own data and for listing artificial intelligence models generated based on the data, means for other users to search for and view the listed artificial intelligence models, means for trading artificial intelligence models between users, means for providing a download link after purchasing an artificial intelligence model, means for recognizing the driver's emotions in real time, means for adjusting the automated driving pattern based on the emotions, and means for changing the content of suggestions based on the emotions, thereby enabling optimization of automated driving according to the driver's emotional state.

[1328] "User" means any individual or legal entity that uses the system to upload their own data and generate and trade artificial intelligence models.

[1329] "Data" refers to the information and files that users upload to the system and are the raw material for generating artificial intelligence models.

[1330] An "artificial intelligence model" is a machine learning model or algorithm generated based on user data, and is a program for performing specific tasks.

[1331] "Listing" is the process of displaying uploaded AI models in a list on the system, making them easier for other users to search and view.

[1332] "Search" is the process by which a user finds an AI model of interest using specific keywords or criteria.

[1333] "Viewing" refers to the act of a user checking detailed information about an artificial intelligence model displayed as a search result.

[1334] "Trading" is the process of buying, selling, or exchanging AI models between users.

[1335] "Purchase" refers to the act of another user paying money to acquire a listed artificial intelligence model.

[1336] A "download link" is a URL generated by the server that allows a user to download an AI model to their device after purchase.

[1337] "Emotion recognition" is the process of identifying a driver's emotional state by analyzing their facial expressions and voice.

[1338] "Adjusting automated driving patterns" is the process of changing the driving mode or operation method of the automated driving system based on the driver's emotional state.

[1339] "Change suggestions" means adjusting infotainment content such as music and route guidance based on the driver's emotions.

[1340] This invention relates to a system that controls driving in an autonomous vehicle based on the emotional state of the driver, thereby providing a safe and comfortable driving experience.

[1341] Configuration and Operation

[1342] The system includes a means for recognizing drivers' emotions while driving, a marketplace for trading artificial intelligence models, a means for adjusting autonomous driving patterns based on emotion recognition, and a database for managing user data.

[1343] Hardware and software used

[1344] To realize this system, the following hardware and software are used.

[1345] Hardware: Cameras (for facial recognition), microphones (for voice recognition), and control units installed in autonomous vehicles

[1346] Software: OpenCV (facial expression recognition library), pyAudioAnalysis (audio analysis library), ROS (Robot Operating System), database (MySQL, etc.)

[1347] Program processing

[1348] 1. Emotion recognition:

[1349] The server captures the driver's face with a camera and analyzes his facial expressions using OpenCV.

[1350] Additionally, audio data collected by the microphone is analyzed with pyAudioAnalysis to identify the driver's emotional state (e.g., tension, relaxation, stress).

[1351] 2. Emotion-based autonomous driving control:

[1352] Once emotional information is recognized, the server uses this information to adjust the autonomous driving pattern.

[1353] For example, if the driver is feeling stressed, the vehicle's control unit will reduce the driving speed and switch to a safety-focused driving mode.

[1354] 3. User interface adjustments:

[1355] Based on emotional information, the content and display method of the infotainment system will also change dynamically.

[1356] For example, if the driver is feeling nervous, the system will suggest relaxing music and change the screen color to a calming tone.

[1357] Specific examples and program processing

[1358] As a concrete example, consider a scenario in which a driver is operating an autonomous vehicle. After the driver starts driving, the system monitors the driver's face and voice for signs of tension. If the emotion recognition library analyzes this information and determines that the emotional state is "tension," the vehicle's autonomous driving system switches to "relaxed driving mode."

[1359] At this time, the autonomous driving speed is set to a slightly slower speed, and the infotainment system starts playing relaxing background music and changes the screen color to calming shades of blue and green to reduce the driver's psychological stress.

[1360] Prompt Sentence Examples

[1361] "Design a system for an autonomous vehicle that recognizes the facial expressions and voice of a nervous driver in real time and switches to safe driving mode. Please provide details of the APIs and logic used."

[1362] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1363] Step 1:

[1364] Acquiring emotion data

[1365] Input: Image data of the driver's facial expressions captured by a camera, and audio data of the driver's voice captured by a microphone.

[1366] Specific operation:

[1367] The device uses a camera installed inside the vehicle to capture a photo of the driver's face at regular intervals and records their voice with a microphone.

[1368] The acquired image and audio data is instantly transmitted to the system.

[1369] Output: Collected facial expression image data and audio data.

[1370] Step 2:

[1371] emotion recognition

[1372] Input: Collected facial image data and audio data.

[1373] Specific operation:

[1374] The device uses facial expression recognition software (OpenCV) to analyze facial expression data and infer emotional states.

[1375] The audio data is analyzed using an audio analysis library (pyAudioAnalysis) to estimate the emotional state from the audio.

[1376] Output: The resulting emotional state (e.g., tense, relaxed, stressed).

[1377] Step 3:

[1378] Integration of emotional states

[1379] Input: Facial expression recognition results and voice analysis results.

[1380] Specific operation:

[1381] The server runs an algorithm to determine the overall emotional state based on the results of facial expression analysis and voice analysis.

[1382] Each emotion result is weighted, and the most dominant emotion is determined as the final emotion state.

[1383] Output: Integrated emotional state information.

[1384] Step 4:

[1385] Adjusting autonomous driving patterns

[1386] Input: Integrated emotional state information.

[1387] Specific operation:

[1388] The server generates a command to change the driving pattern based on the emotional state information.

[1389] For example, if a state of tension is detected, a command to switch to "safe driving mode" is issued.

[1390] Output: Command to change driving pattern (e.g. "Safe driving mode").

[1391] Step 5:

[1392] Executing a driving pattern

[1393] Input: Command to change driving pattern.

[1394] Specific operation:

[1395] The autonomous vehicle's control unit automatically adjusts its driving patterns based on the received instructions.

[1396] For example, when switching to "safe driving mode," the speed is set low and careful driving behavior is adopted.

[1397] Output: Actual driving pattern (e.g. slower speed, more cautious operation).

[1398] Step 6:

[1399] Infotainment system adjustments

[1400] Input: Integrated emotional state information.

[1401] Specific operation:

[1402] The server changes the suggestions and display methods of the infotainment system based on the emotional state.

[1403] For example, if you're feeling nervous, it will suggest relaxing music and change the screen color to a calming tone.

[1404] Output: Tailored infotainment content and screen display.

[1405] Step 7:

[1406] User Feedback

[1407] Input: adjusted infotainment content and driving patterns.

[1408] Specific operation:

[1409] The terminal provides real-time feedback to the user.

[1410] If the driver is nervous, a message such as "Switched to relaxation driving mode" will be displayed.

[1411] Output: Notification and feedback display to the user.

[1412] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1413] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1414] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1415] [Third embodiment]

[1416] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1417] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1418] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1419] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1420] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1421] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1422] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1423] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1424] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1425] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1426] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1427] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1428] MODE FOR CARRYING OUT THE INVENTION

[1429] The present invention provides a system for providing a marketplace where users can buy and sell their own artificial intelligence models. This system includes the following functions:

[1430] User Registration and Login

[1431] 1. Device: The user accesses the marketplace website and enters information such as name, email address, and password on the new registration page.

[1432] 2. Server: The server stores the entered information in a database and sends a confirmation email to the user, who clicks on a link in the email to activate their account.

[1433] 3. Device: Then, log in by entering your email address and password on the login page.

[1434] Uploading and listing AI

[1435] 1. User: After logging in, access the dashboard and select "Upload AI Model."

[1436] 2. Device: The user enters the required information in the upload form (AI model file, description, price information, etc.) and clicks the upload button.

[1437] 3. Server: The server validates the received AI model file format to ensure it is in the correct format. If there are no problems, it stores the file and related information in a database and lists it on the marketplace.

[1438] Search and browse AI models

[1439] 1. User: Other users enter keywords into the marketplace search bar to find AI models that meet their criteria.

[1440] 2. Server: The server searches the database based on the entered keywords and returns a list of matching AI models to the user.

[1441] 3. Device: The user selects an AI model of interest from the displayed list and views detailed information.

[1442] Purchase and Download

[1443] 1. User: Click the "Purchase" button on the details page of the AI ​​model you want to purchase and enter your payment information.

[1444] 2. Server: The server processes the entered payment information, generates a download link if the payment is successful, and records the purchase history in a database.

[1445] 3. User: The user clicks the download link to download the purchased AI model.

[1446] Specific examples

[1447] A specific example of this system is shown below.

[1448] Example 1: User A uploads a facial recognition AI model developed as a hobby to the marketplace.

[1449] 1. Device: User A logs in to the marketplace and accesses the upload page for the facial recognition AI model.

[1450] 2. Device: Enter the AI ​​model file, a brief description of the model, and the price in the form, then click the "Upload" button.

[1451] 3. Server: The server verifies the format of the received AI model and, if there are no problems, stores it in a database and lists it on the marketplace.

[1452] 4. User B: User B types "face recognition" into the search bar and finds User A's AI model in the search results.

[1453] 5. User B: Checks the details page, clicks the "Purchase" button, enters payment information, and completes the purchase.

[1454] 6. Server: If the payment is successful, the server generates a download link and provides it to User B.

[1455] 7. User B: Clicks the download link to get the facial recognition AI model.

[1456] This allows User A to sell the AI ​​model he or she developed, and User B to purchase the AI ​​model they need. This system enables efficient and secure trading of AI models between users.

[1457] The processing flow will be explained below.

[1458] User Registration and Login

[1459] Step 1:

[1460] Device: The user visits the marketplace website and clicks the "Sign Up" button.

[1461] Step 2:

[1462] Device: Enter your name, email address, and password in the registration form and click the "Register" button.

[1463] Step 3:

[1464] Server: Receives the form data and searches a database to ensure the entered email address is unique.

[1465] Step 4:

[1466] Server: If the email address is unique, store the entered user information in a database along with the hashed password.

[1467] Step 5:

[1468] Server: Send the user a confirmation email that their registration is complete.

[1469] Step 6:

[1470] Users: Receive a confirmation email and click the link in the email to activate their account.

[1471] Step 7:

[1472] On the device: The user accesses the login page and logs in by entering their email address and password.

[1473] Step 8:

[1474] Server: Validates the login information and, if successful, starts the user session.

[1475] Uploading and listing AI

[1476] Step 1:

[1477] User: After logging in, select "Upload AI Model" from the dashboard.

[1478] Step 2:

[1479] Device: Enter the AI ​​model file, description, and pricing information in the upload form.

[1480] Step 3:

[1481] On the device: Click the upload button to send the form data to the server.

[1482] Step 4:

[1483] Server: Receives the form data and validates the file format for the AI ​​model.

[1484] Step 5:

[1485] Server: If the verification is successful, the AI ​​model file is saved in storage.

[1486] Step 6:

[1487] Server: Stores the AI ​​model metadata (description, category, pricing information, etc.) in a database.

[1488] Step 7:

[1489] Server: Lists the AI ​​model on the marketplace and notifies the user when the upload is complete.

[1490] Search and browse AI models

[1491] Step 1:

[1492] User: Enter keywords into the Marketplace search bar and click the search button.

[1493] Step 2:

[1494] Server: Receives search queries and extracts corresponding AI models from the database.

[1495] Step 3:

[1496] Server: Returns the list of extracted AI models to the user device.

[1497] Step 4:

[1498] Terminal: Shows the user the list of AI models.

[1499] Step 5:

[1500] User: Select the AI ​​model of interest from the displayed list and view its detailed information.

[1501] Purchase and Download

[1502] Step 1:

[1503] User: Click the "Purchase" button on the details page of the AI ​​model you want to purchase.

[1504] Step 2:

[1505] Device: Enter your credit card and payment information into the purchase form.

[1506] Step 3:

[1507] Terminal: Check the input and send.

[1508] Step 4:

[1509] Server: Receives payment information and sends it to the payment gateway to process the payment.

[1510] Step 5:

[1511] Server: If payment is successful, generate the download link.

[1512] Step 6:

[1513] Server: Sends the user a purchase confirmation email and provides a download link.

[1514] Step 7:

[1515] Server: Records purchase history in a database.

[1516] Step 8:

[1517] User: Receives purchase confirmation email and clicks download link to download the AI ​​model.

[1518] This will allow users to trade the AI ​​models they have created on the marketplace.

[1519] Example 1

[1520] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1521] Conventional AI model trading systems face the challenge of requiring users to upload models properly and effectively list, search, purchase, and download them through cumbersome procedures. In particular, complex registration and authentication procedures, as well as insufficient formal model validation and payment processing, detract from the user experience. Another problem is the inability to properly manage purchase history.

[1522] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1523] In this invention, the server includes means for users to upload their own data and list artificial intelligence models generated based on that data, means for other users to search for and view the listed artificial intelligence models, means for users to trade artificial intelligence models, means for providing a download link after purchasing an artificial intelligence model, means for new users to enter personal information, receive a registration confirmation email, and activate their account, means for registered users to complete login authentication and access the dashboard, means for verifying and listing artificial intelligence models after uploading, means for processing payment information after purchase and generating a download link when successful payment is confirmed, and means for recording purchase history in a database. This makes it possible to streamline the entire process from uploading to trading, purchasing, and downloading artificial intelligence models, improving the user experience.

[1524] "User" means an individual or legal entity that uses the system to upload their own data and trade artificial intelligence models.

[1525] A "server" is a computer system that processes requests sent by users and stores, retrieves, and transacts data, generates download links, and so on.

[1526] A "terminal" is a device such as a PC, smartphone, or tablet that a user uses to access the system.

[1527] An "artificial intelligence model" is a program or algorithm generated by a user and uploaded, listed, traded, purchased, or downloaded through the system.

[1528] "Listing" is the process of storing an uploaded AI model in a database within the system, making it available for other users to search and view.

[1529] "Search" is the act of a user entering specific keywords or conditions to find an artificial intelligence model stored within the system.

[1530] "Viewing" refers to the act of displaying detailed information about an artificial intelligence model selected from the search results.

[1531] "Transaction" refers to the act of buying and selling artificial intelligence models between users.

[1532] A "download link" is a URL that allows a user to save the purchased AI model to their own device.

[1533] A "Registration Confirmation Email" is an email containing a confirmation link required by a New User to complete their Account registration.

[1534] "Account Activation" is the process of activating a new user's account on the system by clicking on a link in a confirmation email.

[1535] "Login authentication" is the process by which a user logs in to their account using an email address and password when accessing a system.

[1536] The "dashboard" is the main screen of the system that can be accessed by logged-in users, and is an interface that allows various operations and confirmation of information.

[1537] "Formal verification" is the process of verifying that the file format of an uploaded artificial intelligence model meets the standards required by the system.

[1538] "Payment Information" is data relating to a payment method, such as credit card information, that a user provides to complete a transaction.

[1539] "Payment processing" is the process of charging the transaction amount based on the payment information entered by the user and confirming whether the payment was successful.

[1540] "Purchase history" is data that records transaction information for AI models that a user has purchased in the past.

[1541] MODE FOR CARRYING OUT THE INVENTION

[1542] The present invention is a system that provides a marketplace where users can buy and sell their own generative AI models. This system includes various functions to efficiently perform a series of processes, such as user registration, login, uploading, listing, searching, viewing, trading, purchasing, and downloading AI models.

[1543] First, users access the system through devices such as PCs, smartphones, and tablets. The system is used through a web browser, and users operate the website's UI. The server processes these requests, storing, searching, and trading the necessary data, generating download links, and so on.

[1544] User Registration and Login

[1545] User Registration

[1546] 1. On the device: The user opens the marketplace website and accesses the sign-up page. The user enters their name, email address, and password.

[1547] 2. Server: The server receives the entered information, stores it in a database, and then sends the user a confirmation email containing a link to activate their account.

[1548] 3. On the device: The user clicks on the link in the confirmation email and the account is activated.

[1549] User Login

[1550] 1. Device: The user accesses the login page, enters their email address and password, and clicks the "Login" button.

[1551] 2. Server: The server validates the entered information and redirects the user to their dashboard if it is correct, or returns an error message if invalid information is entered.

[1552] Uploading and listing AI

[1553] Uploading an AI model

[1554] 1. User: After logging in, the user accesses the dashboard and selects "Upload AI model."

[1555] 2. On the device: An upload form will appear, and the user will enter the AI ​​model file, description, and pricing information, then click the "Upload" button.

[1556] 3. Server: The server checks the format of the uploaded AI model file. If the format is incorrect, it returns an error message to the user. If the format is correct, it stores the file and related information in a database and lists the AI ​​model on the marketplace.

[1557] Search and browse AI models

[1558] AI Model Search

[1559] 1. User: Another user enters a specific keyword (e.g., "facial recognition") into the Marketplace search bar and clicks the search button.

[1560] 2. Server: The server searches the database based on the entered keywords, creates a list of relevant AI models, and returns it.

[1561] 3. Device: The user's device will display a list of applicable AI models, and they can click on links to view more information about each model.

[1562] Purchase and Download

[1563] AI model purchase

[1564] 1. User: Click the "Purchase" button on the details page of the AI ​​model you want to purchase and enter your payment information.

[1565] 2. Server: The server processes the entered payment information, generates a download link and provides it to the user if the payment is successful, and records the purchase history in a database.

[1566] AI model download

[1567] 1. User: Click the download link to download the purchased AI model. The file will be saved to your local device.

[1568] Specific examples

[1569] Example: Steps for User A to upload a facial recognition AI model

[1570] 1. Device: User A logs in to the marketplace website and goes to the dashboard.

[1571] 2. On your device: Go to the "Upload AI Model" page, enter the AI ​​model file (Facial Recognition Model.zip), a description of the model ("This model is specialized for facial recognition"), and a price ($100), then click the "Upload" button.

[1572] 3. Server: The server checks the file format, for example to make sure it's in zip format. It then saves the file, description, and pricing information to a database, lists it on the marketplace, and sends a success message back to User A.

[1573] Example: User B's procedure for purchasing an AI model

[1574] 1. User B: Enter "face recognition" in the search bar and click the search button.

[1575] 2. Server: The server lists the relevant AI models (including User A's model) and returns them to User B.

[1576] 3. Device: User B selects User A's model from the list and checks the details page.

[1577] 4. User B: Clicks the "Purchase" button and enters payment information. For example, enters credit card information and clicks the "Pay" button.

[1578] 5. Server: Once payment is successful, generate a download link and provide it to User B. Also record the purchase history in the database.

[1579] 6. User B: Clicks the download link to download the purchased facial recognition AI model and save it to their local device.

[1580] Prompt Sentence Examples

[1581] By entering the prompt "What are the steps to upload a new AI model to the marketplace?", User A can obtain specific instructions on how to upload and list their facial recognition AI model.

[1582] This makes the system's usage and flow clearer, allowing users to effectively contribute their AI models to the marketplace.

[1583] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1584] Step 1:

[1585] User: A user opens your marketplace website and visits the sign-up page.

[1586] Input: Name, Email Address, Password

[1587] What happens: The user enters this information and clicks the "Register" button.

[1588] Step 2:

[1589] Server: The server receives the entered information and stores it in a database.

[1590] Input: Name, Email Address, Password

[1591] What it does: Checks that the input data is in the correct format, and if so, saves it to the database. It then generates a confirmation email and sends it to the user.

[1592] Output: Confirmation email sending status

[1593] Step 3:

[1594] Device: User clicks on the link in the confirmation email.

[1595] Input: Link in confirmation email

[1596] What it does: When you click the link, a request is sent to the server to access the account and activate it.

[1597] Output: Account activation status

[1598] Step 4:

[1599] Device: The user visits the login page, enters their email address and password, and clicks the "Login" button.

[1600] Input: Email address, Password

[1601] Action: A login request is sent to the server.

[1602] Step 5:

[1603] Server: The server validates the information entered.

[1604] Input: Email address, Password

[1605] What it does: Looks up the database and verifies that the email address and password match. If they are correct, it redirects the user to their dashboard. If invalid information is entered, it generates and returns an error message.

[1606] Output: Login authentication status, redirect URL or error message

[1607] Step 6:

[1608] Users: After logging in, go to the dashboard and select "Upload AI Model."

[1609] What it does: Operate the dashboard to display the AI ​​model upload form.

[1610] Step 7:

[1611] Device: Enter the required information in the upload form.

[1612] Input: AI model file, description, pricing information

[1613] How it works: Clicking the "Upload" button sends the information to the server.

[1614] Step 8:

[1615] Server: Validates the format of the uploaded AI model file.

[1616] Input: AI model file, description, pricing information

[1617] What it does: Checks whether the file format is valid, generates and returns an error message if it is not valid, saves the file and related information to a database, and lists the AI ​​model on the marketplace.

[1618] Output: File format validation status, list display status

[1619] Step 9:

[1620] User: Another user types a keyword into the Marketplace search bar and clicks the search button.

[1621] Input: Search keyword

[1622] Action: A search request is sent to the server.

[1623] Step 10:

[1624] Server: Searches the database based on the entered keywords.

[1625] Input: Search keyword

[1626] What it does: Creates a list of AI models that match the keywords and returns it to the user.

[1627] Output: Search result list

[1628] Step 11:

[1629] On the device: The user selects an AI model of interest from the displayed list and views detailed information.

[1630] Input: Search result list

[1631] Action: Displays detailed information about each AI model.

[1632] Step 12:

[1633] User: Click the "Purchase" button on the details page of the AI ​​model they want to purchase and enter their payment information.

[1634] Input: Payment information (e.g., credit card information)

[1635] What it does: Sends payment information to the server.

[1636] Step 13:

[1637] Server: Processes payment information.

[1638] Input: Payment Information

[1639] What it does: It connects to a payment service to process payments. If payment is successful, it generates a download link and provides it to the user. It also records the purchase history in a database.

[1640] Output: Payment processing status, download link, purchase history record

[1641] Step 14:

[1642] User: Click the download link to download the purchased AI model.

[1643] Input: Download link

[1644] What happens: The file is saved to the user's local device.

[1645] Output: Download completion status

[1646] (Application example 1)

[1647] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1648] In conventional AI model marketplaces, users often operate them web-based, and there is a lack of convenient systems that can be used with smartphones. This makes it difficult for users to easily upload, search, purchase, and download AI models. Furthermore, there are issues with the reliability and security of transactions. Therefore, there is a need for a reliable AI model trading system that is easy for users to use.

[1649] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1650] In this invention, the server includes means for allowing users to upload their own data and list artificial intelligence models generated based on that data, means for other users to search for and view the listed artificial intelligence models, means for trading artificial intelligence models between users, means for providing a download link after purchasing an artificial intelligence model, and means for uploading, searching, purchasing, and downloading artificial intelligence models from a user interface using a smartphone. This enables users to easily trade artificial intelligence models using their smartphones, realizing a highly reliable trading environment.

[1651] "User" refers to an individual user of the system.

[1652] "Data" refers to information and files uploaded by Users.

[1653] "Artificial intelligence model" refers to a machine learning algorithm or program generated by a user based on data.

[1654] "Listing" refers to creating a list of uploaded AI models so that they can be visually checked.

[1655] "Search" refers to the act of searching for a list of AI models based on specific keywords or criteria.

[1656] "Viewing" refers to the act of checking detailed information about an AI model selected from the search results.

[1657] "Trading" refers to the process of buying and selling artificial intelligence models.

[1658] "Purchase" refers to the act of another user paying a fee to acquire a listed artificial intelligence model.

[1659] "Download Link" refers to a specific URL for a User to download the purchased AI model.

[1660] A "smartphone" is a type of mobile phone that is a multi-function device that can connect to the Internet and use applications.

[1661] "User interface" refers to the screen and operating means that allow the user to directly interact with the system.

[1662] "Payment Information" refers to credit card information or other payment method information required for purchase.

[1663] "Database" refers to a component that systematically stores and manages various data handled by the system.

[1664] MODE FOR CARRYING OUT THE INVENTION

[1665] The present invention provides a system that provides a marketplace where users can buy and sell their own AI models. This system is designed to allow users to easily upload, search, purchase, and download AI models using their smartphones.

[1666] System Program

[1667] This system consists of both a front-end and a back-end. The front-end is mainly a smartphone application, and the back-end consists of a cloud server and database.

[1668] Front-end (smartphone app)

[1669] Framework: Cross-platform development using React Native.

[1670] function:

[1671] User Registration and Login: A user creates an account by entering information such as name, email address, and password, and then verifies the email address to activate the account.

[1672] Dashboard: After logging in, you can upload, search, and purchase AI models from the dashboard.

[1673] Upload form: The user enters the AI ​​model file, description, and pricing information, and clicks the upload button.

[1674] Search bar and results display: Users can search for AI models by entering keywords.

[1675] Purchase page and payment input form: Review the details of the AI ​​model you want to purchase and enter your payment information to complete your purchase.

[1676] Download link displayed: After purchase, the download link will be displayed.

[1677] Backend (server and database)

[1678] Framework: Node.js + Express.

[1679] Database: MongoDB is used for cloud-based, scalable data management.

[1680] function:

[1681] User information storage and authentication: User registration information is stored in a database and a confirmation email is sent.

[1682] Validate and save AI model file format: Validate the uploaded file format and save it to ensure it is in the correct format.

[1683] Processing search queries: Searching the database based on keywords entered by the user and returning results.

[1684] Payment processing: Process the user's payment information using the Stripe API, etc., and generate a download link if successful.

[1685] Download link management: Provide the generated download link to the user and record the purchase history in the database.

[1686] Specific examples

[1687] Below are some specific examples of how the system can be used.

[1688] Example of input prompt for generative AI model

[1689] The following prompts can be used to generate specific use cases for AI models:

[1690] markdown

[1691] This section provides a detailed description of a system that provides a marketplace where users can buy and sell their own artificial intelligence models. Please create a specific usage scenario in which users upload, purchase, and download AI models. Marketplace functionality includes user registration, login, and the ability to search, view, purchase, and download AI models.

[1692] By utilizing this prompt, users can create specific scenarios and demonstrate how other users can obtain AI models.

[1693] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1694] Step 1:

[1695] User Registration and Login

[1696] User: Create a new account by entering your name, email address and password.

[1697] Input: Name, Email Address, Password

[1698] Output: Send account creation confirmation email

[1699] Server: Stores this information in a database and sends a confirmation email to the user.

[1700] How it works: Click the confirmation link in the email to activate your account.

[1701] Step 2:

[1702] Log in

[1703] User: Log in with your email address and password.

[1704] Input: Email address, Password

[1705] Output: Dashboard access rights

[1706] Server: Checks credentials and redirects user to dashboard.

[1707] Behavior: If authentication is successful, the user is able to access the dashboard.

[1708] Step 3:

[1709] Uploading an AI model

[1710] User: Select "Upload AI Model" on the dashboard.

[1711] Input: AI model file, description, pricing information

[1712] Output: Upload completion notification

[1713] Device: Fill in the required information in the input form and click the upload button.

[1714] Server: Validates the file format, ensures it is in the correct format, and saves it to the database.

[1715] How it works: After the file format is validated, the model information will be listed on the Marketplace.

[1716] Step 4:

[1717] Searching for AI models

[1718] User: Enter keywords in the search bar to find AI models that meet your criteria.

[1719] Input: keyword

[1720] Output: A list of search results

[1721] Server: Sends the search query to the database and lists the corresponding AI models.

[1722] Behavior: Returns a list of matching AI models to the user.

[1723] Step 5:

[1724] Viewing AI models

[1725] User: Select an AI model of interest from the search results and view detailed information.

[1726] Input: Select search result

[1727] Output: Detailed information about the AI ​​model

[1728] On your device: View detailed information about the selected AI model.

[1729] What it does: The details page for the AI ​​model selected by the user is displayed.

[1730] Step 6:

[1731] Purchasing AI models

[1732] User: Click the "Purchase" button on the details page of the AI ​​model they want to purchase and enter their payment information.

[1733] Input: Payment Information

[1734] Output: Purchase confirmation and download link

[1735] Server: Processes payment information and generates a download link for the AI ​​model if payment is successful.

[1736] How it works: After the payment is processed, the purchase history is recorded in a database and the user is provided with a download link.

[1737] Step 7:

[1738] Downloading the AI ​​model

[1739] User: Click the download link to download the purchased AI model.

[1740] Input: Click on the download link

[1741] Output: AI model file

[1742] Device: Use the download link to get the AI ​​model.

[1743] Operation: The purchased AI model is downloaded to the user's device.

[1744] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1745] MODE FOR CARRYING OUT THE INVENTION

[1746] The present invention provides a more personalized trading environment by combining a marketplace where users can buy and sell their AI models with an emotion engine that recognizes user emotions. This system includes the following functions:

[1747] User Registration and Login

[1748] 1. Device: The user accesses the marketplace website and enters information such as name, email address, and password on the new registration page.

[1749] 2. Server: The server stores the entered information in a database and sends a confirmation email to the user, who clicks on a link in the email to activate their account.

[1750] 3. Device: Then, log in by entering your email address and password on the login page.

[1751] Uploading and listing AI

[1752] 1. User: After logging in, access the dashboard and select "Upload AI Model."

[1753] 2. Device: Enter the required information in the upload form (AI model file, description, price information, etc.) and click the Upload button.

[1754] 3. Server: The server validates the received AI model file format to ensure it is in the correct format. If there are no problems, it stores the file and related information in a database and lists it on the marketplace.

[1755] Search and browse AI models

[1756] 1. User: Enter keywords in the Marketplace search bar to find AI models that meet your criteria.

[1757] 2. Server: The server searches the database based on the entered keywords and returns a list of matching AI models to the user.

[1758] 3. Device: The user selects an AI model of interest from the displayed list and views detailed information.

[1759] Purchase and Download

[1760] 1. User: Click the "Purchase" button on the details page of the AI ​​model you want to purchase and enter your payment information.

[1761] 2. Server: The server processes the entered payment information, generates a download link if the payment is successful, and records the purchase history in a database.

[1762] 3. User: The user clicks the download link to download the purchased AI model.

[1763] Additional features of the Emotion Engine

[1764] 1. Server: The data uploaded by the user is embedded with an emotion engine that recognizes the user's emotions.

[1765] 2. Server: Based on the recognized emotion, analyze the state, such as "excited" or "anxious."

[1766] 3. Device: Recommends AI models based on the emotional information recognized by the emotion engine. For example, if the user is excited, it will recommend an entertainment-oriented AI model, and if the user is calm, it will recommend an educational AI model.

[1767] 4. Terminal: Dynamically change the interface of the transaction page based on emotional information. For example, if the user is feeling anxious, a more subdued color scheme and fonts can be used to provide a sense of security.

[1768] Specific examples

[1769] Below is a concrete example of incorporating an emotion engine.

[1770] Example 1: User C uploads a facial recognition AI model to the marketplace

[1771] 1. Device: User C logs in to the marketplace and accesses the upload page for the facial recognition AI model.

[1772] 2. Device: Enter the AI ​​model file, a brief description of the model, and the price in the form, then click the "Upload" button.

[1773] 3. Server: The server verifies the format of the received AI model and, if there are no problems, stores it in a database and lists it on the marketplace.

[1774] 4. Server: The emotion engine recognizes User C's emotions from their facial expressions and voice data, and analyzes them as, for example, "excited."

[1775] 5. User D: User D types "face recognition" into the search bar and finds User C's AI model in the search results.

[1776] 6. Server: Recognizes that User D's emotion is "anxiety" and changes the design of the transaction page to a calmer color scheme.

[1777] 7. User D: Completes the purchase process, enters payment information, and clicks the "Purchase" button.

[1778] 8. Server: The payment process is successful and a download link is generated and provided to User D.

[1779] 9. User D: Clicks the download link to get the facial recognition AI model.

[1780] This system can provide a personalized trading environment that responds to users' emotions, improving trading reliability and user experience.

[1781] The processing flow will be explained below.

[1782] User Registration and Login

[1783] Step 1:

[1784] Device: The user visits the marketplace website and clicks the "Sign Up" button.

[1785] Step 2:

[1786] Device: Enter your name, email address, and password in the registration form and click the "Register" button.

[1787] Step 3:

[1788] Server: Receives the form data and searches a database to ensure the entered email address is unique.

[1789] Step 4:

[1790] Server: If the email address is unique, store the entered user information in a database along with the hashed password.

[1791] Step 5:

[1792] Server: Send the user a confirmation email that their registration is complete.

[1793] Step 6:

[1794] Users: Receive a confirmation email and click the link in the email to activate their account.

[1795] Step 7:

[1796] On the device: The user accesses the login page and logs in by entering their email address and password.

[1797] Step 8:

[1798] Server: Validates the login information and, if successful, starts the user session.

[1799] Uploading and listing AI

[1800] Step 1:

[1801] User: After logging in, select "Upload AI Model" from the dashboard.

[1802] Step 2:

[1803] Device: Enter the AI ​​model file, description, and pricing information in the upload form.

[1804] Step 3:

[1805] On the device: Click the upload button to send the form data to the server.

[1806] Step 4:

[1807] Server: Receives the form data and validates the file format for the AI ​​model.

[1808] Step 5:

[1809] Server: If the verification is successful, the AI ​​model file is saved in storage.

[1810] Step 6:

[1811] Server: Stores the AI ​​model metadata (description, category, pricing information, etc.) in a database.

[1812] Step 7:

[1813] Server: Lists the AI ​​model on the marketplace and notifies the user when the upload is complete.

[1814] Search and browse AI models

[1815] Step 1:

[1816] User: Enter keywords into the Marketplace search bar and click the search button.

[1817] Step 2:

[1818] Server: Receives search queries and extracts corresponding AI models from the database.

[1819] Step 3:

[1820] Server: Returns the list of extracted AI models to the user device.

[1821] Step 4:

[1822] Terminal: Shows the user the list of AI models.

[1823] Step 5:

[1824] User: Select the AI ​​model of interest from the displayed list and view its detailed information.

[1825] Purchase and Download

[1826] Step 1:

[1827] User: Click the "Purchase" button on the details page of the AI ​​model you want to purchase.

[1828] Step 2:

[1829] Device: Enter your credit card and payment information into the purchase form.

[1830] Step 3:

[1831] Terminal: Check the input and send.

[1832] Step 4:

[1833] Server: Receives payment information and sends it to the payment gateway to process the payment.

[1834] Step 5:

[1835] Server: If payment is successful, generate the download link.

[1836] Step 6:

[1837] Server: Sends the user a purchase confirmation email and provides a download link.

[1838] Step 7:

[1839] Server: Records purchase history in a database.

[1840] Step 8:

[1841] User: Receives purchase confirmation email and clicks download link to download the AI ​​model.

[1842] Additional features of the Emotion Engine

[1843] Step 1:

[1844] Server: The data uploaded by the user has an emotion engine built in that recognizes the user's emotions.

[1845] Step 2:

[1846] Server: Based on the recognized emotion, analyze the state, such as "excited" or "anxious."

[1847] Step 3:

[1848] Device: Recommends AI models based on the emotional information recognized by the emotion engine. For example, if the user is excited, it will recommend an entertainment-oriented AI model, and if the user is calm, it will recommend an educational AI model.

[1849] Step 4:

[1850] Terminal: Dynamically change the interface of the transaction page based on emotional information. For example, if the user is feeling anxious, a more subdued color scheme and fonts can be used to provide a sense of security.

[1851] Specific examples

[1852] Example 1: User C uploads a facial recognition AI model to the marketplace

[1853] Step 1:

[1854] Device: User C logs in to the marketplace and accesses the upload page for the facial recognition AI model.

[1855] Step 2:

[1856] Device: Enter the AI ​​model file, a brief description of the model, and the price in the form, then click the "Upload" button.

[1857] Step 3:

[1858] Server: The server verifies the format of the received AI model and, if there are no problems, stores it in a database and lists it on the marketplace.

[1859] Step 4:

[1860] Server: The emotion engine recognizes User C's emotions from their facial expressions and voice data, and analyzes them as "excited," for example.

[1861] Step 5:

[1862] User D: User D types "face recognition" into the search bar and finds User C's AI model in the search results.

[1863] Step 6:

[1864] Server: Recognizes that User D's emotion is "anxiety" and changes the design of the trading page to a more subdued color scheme.

[1865] Step 7:

[1866] User D: Completes the checkout process, enters payment information and clicks the "Purchase" button.

[1867] Step 8:

[1868] Server: Payment processing is successful, and a download link is generated and provided to User D.

[1869] Step 9:

[1870] User D: Clicks the download link to get the facial recognition AI model.

[1871] Example 2

[1872] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1873] Conventional AI model marketplaces do not personalize the trading environment according to the user's emotional state, which leads to a problem that the user experience tends to remain at a constant quality.In addition, since recommendations and interface adjustments are not made based on the user's emotional state, it is difficult to optimize trading, and improving user satisfaction has been an issue.

[1874] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for a user to upload his / her own data and list AI models generated based on the data; means for other users to search for and view the listed AI models; means for trading AI models between users; means for providing a download link after purchasing an AI model; means for an emotion analysis engine to recognize the emotional state of the user when uploading an AI model and adjust operation based on the emotional state; means for dynamically changing the AI ​​model recommended to the user based on the emotional state recognized by the emotion analysis engine; and means for dynamically changing the design of the user interface based on the emotional state recognized by the emotion analysis engine. This provides a trading environment personalized according to the user's emotional state, enabling optimization of trading and improved user satisfaction.

[1875] "User" means any person or entity that uses the System to upload, search, purchase, or download AI models.

[1876] "Data" refers to various information uploaded by users, including the AI ​​model itself, descriptions, pricing information, etc.

[1877] An "artificial intelligence model" is a user-created machine learning algorithm or software that operates based on specific data.

[1878] A "marketplace" is an online platform for buying and selling artificial intelligence models generated by multiple users.

[1879] An "emotion analysis engine" is software or hardware that recognizes and analyzes a user's emotional state from facial expressions and voice data.

[1880] "Listing" refers to organizing uploaded AI models and making them available for viewing on the marketplace.

[1881] "Search" refers to the act of finding a specific AI model within the marketplace using keywords and filters.

[1882] "Trading" is the process by which users buy and sell artificial intelligence models.

[1883] A "download link" is a URL or access means for a user to save the AI ​​model they purchased to their device via the Internet.

[1884] "Adjusting behavior" means dynamically changing the system's behavior and recommendations based on the user's emotional state recognized by the emotion analysis engine.

[1885] "Recommendation" is the act of presenting an appropriate artificial intelligence model to a user based on the user's emotional state and past operation history.

[1886] "User interface" refers to the screens and methods of operation that allow a user to interact with a system.

[1887] MODE FOR CARRYING OUT THE INVENTION

[1888] The present invention provides a more personalized trading environment by combining a marketplace where users can buy and sell their artificial intelligence models with an emotion analysis engine that recognizes user emotions. An embodiment of this system is described in detail below.

[1889] System Configuration

[1890] The system includes the following elements:

[1891] 1. Terminal: A device used by a user to access the site, such as a PC, tablet, or smartphone. A web browser runs on the terminal, providing the user interface.

[1892] 2. Server: The core of the system, performing functions such as database management, sentiment analysis, and transaction processing. This includes web servers such as Apache and Nginx, and database servers such as MySQL.

[1893] 3. Sentiment analysis engine: Software for recognizing the user's emotional state. For example, Amazon Rekognition or Microsoft Azure Cognitive Services can be used.

[1894] Key Features

[1895] The system has the following main functions:

[1896] User Registration and Login

[1897] Terminal: The user accesses the marketplace registration page on a web browser and enters the required information.

[1898] Server: Stores the entered information in a database and sends a confirmation email. The user activates their account by clicking the link in the confirmation email and then logs in.

[1899] Uploading and validating the AI ​​model

[1900] User: After logging in, access the dashboard and select "Upload AI model."

[1901] Device: Enter the required information (AI model file, description, price information, etc.) and click the upload button.

[1902] Server: Validates the file format of the received AI model to ensure it is in the correct format. If there are no problems, it is saved in the database and listed on the marketplace.

[1903] Search and browse AI models

[1904] Users: Enter keywords into the Marketplace search bar to find AI models that meet their criteria.

[1905] Server: Queries the database based on the search keywords and returns a list of relevant AI models.

[1906] Terminal: Displays search results and allows users to view detailed information about AI models of interest.

[1907] Purchase and download AI models

[1908] User: Click the "Purchase" button on the details page of the AI ​​model they want to purchase and enter their payment information.

[1909] Server: Processes payment information, generates download links if payment is successful, and records purchase history in a database.

[1910] User: Click the download link to get the AI ​​model.

[1911] Personalization with sentiment analysis

[1912] Server: The emotion analysis engine recognizes the user's emotional state based on facial expressions and voice data. For example, it analyzes states such as "excited" or "anxious."

[1913] Device: Recommend appropriate AI models to users based on their emotional state, for example, entertainment or education models.

[1914] Terminal: Dynamically change the interface design based on emotions, for example by using muted color schemes to improve the user experience.

[1915] Specific examples

[1916] Here are some examples of how sentiment analysis engines can be used:

[1917] Example 1: User A uploads a facial recognition AI model to the marketplace

[1918] Device: User A logs in to the marketplace and accesses the upload page for the facial recognition AI model.

[1919] Device: Enter the AI ​​model file, a brief description, and pricing information into the form and click the "Upload" button.

[1920] Server: Validates the format of the AI ​​model and stores it in the database if there are no problems.

[1921] Server: The emotion analysis engine analyzes User A's emotion and recognizes that he is "excited."

[1922] Example 2: User B searches for a face recognition AI model

[1923] User B: Enters "face recognition" in the search bar and finds User A's model in the search results.

[1924] Server: The emotion analysis engine analyzes User B's emotions and recognizes "anxiety."

[1925] Terminal: The design of the trading page is changed to a more subdued color scheme, providing an environment where User B can trade with peace of mind.

[1926] Prompt Sentence Examples

[1927] Below are some example prompts to input to a generative AI model:

[1928] "Please recommend the best educational AI model for a calm user."

[1929] "Please suggest entertainment AI models to users who are in an excited state."

[1930] "Design a reassuring interface for anxious users."

[1931] The system of the present invention makes it possible to provide a personalized trading environment that corresponds to the user's emotional state, improving the user experience and increasing the reliability of transactions.

[1932] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1933] Step 1:

[1934] User: Visits the marketplace website and enters information such as name, email address, and password on the sign-up page.

[1935] Input: Personal information (name, email address, password)

[1936] Output: Submit the registration form

[1937] Specific actions: The user enters their information and clicks the "Register" button.

[1938] Step 2:

[1939] Server: Stores the entered information in a database and sends a confirmation email to the user.

[1940] Input: Registration form data

[1941] Output: Database record, confirmation email

[1942] What it does: Receives registration information, stores it in a MySQL database, and then sends a confirmation email using an SMTP server.

[1943] Step 3:

[1944] Users: Click the link in the confirmation email to activate their account.

[1945] Input: Link from confirmation email

[1946] Output: Account activation confirmation

[1947] Specific actions: Open the email and click the link to go to the account activation page.

[1948] Step 4:

[1949] User: Log in by entering your email address and password on the login page.

[1950] Input: Email address, Password

[1951] Output: Login request

[1952] Specific action: The user enters their email address and password and clicks the "Login" button.

[1953] Step 5:

[1954] Server: Checks database to see if the entered email address and password are correct. If so, creates a session and redirects to the dashboard.

[1955] Input: Login request data

[1956] Output: Session ID, Dashboard screen display

[1957] What it does: Generates a session ID and stores it as a cookie in the user's browser, then redirects the user to the dashboard.

[1958] Step 6:

[1959] User: Go to the dashboard and select "Upload AI Model."

[1960] Input: User action

[1961] Output: Upload form displayed

[1962] Specific actions: Click the "Upload AI model" link on the dashboard.

[1963] Step 7:

[1964] Device: Enter the required information in the upload form (AI model file, description, price information, etc.) and click the Upload button.

[1965] Input: AI model file, description, price information

[1966] Output: Upload request

[1967] Specific actions: Enter the required information into the form and click the "Upload" button.

[1968] Step 8:

[1969] Server: Validates the file format of the received AI model to ensure it is in the correct format. If there are no problems, it stores it in the database and storage, and lists it on the marketplace.

[1970] Input: Upload request data

[1971] Output: Database records, storage saves, marketplace listings

[1972] Specific behavior: Checks the file format and performs error checking. Passed files are saved to storage and the database. Then, they are added to the marketplace listing.

[1973] Step 9:

[1974] Users: Enter keywords into the Marketplace search bar to find AI models that meet their criteria.

[1975] Input: Search keyword

[1976] Output: Search result list

[1977] Specific actions: Enter keywords in the search bar and click the "Search" button.

[1978] Step 10:

[1979] Server: Searches the database based on the entered keywords and returns a list of matching AI models to the user.

[1980] Input: Search keyword

[1981] Output: Search result data

[1982] What it does: Executes a database query and returns the results in JSON format.

[1983] Step 11:

[1984] On the device: The user selects an AI model of interest from the displayed list and views detailed information.

[1985] Input: Search results

[1986] Output: Detailed information about the AI ​​model

[1987] Specific actions: Click on an AI model from the list to go to its details page.

[1988] Step 12:

[1989] User: Click the "Purchase" button on the details page of the AI ​​model they want to purchase and enter their payment information.

[1990] Input: Payment Information

[1991] Output: Purchase request

[1992] Specific actions: Enter your credit card information on the purchase page and click the "Purchase" button.

[1993] Step 13:

[1994] Server: Processes payment information, generates download links if payment is successful, and records purchase history in a database.

[1995] Input: Purchase request, payment information

[1996] Output: Download links, purchase history

[1997] What it does: Processes the payment through a payment gateway, generates and stores a download link if successful, and records the purchase history in a database.

[1998] Step 14:

[1999] User: Click the download link to download the purchased AI model.

[2000] Input: Download link

[2001] Output: AI model file

[2002] Specific actions: Click the download link and save the file to your device.

[2003] Step 15:

[2004] Server: The emotion analysis engine recognizes the user's emotional state based on facial expressions and voice data.

[2005] Input: facial expression data, voice data

[2006] Output: Emotional state data

[2007] Specific behavior: Analyze facial expressions and voice data and assign emotional status such as "excited" or "anxious."

[2008] Step 16:

[2009] On-device: Recommend appropriate AI models to users based on their emotional state.

[2010] Input: Emotional state data

[2011] Output: Recommended AI model list

[2012] Specific behavior: Display a list of appropriate AI models on the screen depending on the emotional status.

[2013] Step 17:

[2014] Terminal: Dynamically change interface design based on emotions.

[2015] Input: Emotional state data

[2016] Output: A customized user interface

[2017] What it does: Dynamically change the CSS styles of the page to optimize the design depending on the emotional status.

[2018] (Application example 2)

[2019] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2020] Conventional automated driving systems provide a uniform driving pattern without considering the emotional state of the driver, which results in a lack of safety and comfort due to the lack of driving control according to the driver's psychological state. The present invention aims to solve this problem and optimize automated driving according to the driver's emotions.

[2021] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2022] In this invention, the server includes means for allowing users to upload their own data and for listing artificial intelligence models generated based on the data, means for other users to search for and view the listed artificial intelligence models, means for trading artificial intelligence models between users, means for providing a download link after purchasing an artificial intelligence model, means for recognizing the driver's emotions in real time, means for adjusting the automated driving pattern based on the emotions, and means for changing the content of suggestions based on the emotions, thereby enabling optimization of automated driving according to the driver's emotional state.

[2023] "User" means any individual or legal entity that uses the system to upload their own data and generate and trade artificial intelligence models.

[2024] "Data" refers to the information and files that users upload to the system and are the raw material for generating artificial intelligence models.

[2025] An "artificial intelligence model" is a machine learning model or algorithm generated based on user data, and is a program for performing specific tasks.

[2026] "Listing" is the process of displaying uploaded AI models in a list on the system, making them easier for other users to search and view.

[2027] "Search" is the process by which a user finds an AI model of interest using specific keywords or criteria.

[2028] "Viewing" refers to the act of a user checking detailed information about an artificial intelligence model displayed as a search result.

[2029] "Trading" is the process of buying, selling, or exchanging AI models between users.

[2030] "Purchase" refers to the act of another user paying money to acquire a listed artificial intelligence model.

[2031] A "download link" is a URL generated by the server that allows a user to download an AI model to their device after purchase.

[2032] "Emotion recognition" is the process of identifying a driver's emotional state by analyzing their facial expressions and voice.

[2033] "Adjusting automated driving patterns" is the process of changing the driving mode or operation method of the automated driving system based on the driver's emotional state.

[2034] "Change suggestions" means adjusting infotainment content such as music and route guidance based on the driver's emotions.

[2035] This invention relates to a system that controls driving in an autonomous vehicle based on the emotional state of the driver, thereby providing a safe and comfortable driving experience.

[2036] Configuration and Operation

[2037] The system includes a means for recognizing drivers' emotions while driving, a marketplace for trading artificial intelligence models, a means for adjusting autonomous driving patterns based on emotion recognition, and a database for managing user data.

[2038] Hardware and software used

[2039] To realize this system, the following hardware and software are used.

[2040] Hardware: Cameras (for facial recognition), microphones (for voice recognition), and control units installed in autonomous vehicles

[2041] Software: OpenCV (facial expression recognition library), pyAudioAnalysis (audio analysis library), ROS (Robot Operating System), database (MySQL, etc.)

[2042] Program processing

[2043] 1. Emotion recognition:

[2044] The server captures the driver's face with a camera and analyzes his facial expressions using OpenCV.

[2045] Additionally, audio data collected by the microphone is analyzed with pyAudioAnalysis to identify the driver's emotional state (e.g., tension, relaxation, stress).

[2046] 2. Emotion-based autonomous driving control:

[2047] Once emotional information is recognized, the server uses this information to adjust the autonomous driving pattern.

[2048] For example, if the driver is feeling stressed, the vehicle's control unit will reduce the driving speed and switch to a safety-focused driving mode.

[2049] 3. User interface adjustments:

[2050] Based on emotional information, the content and display method of the infotainment system will also change dynamically.

[2051] For example, if the driver is feeling nervous, the system will suggest relaxing music and change the screen color to a calming tone.

[2052] Specific examples and program processing

[2053] As a concrete example, consider a scenario in which a driver is operating an autonomous vehicle. After the driver starts driving, the system monitors the driver's face and voice for signs of tension. If the emotion recognition library analyzes this information and determines that the emotional state is "tension," the vehicle's autonomous driving system switches to "relaxed driving mode."

[2054] At this time, the autonomous driving speed is set to a slightly slower speed, and the infotainment system starts playing relaxing background music and changes the screen color to calming shades of blue and green to reduce the driver's psychological stress.

[2055] Prompt Sentence Examples

[2056] "Design a system for an autonomous vehicle that recognizes the facial expressions and voice of a nervous driver in real time and switches to safe driving mode. Please provide details of the APIs and logic used."

[2057] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2058] Step 1:

[2059] Acquiring emotion data

[2060] Input: Image data of the driver's facial expressions captured by a camera, and audio data of the driver's voice captured by a microphone.

[2061] Specific operation:

[2062] The device uses a camera installed inside the vehicle to capture a photo of the driver's face at regular intervals and records their voice with a microphone.

[2063] The acquired image and audio data is instantly transmitted to the system.

[2064] Output: Collected facial expression image data and audio data.

[2065] Step 2:

[2066] emotion recognition

[2067] Input: Collected facial image data and audio data.

[2068] Specific operation:

[2069] The device uses facial expression recognition software (OpenCV) to analyze facial expression data and infer emotional states.

[2070] The audio data is analyzed using an audio analysis library (pyAudioAnalysis) to estimate the emotional state from the audio.

[2071] Output: The resulting emotional state (e.g., tense, relaxed, stressed).

[2072] Step 3:

[2073] Integration of emotional states

[2074] Input: Facial expression recognition results and voice analysis results.

[2075] Specific operation:

[2076] The server runs an algorithm to determine the overall emotional state based on the results of facial expression analysis and voice analysis.

[2077] Each emotion result is weighted, and the most dominant emotion is determined as the final emotion state.

[2078] Output: Integrated emotional state information.

[2079] Step 4:

[2080] Adjusting autonomous driving patterns

[2081] Input: Integrated emotional state information.

[2082] Specific operation:

[2083] The server generates a command to change the driving pattern based on the emotional state information.

[2084] For example, if a state of tension is detected, a command to switch to "safe driving mode" is issued.

[2085] Output: Command to change driving pattern (e.g. "Safe driving mode").

[2086] Step 5:

[2087] Executing a driving pattern

[2088] Input: Command to change driving pattern.

[2089] Specific operation:

[2090] The autonomous vehicle's control unit automatically adjusts its driving patterns based on the received instructions.

[2091] For example, when switching to "safe driving mode," the speed is set low and careful driving behavior is adopted.

[2092] Output: Actual driving pattern (e.g. slower speed, more cautious operation).

[2093] Step 6:

[2094] Infotainment system adjustments

[2095] Input: Integrated emotional state information.

[2096] Specific operation:

[2097] The server changes the suggestions and display methods of the infotainment system based on the emotional state.

[2098] For example, if you're feeling nervous, it will suggest relaxing music and change the screen color to a calming tone.

[2099] Output: Tailored infotainment content and screen display.

[2100] Step 7:

[2101] User Feedback

[2102] Input: adjusted infotainment content and driving patterns.

[2103] Specific operation:

[2104] The terminal provides real-time feedback to the user.

[2105] If the driver is nervous, a message such as "Switched to relaxation driving mode" will be displayed.

[2106] Output: Notification and feedback display to the user.

[2107] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[2108] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2109] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[2110] [Fourth embodiment]

[2111] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[2112] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[2113] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2114] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[2115] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[2116] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[2117] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[2118] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[2119] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[2120] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2121] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2122] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2123] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2124] MODE FOR CARRYING OUT THE INVENTION

[2125] The present invention provides a system for providing a marketplace where users can buy and sell their own artificial intelligence models. This system includes the following functions:

[2126] User Registration and Login

[2127] 1. Device: The user accesses the marketplace website and enters information such as name, email address, and password on the new registration page.

[2128] 2. Server: The server stores the entered information in a database and sends a confirmation email to the user, who clicks on a link in the email to activate their account.

[2129] 3. Device: Then, log in by entering your email address and password on the login page.

[2130] Uploading and listing AI

[2131] 1. User: After logging in, access the dashboard and select "Upload AI Model."

[2132] 2. Device: The user enters the required information in the upload form (AI model file, description, price information, etc.) and clicks the upload button.

[2133] 3. Server: The server validates the received AI model file format to ensure it is in the correct format. If there are no problems, it stores the file and related information in a database and lists it on the marketplace.

[2134] Search and browse AI models

[2135] 1. User: Other users enter keywords into the marketplace search bar to find AI models that meet their criteria.

[2136] 2. Server: The server searches the database based on the entered keywords and returns a list of matching AI models to the user.

[2137] 3. Device: The user selects an AI model of interest from the displayed list and views detailed information.

[2138] Purchase and Download

[2139] 1. User: Click the "Purchase" button on the details page of the AI ​​model you want to purchase and enter your payment information.

[2140] 2. Server: The server processes the entered payment information, generates a download link if the payment is successful, and records the purchase history in a database.

[2141] 3. User: The user clicks the download link to download the purchased AI model.

[2142] Specific examples

[2143] A specific example of this system is shown below.

[2144] Example 1: User A uploads a facial recognition AI model developed as a hobby to the marketplace.

[2145] 1. Device: User A logs in to the marketplace and accesses the upload page for the facial recognition AI model.

[2146] 2. Device: Enter the AI ​​model file, a brief description of the model, and the price in the form, then click the "Upload" button.

[2147] 3. Server: The server verifies the format of the received AI model and, if there are no problems, stores it in a database and lists it on the marketplace.

[2148] 4. User B: User B types "face recognition" into the search bar and finds User A's AI model in the search results.

[2149] 5. User B: Checks the details page, clicks the "Purchase" button, enters payment information, and completes the purchase.

[2150] 6. Server: If the payment is successful, the server generates a download link and provides it to User B.

[2151] 7. User B: Clicks the download link to get the facial recognition AI model.

[2152] This allows User A to sell the AI ​​model he or she developed, and User B to purchase the AI ​​model they need. This system enables efficient and secure trading of AI models between users.

[2153] The processing flow will be explained below.

[2154] User Registration and Login

[2155] Step 1:

[2156] Device: The user visits the marketplace website and clicks the "Sign Up" button.

[2157] Step 2:

[2158] Device: Enter your name, email address, and password in the registration form and click the "Register" button.

[2159] Step 3:

[2160] Server: Receives the form data and searches a database to ensure the entered email address is unique.

[2161] Step 4:

[2162] Server: If the email address is unique, store the entered user information in a database along with the hashed password.

[2163] Step 5:

[2164] Server: Send the user a confirmation email that their registration is complete.

[2165] Step 6:

[2166] Users: Receive a confirmation email and click the link in the email to activate their account.

[2167] Step 7:

[2168] On the device: The user accesses the login page and logs in by entering their email address and password.

[2169] Step 8:

[2170] Server: Validates the login information and, if successful, starts the user session.

[2171] Uploading and listing AI

[2172] Step 1:

[2173] User: After logging in, select "Upload AI Model" from the dashboard.

[2174] Step 2:

[2175] Device: Enter the AI ​​model file, description, and pricing information in the upload form.

[2176] Step 3:

[2177] On the device: Click the upload button to send the form data to the server.

[2178] Step 4:

[2179] Server: Receives the form data and validates the file format for the AI ​​model.

[2180] Step 5:

[2181] Server: If the verification is successful, the AI ​​model file is saved in storage.

[2182] Step 6:

[2183] Server: Stores the AI ​​model metadata (description, category, pricing information, etc.) in a database.

[2184] Step 7:

[2185] Server: Lists the AI ​​model on the marketplace and notifies the user when the upload is complete.

[2186] Search and browse AI models

[2187] Step 1:

[2188] User: Enter keywords into the Marketplace search bar and click the search button.

[2189] Step 2:

[2190] Server: Receives search queries and extracts corresponding AI models from the database.

[2191] Step 3:

[2192] Server: Returns the list of extracted AI models to the user device.

[2193] Step 4:

[2194] Terminal: Shows the user the list of AI models.

[2195] Step 5:

[2196] User: Select the AI ​​model of interest from the displayed list and view its detailed information.

[2197] Purchase and Download

[2198] Step 1:

[2199] User: Click the "Purchase" button on the details page of the AI ​​model you want to purchase.

[2200] Step 2:

[2201] Device: Enter your credit card and payment information into the purchase form.

[2202] Step 3:

[2203] Terminal: Check the input and send.

[2204] Step 4:

[2205] Server: Receives payment information and sends it to the payment gateway to process the payment.

[2206] Step 5:

[2207] Server: If payment is successful, generate the download link.

[2208] Step 6:

[2209] Server: Sends the user a purchase confirmation email and provides a download link.

[2210] Step 7:

[2211] Server: Records purchase history in a database.

[2212] Step 8:

[2213] User: Receives purchase confirmation email and clicks download link to download the AI ​​model.

[2214] This will allow users to trade the AI ​​models they have created on the marketplace.

[2215] Example 1

[2216] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2217] Conventional AI model trading systems face the challenge of requiring users to upload models properly and effectively list, search, purchase, and download them through cumbersome procedures. In particular, complex registration and authentication procedures, as well as insufficient formal model validation and payment processing, detract from the user experience. Another problem is the inability to properly manage purchase history.

[2218] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2219] In this invention, the server includes means for users to upload their own data and list artificial intelligence models generated based on that data, means for other users to search for and view the listed artificial intelligence models, means for users to trade artificial intelligence models, means for providing a download link after purchasing an artificial intelligence model, means for new users to enter personal information, receive a registration confirmation email, and activate their account, means for registered users to complete login authentication and access the dashboard, means for verifying and listing artificial intelligence models after uploading, means for processing payment information after purchase and generating a download link when successful payment is confirmed, and means for recording purchase history in a database. This makes it possible to streamline the entire process from uploading to trading, purchasing, and downloading artificial intelligence models, improving the user experience.

[2220] "User" means an individual or legal entity that uses the system to upload their own data and trade artificial intelligence models.

[2221] A "server" is a computer system that processes requests sent by users and stores, retrieves, and transacts data, generates download links, and so on.

[2222] A "terminal" is a device such as a PC, smartphone, or tablet that a user uses to access the system.

[2223] An "artificial intelligence model" is a program or algorithm generated by a user and uploaded, listed, traded, purchased, or downloaded through the system.

[2224] "Listing" is the process of storing an uploaded AI model in a database within the system, making it available for other users to search and view.

[2225] "Search" is the act of a user entering specific keywords or conditions to find an artificial intelligence model stored within the system.

[2226] "Viewing" refers to the act of displaying detailed information about an artificial intelligence model selected from the search results.

[2227] "Transaction" refers to the act of buying and selling artificial intelligence models between users.

[2228] A "download link" is a URL that allows a user to save the purchased AI model to their own device.

[2229] A "Registration Confirmation Email" is an email containing a confirmation link required by a New User to complete their Account registration.

[2230] "Account Activation" is the process of activating a new user's account on the system by clicking on a link in a confirmation email.

[2231] "Login authentication" is the process by which a user logs in to their account using an email address and password when accessing a system.

[2232] The "dashboard" is the main screen of the system that can be accessed by logged-in users, and is an interface that allows various operations and confirmation of information.

[2233] "Formal verification" is the process of verifying that the file format of an uploaded artificial intelligence model meets the standards required by the system.

[2234] "Payment Information" is data relating to a payment method, such as credit card information, that a user provides to complete a transaction.

[2235] "Payment processing" is the process of charging the transaction amount based on the payment information entered by the user and confirming whether the payment was successful.

[2236] "Purchase history" is data that records transaction information for AI models that a user has purchased in the past.

[2237] MODE FOR CARRYING OUT THE INVENTION

[2238] The present invention is a system that provides a marketplace where users can buy and sell their own generative AI models. This system includes various functions to efficiently perform a series of processes, such as user registration, login, uploading, listing, searching, viewing, trading, purchasing, and downloading AI models.

[2239] First, users access the system through devices such as PCs, smartphones, and tablets. The system is used through a web browser, and users operate the website's UI. The server processes these requests, storing, searching, and trading the necessary data, generating download links, and so on.

[2240] User Registration and Login

[2241] User Registration

[2242] 1. On the device: The user opens the marketplace website and accesses the sign-up page. The user enters their name, email address, and password.

[2243] 2. Server: The server receives the entered information, stores it in a database, and then sends the user a confirmation email containing a link to activate their account.

[2244] 3. On the device: The user clicks on the link in the confirmation email and the account is activated.

[2245] User Login

[2246] 1. Device: The user accesses the login page, enters their email address and password, and clicks the "Login" button.

[2247] 2. Server: The server validates the entered information and redirects the user to their dashboard if it is correct, or returns an error message if invalid information is entered.

[2248] Uploading and listing AI

[2249] Uploading an AI model

[2250] 1. User: After logging in, the user accesses the dashboard and selects "Upload AI model."

[2251] 2. On the device: An upload form will appear, and the user will enter the AI ​​model file, description, and pricing information, then click the "Upload" button.

[2252] 3. Server: The server checks the format of the uploaded AI model file. If the format is incorrect, it returns an error message to the user. If the format is correct, it stores the file and related information in a database and lists the AI ​​model on the marketplace.

[2253] Search and browse AI models

[2254] AI Model Search

[2255] 1. User: Another user enters a specific keyword (e.g., "facial recognition") into the Marketplace search bar and clicks the search button.

[2256] 2. Server: The server searches the database based on the entered keywords, creates a list of relevant AI models, and returns it.

[2257] 3. Device: The user's device will display a list of applicable AI models, and they can click on links to view more information about each model.

[2258] Purchase and Download

[2259] AI model purchase

[2260] 1. User: Click the "Purchase" button on the details page of the AI ​​model you want to purchase and enter your payment information.

[2261] 2. Server: The server processes the entered payment information, generates a download link and provides it to the user if the payment is successful, and records the purchase history in a database.

[2262] AI model download

[2263] 1. User: Click the download link to download the purchased AI model. The file will be saved to your local device.

[2264] Specific examples

[2265] Example: Steps for User A to upload a facial recognition AI model

[2266] 1. Device: User A logs in to the marketplace website and goes to the dashboard.

[2267] 2. On your device: Go to the "Upload AI Model" page, enter the AI ​​model file (Facial Recognition Model.zip), a description of the model ("This model is specialized for facial recognition"), and a price ($100), then click the "Upload" button.

[2268] 3. Server: The server checks the file format, for example to make sure it's in zip format. It then saves the file, description, and pricing information to a database, lists it on the marketplace, and sends a success message back to User A.

[2269] Example: User B's procedure for purchasing an AI model

[2270] 1. User B: Enter "face recognition" in the search bar and click the search button.

[2271] 2. Server: The server lists the relevant AI models (including User A's model) and returns them to User B.

[2272] 3. Device: User B selects User A's model from the list and checks the details page.

[2273] 4. User B: Clicks the "Purchase" button and enters payment information. For example, enters credit card information and clicks the "Pay" button.

[2274] 5. Server: Once payment is successful, generate a download link and provide it to User B. Also record the purchase history in the database.

[2275] 6. User B: Clicks the download link to download the purchased facial recognition AI model and save it to their local device.

[2276] Prompt Sentence Examples

[2277] By entering the prompt "What are the steps to upload a new AI model to the marketplace?", User A can obtain specific instructions on how to upload and list their facial recognition AI model.

[2278] This makes the system's usage and flow clearer, allowing users to effectively contribute their AI models to the marketplace.

[2279] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2280] Step 1:

[2281] User: A user opens your marketplace website and visits the sign-up page.

[2282] Input: Name, Email Address, Password

[2283] What happens: The user enters this information and clicks the "Register" button.

[2284] Step 2:

[2285] Server: The server receives the entered information and stores it in a database.

[2286] Input: Name, Email Address, Password

[2287] What it does: Checks that the input data is in the correct format, and if so, saves it to the database. It then generates a confirmation email and sends it to the user.

[2288] Output: Confirmation email sending status

[2289] Step 3:

[2290] Device: User clicks on the link in the confirmation email.

[2291] Input: Link in confirmation email

[2292] What it does: When you click the link, a request is sent to the server to access the account and activate it.

[2293] Output: Account activation status

[2294] Step 4:

[2295] Device: The user visits the login page, enters their email address and password, and clicks the "Login" button.

[2296] Input: Email address, Password

[2297] Action: A login request is sent to the server.

[2298] Step 5:

[2299] Server: The server validates the information entered.

[2300] Input: Email address, Password

[2301] What it does: Looks up the database and verifies that the email address and password match. If they are correct, it redirects the user to their dashboard. If invalid information is entered, it generates and returns an error message.

[2302] Output: Login authentication status, redirect URL or error message

[2303] Step 6:

[2304] Users: After logging in, go to the dashboard and select "Upload AI Model."

[2305] What it does: Operate the dashboard to display the AI ​​model upload form.

[2306] Step 7:

[2307] Device: Enter the required information in the upload form.

[2308] Input: AI model file, description, pricing information

[2309] How it works: Clicking the "Upload" button sends the information to the server.

[2310] Step 8:

[2311] Server: Validates the format of the uploaded AI model file.

[2312] Input: AI model file, description, pricing information

[2313] What it does: Checks whether the file format is valid, generates and returns an error message if it is not valid, saves the file and related information to a database, and lists the AI ​​model on the marketplace.

[2314] Output: File format validation status, list display status

[2315] Step 9:

[2316] User: Another user types a keyword into the Marketplace search bar and clicks the search button.

[2317] Input: Search keyword

[2318] Action: A search request is sent to the server.

[2319] Step 10:

[2320] Server: Searches the database based on the entered keywords.

[2321] Input: Search keyword

[2322] What it does: Creates a list of AI models that match the keywords and returns it to the user.

[2323] Output: Search result list

[2324] Step 11:

[2325] On the device: The user selects an AI model of interest from the displayed list and views detailed information.

[2326] Input: Search result list

[2327] Action: Displays detailed information about each AI model.

[2328] Step 12:

[2329] User: Click the "Purchase" button on the details page of the AI ​​model they want to purchase and enter their payment information.

[2330] Input: Payment information (e.g., credit card information)

[2331] What it does: Sends payment information to the server.

[2332] Step 13:

[2333] Server: Processes payment information.

[2334] Input: Payment Information

[2335] What it does: It connects to a payment service to process payments. If payment is successful, it generates a download link and provides it to the user. It also records the purchase history in a database.

[2336] Output: Payment processing status, download link, purchase history record

[2337] Step 14:

[2338] User: Click the download link to download the purchased AI model.

[2339] Input: Download link

[2340] What happens: The file is saved to the user's local device.

[2341] Output: Download completion status

[2342] (Application example 1)

[2343] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2344] In conventional AI model marketplaces, users often operate them web-based, and there is a lack of convenient systems that can be used with smartphones. This makes it difficult for users to easily upload, search, purchase, and download AI models. Furthermore, there are issues with the reliability and security of transactions. Therefore, there is a need for a reliable AI model trading system that is easy for users to use.

[2345] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2346] In this invention, the server includes means for allowing users to upload their own data and list artificial intelligence models generated based on that data, means for other users to search for and view the listed artificial intelligence models, means for trading artificial intelligence models between users, means for providing a download link after purchasing an artificial intelligence model, and means for uploading, searching, purchasing, and downloading artificial intelligence models from a user interface using a smartphone. This enables users to easily trade artificial intelligence models using their smartphones, realizing a highly reliable trading environment.

[2347] "User" refers to an individual user of the system.

[2348] "Data" refers to information and files uploaded by Users.

[2349] "Artificial intelligence model" refers to a machine learning algorithm or program generated by a user based on data.

[2350] "Listing" refers to creating a list of uploaded AI models so that they can be visually checked.

[2351] "Search" refers to the act of searching for a list of AI models based on specific keywords or criteria.

[2352] "Viewing" refers to the act of checking detailed information about an AI model selected from the search results.

[2353] "Trading" refers to the process of buying and selling artificial intelligence models.

[2354] "Purchase" refers to the act of another user paying a fee to acquire a listed artificial intelligence model.

[2355] "Download Link" refers to a specific URL for a User to download the purchased AI model.

[2356] A "smartphone" is a type of mobile phone that is a multi-function device that can connect to the Internet and use applications.

[2357] "User interface" refers to the screen and operating means that allow the user to directly interact with the system.

[2358] "Payment Information" refers to credit card information or other payment method information required for purchase.

[2359] "Database" refers to a component that systematically stores and manages various data handled by the system.

[2360] MODE FOR CARRYING OUT THE INVENTION

[2361] The present invention provides a system that provides a marketplace where users can buy and sell their own AI models. This system is designed to allow users to easily upload, search, purchase, and download AI models using their smartphones.

[2362] System Program

[2363] This system consists of both a front-end and a back-end. The front-end is mainly a smartphone application, and the back-end consists of a cloud server and database.

[2364] Front-end (smartphone app)

[2365] Framework: Cross-platform development using React Native.

[2366] function:

[2367] User Registration and Login: A user creates an account by entering information such as name, email address, and password, and then verifies the email address to activate the account.

[2368] Dashboard: After logging in, you can upload, search, and purchase AI models from the dashboard.

[2369] Upload form: The user enters the AI ​​model file, description, and pricing information, and clicks the upload button.

[2370] Search bar and results display: Users can search for AI models by entering keywords.

[2371] Purchase page and payment input form: Review the details of the AI ​​model you want to purchase and enter your payment information to complete your purchase.

[2372] Download link displayed: After purchase, the download link will be displayed.

[2373] Backend (server and database)

[2374] Framework: Node.js + Express.

[2375] Database: MongoDB is used for cloud-based, scalable data management.

[2376] function:

[2377] User information storage and authentication: User registration information is stored in a database and a confirmation email is sent.

[2378] Validate and save AI model file format: Validate the uploaded file format and save it to ensure it is in the correct format.

[2379] Processing search queries: Searching the database based on keywords entered by the user and returning results.

[2380] Payment processing: Process the user's payment information using the Stripe API, etc., and generate a download link if successful.

[2381] Download link management: Provide the generated download link to the user and record the purchase history in the database.

[2382] Specific examples

[2383] Below are some specific examples of how the system can be used.

[2384] Example of input prompt for generative AI model

[2385] The following prompts can be used to generate specific use cases for AI models:

[2386] markdown

[2387] This section provides a detailed description of a system that provides a marketplace where users can buy and sell their own artificial intelligence models. Please create a specific usage scenario in which users upload, purchase, and download AI models. Marketplace functionality includes user registration, login, and the ability to search, view, purchase, and download AI models.

[2388] By utilizing this prompt, users can create specific scenarios and demonstrate how other users can obtain AI models.

[2389] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2390] Step 1:

[2391] User Registration and Login

[2392] User: Create a new account by entering your name, email address and password.

[2393] Input: Name, Email Address, Password

[2394] Output: Send account creation confirmation email

[2395] Server: Stores this information in a database and sends a confirmation email to the user.

[2396] How it works: Click the confirmation link in the email to activate your account.

[2397] Step 2:

[2398] Log in

[2399] User: Log in with your email address and password.

[2400] Input: Email address, Password

[2401] Output: Dashboard access rights

[2402] Server: Checks credentials and redirects user to dashboard.

[2403] Behavior: If authentication is successful, the user is able to access the dashboard.

[2404] Step 3:

[2405] Uploading an AI model

[2406] User: Select "Upload AI Model" on the dashboard.

[2407] Input: AI model file, description, pricing information

[2408] Output: Upload completion notification

[2409] Device: Fill in the required information in the input form and click the upload button.

[2410] Server: Validates the file format, ensures it is in the correct format, and saves it to the database.

[2411] How it works: After the file format is validated, the model information will be listed on the Marketplace.

[2412] Step 4:

[2413] Searching for AI models

[2414] User: Enter keywords in the search bar to find AI models that meet your criteria.

[2415] Input: keyword

[2416] Output: A list of search results

[2417] Server: Sends the search query to the database and lists the corresponding AI models.

[2418] Behavior: Returns a list of matching AI models to the user.

[2419] Step 5:

[2420] Viewing AI models

[2421] User: Select an AI model of interest from the search results and view detailed information.

[2422] Input: Select search result

[2423] Output: Detailed information about the AI ​​model

[2424] On your device: View detailed information about the selected AI model.

[2425] What it does: The details page for the AI ​​model selected by the user is displayed.

[2426] Step 6:

[2427] Purchasing AI models

[2428] User: Click the "Purchase" button on the details page of the AI ​​model they want to purchase and enter their payment information.

[2429] Input: Payment Information

[2430] Output: Purchase confirmation and download link

[2431] Server: Processes payment information and generates a download link for the AI ​​model if payment is successful.

[2432] How it works: After the payment is processed, the purchase history is recorded in a database and the user is provided with a download link.

[2433] Step 7:

[2434] Downloading the AI ​​model

[2435] User: Click the download link to download the purchased AI model.

[2436] Input: Click on the download link

[2437] Output: AI model file

[2438] Device: Use the download link to get the AI ​​model.

[2439] Operation: The purchased AI model is downloaded to the user's device.

[2440] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2441] MODE FOR CARRYING OUT THE INVENTION

[2442] The present invention provides a more personalized trading environment by combining a marketplace where users can buy and sell their AI models with an emotion engine that recognizes user emotions. This system includes the following functions:

[2443] User Registration and Login

[2444] 1. Device: The user accesses the marketplace website and enters information such as name, email address, and password on the new registration page.

[2445] 2. Server: The server stores the entered information in a database and sends a confirmation email to the user, who clicks on a link in the email to activate their account.

[2446] 3. Device: Then, log in by entering your email address and password on the login page.

[2447] Uploading and listing AI

[2448] 1. User: After logging in, access the dashboard and select "Upload AI Model."

[2449] 2. Device: Enter the required information in the upload form (AI model file, description, price information, etc.) and click the Upload button.

[2450] 3. Server: The server validates the received AI model file format to ensure it is in the correct format. If there are no problems, it stores the file and related information in a database and lists it on the marketplace.

[2451] Search and browse AI models

[2452] 1. User: Enter keywords in the Marketplace search bar to find AI models that meet your criteria.

[2453] 2. Server: The server searches the database based on the entered keywords and returns a list of matching AI models to the user.

[2454] 3. Device: The user selects an AI model of interest from the displayed list and views detailed information.

[2455] Purchase and Download

[2456] 1. User: Click the "Purchase" button on the details page of the AI ​​model you want to purchase and enter your payment information.

[2457] 2. Server: The server processes the entered payment information, generates a download link if the payment is successful, and records the purchase history in a database.

[2458] 3. User: The user clicks the download link to download the purchased AI model.

[2459] Additional features of the Emotion Engine

[2460] 1. Server: The data uploaded by the user is embedded with an emotion engine that recognizes the user's emotions.

[2461] 2. Server: Based on the recognized emotion, analyze the state, such as "excited" or "anxious."

[2462] 3. Device: Recommends AI models based on the emotional information recognized by the emotion engine. For example, if the user is excited, it will recommend an entertainment-oriented AI model, and if the user is calm, it will recommend an educational AI model.

[2463] 4. Terminal: Dynamically change the interface of the transaction page based on emotional information. For example, if the user is feeling anxious, a more subdued color scheme and fonts can be used to provide a sense of security.

[2464] Specific examples

[2465] Below is a concrete example of incorporating an emotion engine.

[2466] Example 1: User C uploads a facial recognition AI model to the marketplace

[2467] 1. Device: User C logs in to the marketplace and accesses the upload page for the facial recognition AI model.

[2468] 2. Device: Enter the AI ​​model file, a brief description of the model, and the price in the form, then click the "Upload" button.

[2469] 3. Server: The server verifies the format of the received AI model and, if there are no problems, stores it in a database and lists it on the marketplace.

[2470] 4. Server: The emotion engine recognizes User C's emotions from their facial expressions and voice data, and analyzes them as, for example, "excited."

[2471] 5. User D: User D types "face recognition" into the search bar and finds User C's AI model in the search results.

[2472] 6. Server: Recognizes that User D's emotion is "anxiety" and changes the design of the transaction page to a calmer color scheme.

[2473] 7. User D: Completes the purchase process, enters payment information, and clicks the "Purchase" button.

[2474] 8. Server: The payment process is successful and a download link is generated and provided to User D.

[2475] 9. User D: Clicks the download link to get the facial recognition AI model.

[2476] This system can provide a personalized trading environment that responds to users' emotions, improving trading reliability and user experience.

[2477] The processing flow will be explained below.

[2478] User Registration and Login

[2479] Step 1:

[2480] Device: The user visits the marketplace website and clicks the "Sign Up" button.

[2481] Step 2:

[2482] Device: Enter your name, email address, and password in the registration form and click the "Register" button.

[2483] Step 3:

[2484] Server: Receives the form data and searches a database to ensure the entered email address is unique.

[2485] Step 4:

[2486] Server: If the email address is unique, store the entered user information in a database along with the hashed password.

[2487] Step 5:

[2488] Server: Send the user a confirmation email that their registration is complete.

[2489] Step 6:

[2490] Users: Receive a confirmation email and click the link in the email to activate their account.

[2491] Step 7:

[2492] On the device: The user accesses the login page and logs in by entering their email address and password.

[2493] Step 8:

[2494] Server: Validates the login information and, if successful, starts the user session.

[2495] Uploading and listing AI

[2496] Step 1:

[2497] User: After logging in, select "Upload AI Model" from the dashboard.

[2498] Step 2:

[2499] Device: Enter the AI ​​model file, description, and pricing information in the upload form.

[2500] Step 3:

[2501] On the device: Click the upload button to send the form data to the server.

[2502] Step 4:

[2503] Server: Receives the form data and validates the file format for the AI ​​model.

[2504] Step 5:

[2505] Server: If the verification is successful, the AI ​​model file is saved in storage.

[2506] Step 6:

[2507] Server: Stores the AI ​​model metadata (description, category, pricing information, etc.) in a database.

[2508] Step 7:

[2509] Server: Lists the AI ​​model on the marketplace and notifies the user when the upload is complete.

[2510] Search and browse AI models

[2511] Step 1:

[2512] User: Enter keywords into the Marketplace search bar and click the search button.

[2513] Step 2:

[2514] Server: Receives search queries and extracts corresponding AI models from the database.

[2515] Step 3:

[2516] Server: Returns the list of extracted AI models to the user device.

[2517] Step 4:

[2518] Terminal: Shows the user the list of AI models.

[2519] Step 5:

[2520] User: Select the AI ​​model of interest from the displayed list and view its detailed information.

[2521] Purchase and Download

[2522] Step 1:

[2523] User: Click the "Purchase" button on the details page of the AI ​​model you want to purchase.

[2524] Step 2:

[2525] Device: Enter your credit card and payment information into the purchase form.

[2526] Step 3:

[2527] Terminal: Check the input and send.

[2528] Step 4:

[2529] Server: Receives payment information and sends it to the payment gateway to process the payment.

[2530] Step 5:

[2531] Server: If payment is successful, generate the download link.

[2532] Step 6:

[2533] Server: Sends the user a purchase confirmation email and provides a download link.

[2534] Step 7:

[2535] Server: Records purchase history in a database.

[2536] Step 8:

[2537] User: Receives purchase confirmation email and clicks download link to download the AI ​​model.

[2538] Additional features of the Emotion Engine

[2539] Step 1:

[2540] Server: The data uploaded by the user has an emotion engine built in that recognizes the user's emotions.

[2541] Step 2:

[2542] Server: Based on the recognized emotion, analyze the state, such as "excited" or "anxious."

[2543] Step 3:

[2544] Device: Recommends AI models based on the emotional information recognized by the emotion engine. For example, if the user is excited, it will recommend an entertainment-oriented AI model, and if the user is calm, it will recommend an educational AI model.

[2545] Step 4:

[2546] Terminal: Dynamically change the interface of the transaction page based on emotional information. For example, if the user is feeling anxious, a more subdued color scheme and fonts can be used to provide a sense of security.

[2547] Specific examples

[2548] Example 1: User C uploads a facial recognition AI model to the marketplace

[2549] Step 1:

[2550] Device: User C logs in to the marketplace and accesses the upload page for the facial recognition AI model.

[2551] Step 2:

[2552] Device: Enter the AI ​​model file, a brief description of the model, and the price in the form, then click the "Upload" button.

[2553] Step 3:

[2554] Server: The server verifies the format of the received AI model and, if there are no problems, stores it in a database and lists it on the marketplace.

[2555] Step 4:

[2556] Server: The emotion engine recognizes User C's emotions from their facial expressions and voice data, and analyzes them as "excited," for example.

[2557] Step 5:

[2558] User D: User D types "face recognition" into the search bar and finds User C's AI model in the search results.

[2559] Step 6:

[2560] Server: Recognizes that User D's emotion is "anxiety" and changes the design of the trading page to a more subdued color scheme.

[2561] Step 7:

[2562] User D: Completes the checkout process, enters payment information and clicks the "Purchase" button.

[2563] Step 8:

[2564] Server: Payment processing is successful, and a download link is generated and provided to User D.

[2565] Step 9:

[2566] User D: Clicks the download link to get the facial recognition AI model.

[2567] Example 2

[2568] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2569] Conventional AI model marketplaces do not personalize the trading environment according to the user's emotional state, which leads to a problem that the user experience tends to remain at a constant quality.In addition, since recommendations and interface adjustments are not made based on the user's emotional state, it is difficult to optimize trading, and improving user satisfaction has been an issue.

[2570] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for a user to upload his / her own data and list AI models generated based on the data; means for other users to search for and view the listed AI models; means for trading AI models between users; means for providing a download link after purchasing an AI model; means for an emotion analysis engine to recognize the emotional state of the user when uploading an AI model and adjust operation based on the emotional state; means for dynamically changing the AI ​​model recommended to the user based on the emotional state recognized by the emotion analysis engine; and means for dynamically changing the design of the user interface based on the emotional state recognized by the emotion analysis engine. This provides a trading environment personalized according to the user's emotional state, enabling optimization of trading and improved user satisfaction.

[2571] "User" means any person or entity that uses the System to upload, search, purchase, or download AI models.

[2572] "Data" refers to various information uploaded by users, including the AI ​​model itself, descriptions, pricing information, etc.

[2573] An "artificial intelligence model" is a user-created machine learning algorithm or software that operates based on specific data.

[2574] A "marketplace" is an online platform for buying and selling artificial intelligence models generated by multiple users.

[2575] An "emotion analysis engine" is software or hardware that recognizes and analyzes a user's emotional state from facial expressions and voice data.

[2576] "Listing" refers to organizing uploaded AI models and making them available for viewing on the marketplace.

[2577] "Search" refers to the act of finding a specific AI model within the marketplace using keywords and filters.

[2578] "Trading" is the process by which users buy and sell artificial intelligence models.

[2579] A "download link" is a URL or access means for a user to save the AI ​​model they purchased to their device via the Internet.

[2580] "Adjusting behavior" means dynamically changing the system's behavior and recommendations based on the user's emotional state recognized by the emotion analysis engine.

[2581] "Recommendation" is the act of presenting an appropriate artificial intelligence model to a user based on the user's emotional state and past operation history.

[2582] "User interface" refers to the screens and methods of operation that allow a user to interact with a system.

[2583] MODE FOR CARRYING OUT THE INVENTION

[2584] The present invention provides a more personalized trading environment by combining a marketplace where users can buy and sell their artificial intelligence models with an emotion analysis engine that recognizes user emotions. An embodiment of this system is described in detail below.

[2585] System Configuration

[2586] The system includes the following elements:

[2587] 1. Terminal: A device used by a user to access the site, such as a PC, tablet, or smartphone. A web browser runs on the terminal, providing the user interface.

[2588] 2. Server: The core of the system, performing functions such as database management, sentiment analysis, and transaction processing. This includes web servers such as Apache and Nginx, and database servers such as MySQL.

[2589] 3. Sentiment analysis engine: Software for recognizing the user's emotional state. For example, Amazon Rekognition or Microsoft Azure Cognitive Services can be used.

[2590] Key Features

[2591] The system has the following main functions:

[2592] User Registration and Login

[2593] Terminal: The user accesses the marketplace registration page on a web browser and enters the required information.

[2594] Server: Stores the entered information in a database and sends a confirmation email. The user activates their account by clicking the link in the confirmation email and then logs in.

[2595] Uploading and validating the AI ​​model

[2596] User: After logging in, access the dashboard and select "Upload AI model."

[2597] Device: Enter the required information (AI model file, description, price information, etc.) and click the upload button.

[2598] Server: Validates the file format of the received AI model to ensure it is in the correct format. If there are no problems, it is saved in the database and listed on the marketplace.

[2599] Search and browse AI models

[2600] Users: Enter keywords into the Marketplace search bar to find AI models that meet their criteria.

[2601] Server: Queries the database based on the search keywords and returns a list of relevant AI models.

[2602] Terminal: Displays search results and allows users to view detailed information about AI models of interest.

[2603] Purchase and download AI models

[2604] User: Click the "Purchase" button on the details page of the AI ​​model they want to purchase and enter their payment information.

[2605] Server: Processes payment information, generates download links if payment is successful, and records purchase history in a database.

[2606] User: Click the download link to get the AI ​​model.

[2607] Personalization with sentiment analysis

[2608] Server: The emotion analysis engine recognizes the user's emotional state based on facial expressions and voice data. For example, it analyzes states such as "excited" or "anxious."

[2609] Device: Recommend appropriate AI models to users based on their emotional state, for example, entertainment or education models.

[2610] Terminal: Dynamically change the interface design based on emotions, for example by using muted color schemes to improve the user experience.

[2611] Specific examples

[2612] Here are some examples of how sentiment analysis engines can be used:

[2613] Example 1: User A uploads a facial recognition AI model to the marketplace

[2614] Device: User A logs in to the marketplace and accesses the upload page for the facial recognition AI model.

[2615] Device: Enter the AI ​​model file, a brief description, and pricing information into the form and click the "Upload" button.

[2616] Server: Validates the format of the AI ​​model and stores it in the database if there are no problems.

[2617] Server: The emotion analysis engine analyzes User A's emotion and recognizes that he is "excited."

[2618] Example 2: User B searches for a face recognition AI model

[2619] User B: Enters "face recognition" in the search bar and finds User A's model in the search results.

[2620] Server: The emotion analysis engine analyzes User B's emotions and recognizes "anxiety."

[2621] Terminal: The design of the trading page is changed to a more subdued color scheme, providing an environment where User B can trade with peace of mind.

[2622] Prompt Sentence Examples

[2623] Below are some example prompts to input to a generative AI model:

[2624] "Please recommend the best educational AI model for a calm user."

[2625] "Please suggest entertainment AI models to users who are in an excited state."

[2626] "Design a reassuring interface for anxious users."

[2627] The system of the present invention makes it possible to provide a personalized trading environment that corresponds to the user's emotional state, improving the user experience and increasing the reliability of transactions.

[2628] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2629] Step 1:

[2630] User: Visits the marketplace website and enters information such as name, email address, and password on the sign-up page.

[2631] Input: Personal information (name, email address, password)

[2632] Output: Submit the registration form

[2633] Specific actions: The user enters their information and clicks the "Register" button.

[2634] Step 2:

[2635] Server: Stores the entered information in a database and sends a confirmation email to the user.

[2636] Input: Registration form data

[2637] Output: Database record, confirmation email

[2638] What it does: Receives registration information, stores it in a MySQL database, and then sends a confirmation email using an SMTP server.

[2639] Step 3:

[2640] Users: Click the link in the confirmation email to activate their account.

[2641] Input: Link from confirmation email

[2642] Output: Account activation confirmation

[2643] Specific actions: Open the email and click the link to go to the account activation page.

[2644] Step 4:

[2645] User: Log in by entering your email address and password on the login page.

[2646] Input: Email address, Password

[2647] Output: Login request

[2648] Specific action: The user enters their email address and password and clicks the "Login" button.

[2649] Step 5:

[2650] Server: Checks database to see if the entered email address and password are correct. If so, creates a session and redirects to the dashboard.

[2651] Input: Login request data

[2652] Output: Session ID, Dashboard screen display

[2653] What it does: Generates a session ID and stores it as a cookie in the user's browser, then redirects the user to the dashboard.

[2654] Step 6:

[2655] User: Go to the dashboard and select "Upload AI Model."

[2656] Input: User action

[2657] Output: Upload form displayed

[2658] Specific actions: Click the "Upload AI model" link on the dashboard.

[2659] Step 7:

[2660] Device: Enter the required information in the upload form (AI model file, description, price information, etc.) and click the Upload button.

[2661] Input: AI model file, description, price information

[2662] Output: Upload request

[2663] Specific actions: Enter the required information into the form and click the "Upload" button.

[2664] Step 8:

[2665] Server: Validates the file format of the received AI model to ensure it is in the correct format. If there are no problems, it stores it in the database and storage, and lists it on the marketplace.

[2666] Input: Upload request data

[2667] Output: Database records, storage saves, marketplace listings

[2668] Specific behavior: Checks the file format and performs error checking. Passed files are saved to storage and the database. Then, they are added to the marketplace listing.

[2669] Step 9:

[2670] Users: Enter keywords into the Marketplace search bar to find AI models that meet their criteria.

[2671] Input: Search keyword

[2672] Output: Search result list

[2673] Specific actions: Enter keywords in the search bar and click the "Search" button.

[2674] Step 10:

[2675] Server: Searches the database based on the entered keywords and returns a list of matching AI models to the user.

[2676] Input: Search keyword

[2677] Output: Search result data

[2678] What it does: Executes a database query and returns the results in JSON format.

[2679] Step 11:

[2680] On the device: The user selects an AI model of interest from the displayed list and views detailed information.

[2681] Input: Search results

[2682] Output: Detailed information about the AI ​​model

[2683] Specific actions: Click on an AI model from the list to go to its details page.

[2684] Step 12:

[2685] User: Click the "Purchase" button on the details page of the AI ​​model they want to purchase and enter their payment information.

[2686] Input: Payment Information

[2687] Output: Purchase request

[2688] Specific actions: Enter your credit card information on the purchase page and click the "Purchase" button.

[2689] Step 13:

[2690] Server: Processes payment information, generates download links if payment is successful, and records purchase history in a database.

[2691] Input: Purchase request, payment information

[2692] Output: Download links, purchase history

[2693] What it does: Processes the payment through a payment gateway, generates and stores a download link if successful, and records the purchase history in a database.

[2694] Step 14:

[2695] User: Click the download link to download the purchased AI model.

[2696] Input: Download link

[2697] Output: AI model file

[2698] Specific actions: Click the download link and save the file to your device.

[2699] Step 15:

[2700] Server: The emotion analysis engine recognizes the user's emotional state based on facial expressions and voice data.

[2701] Input: facial expression data, voice data

[2702] Output: Emotional state data

[2703] Specific behavior: Analyze facial expressions and voice data and assign emotional status such as "excited" or "anxious."

[2704] Step 16:

[2705] On-device: Recommend appropriate AI models to users based on their emotional state.

[2706] Input: Emotional state data

[2707] Output: Recommended AI model list

[2708] Specific behavior: Display a list of appropriate AI models on the screen depending on the emotional status.

[2709] Step 17:

[2710] Terminal: Dynamically change interface design based on emotions.

[2711] Input: Emotional state data

[2712] Output: A customized user interface

[2713] What it does: Dynamically change the CSS styles of the page to optimize the design depending on the emotional status.

[2714] (Application example 2)

[2715] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2716] Conventional automated driving systems provide a uniform driving pattern without considering the emotional state of the driver, which results in a lack of safety and comfort due to the lack of driving control according to the driver's psychological state. The present invention aims to solve this problem and optimize automated driving according to the driver's emotions.

[2717] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2718] In this invention, the server includes means for allowing users to upload their own data and for listing artificial intelligence models generated based on the data, means for other users to search for and view the listed artificial intelligence models, means for trading artificial intelligence models between users, means for providing a download link after purchasing an artificial intelligence model, means for recognizing the driver's emotions in real time, means for adjusting the automated driving pattern based on the emotions, and means for changing the content of suggestions based on the emotions, thereby enabling optimization of automated driving according to the driver's emotional state.

[2719] "User" means any individual or legal entity that uses the system to upload their own data and generate and trade artificial intelligence models.

[2720] "Data" refers to the information and files that users upload to the system and are the raw material for generating artificial intelligence models.

[2721] An "artificial intelligence model" is a machine learning model or algorithm generated based on user data, and is a program for performing specific tasks.

[2722] "Listing" is the process of displaying uploaded AI models in a list on the system, making them easier for other users to search and view.

[2723] "Search" is the process by which a user finds an AI model of interest using specific keywords or criteria.

[2724] "Viewing" refers to the act of a user checking detailed information about an artificial intelligence model displayed as a search result.

[2725] "Trading" is the process of buying, selling, or exchanging AI models between users.

[2726] "Purchase" refers to the act of another user paying money to acquire a listed artificial intelligence model.

[2727] A "download link" is a URL generated by the server that allows a user to download an AI model to their device after purchase.

[2728] "Emotion recognition" is the process of identifying a driver's emotional state by analyzing their facial expressions and voice.

[2729] "Adjusting automated driving patterns" is the process of changing the driving mode or operation method of the automated driving system based on the driver's emotional state.

[2730] "Change suggestions" means adjusting infotainment content such as music and route guidance based on the driver's emotions.

[2731] This invention relates to a system that controls driving in an autonomous vehicle based on the emotional state of the driver, thereby providing a safe and comfortable driving experience.

[2732] Configuration and Operation

[2733] The system includes a means for recognizing drivers' emotions while driving, a marketplace for trading artificial intelligence models, a means for adjusting autonomous driving patterns based on emotion recognition, and a database for managing user data.

[2734] Hardware and software used

[2735] To realize this system, the following hardware and software are used.

[2736] Hardware: Cameras (for facial recognition), microphones (for voice recognition), and control units installed in autonomous vehicles

[2737] Software: OpenCV (facial expression recognition library), pyAudioAnalysis (audio analysis library), ROS (Robot Operating System), database (MySQL, etc.)

[2738] Program processing

[2739] 1. Emotion recognition:

[2740] The server captures the driver's face with a camera and analyzes his facial expressions using OpenCV.

[2741] Additionally, audio data collected by the microphone is analyzed with pyAudioAnalysis to identify the driver's emotional state (e.g., tension, relaxation, stress).

[2742] 2. Emotion-based autonomous driving control:

[2743] Once emotional information is recognized, the server uses this information to adjust the autonomous driving pattern.

[2744] For example, if the driver is feeling stressed, the vehicle's control unit will reduce the driving speed and switch to a safety-focused driving mode.

[2745] 3. User interface adjustments:

[2746] Based on emotional information, the content and display method of the infotainment system will also change dynamically.

[2747] For example, if the driver is feeling nervous, the system will suggest relaxing music and change the screen color to a calming tone.

[2748] Specific examples and program processing

[2749] As a concrete example, consider a scenario in which a driver is operating an autonomous vehicle. After the driver starts driving, the system monitors the driver's face and voice for signs of tension. If the emotion recognition library analyzes this information and determines that the emotional state is "tension," the vehicle's autonomous driving system switches to "relaxed driving mode."

[2750] At this time, the autonomous driving speed is set to a slightly slower speed, and the infotainment system starts playing relaxing background music and changes the screen color to calming shades of blue and green to reduce the driver's psychological stress.

[2751] Prompt Sentence Examples

[2752] "Design a system for an autonomous vehicle that recognizes the facial expressions and voice of a nervous driver in real time and switches to safe driving mode. Please provide details of the APIs and logic used."

[2753] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2754] Step 1:

[2755] Acquiring emotion data

[2756] Input: Image data of the driver's facial expressions captured by a camera, and audio data of the driver's voice captured by a microphone.

[2757] Specific operation:

[2758] The device uses a camera installed inside the vehicle to capture a photo of the driver's face at regular intervals and records their voice with a microphone.

[2759] The acquired image and audio data is instantly transmitted to the system.

[2760] Output: Collected facial expression image data and audio data.

[2761] Step 2:

[2762] emotion recognition

[2763] Input: Collected facial image data and audio data.

[2764] Specific operation:

[2765] The device uses facial expression recognition software (OpenCV) to analyze facial expression data and infer emotional states.

[2766] The audio data is analyzed using an audio analysis library (pyAudioAnalysis) to estimate the emotional state from the audio.

[2767] Output: The resulting emotional state (e.g., tense, relaxed, stressed).

[2768] Step 3:

[2769] Integration of emotional states

[2770] Input: Facial expression recognition results and voice analysis results.

[2771] Specific operation:

[2772] The server runs an algorithm to determine the overall emotional state based on the results of facial expression analysis and voice analysis.

[2773] Each emotion result is weighted, and the most dominant emotion is determined as the final emotion state.

[2774] Output: Integrated emotional state information.

[2775] Step 4:

[2776] Adjusting autonomous driving patterns

[2777] Input: Integrated emotional state information.

[2778] Specific operation:

[2779] The server generates a command to change the driving pattern based on the emotional state information.

[2780] For example, if a state of tension is detected, a command to switch to "safe driving mode" is issued.

[2781] Output: Command to change driving pattern (e.g. "Safe driving mode").

[2782] Step 5:

[2783] Executing a driving pattern

[2784] Input: Command to change driving pattern.

[2785] Specific operation:

[2786] The autonomous vehicle's control unit automatically adjusts its driving patterns based on the received instructions.

[2787] For example, when switching to "safe driving mode," the speed is set low and careful driving behavior is adopted.

[2788] Output: Actual driving pattern (e.g. slower speed, more cautious operation).

[2789] Step 6:

[2790] Infotainment system adjustments

[2791] Input: Integrated emotional state information.

[2792] Specific operation:

[2793] The server changes the suggestions and display methods of the infotainment system based on the emotional state.

[2794] For example, if you're feeling nervous, it will suggest relaxing music and change the screen color to a calming tone.

[2795] Output: Tailored infotainment content and screen display.

[2796] Step 7:

[2797] User Feedback

[2798] Input: adjusted infotainment content and driving patterns.

[2799] Specific operation:

[2800] The terminal provides real-time feedback to the user.

[2801] If the driver is nervous, a message such as "Switched to relaxation driving mode" will be displayed.

[2802] Output: Notification and feedback display to the user.

[2803] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2804] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2805] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2806] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2807] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged ...

Claims

1. A means for users to upload their own data and list the AI ​​models generated based on that data; A means for other users to search and view the listed artificial intelligence models; and A means for trading artificial intelligence models between users; A means to provide a download link after purchasing an AI model; A system including:

2. 10. The system of claim 1, further comprising means for validating the format of an uploaded artificial intelligence model to ensure that it is in a proper format.

3. means for processing the payment information entered by the user and, if successful, generating a download link; 10. The system of claim 1, further comprising means for recording the purchase history in a database.

Images