System
The system addresses inefficiencies in AI prompt generation by enabling efficient creation, sharing, and evaluation of prompts, along with streamlined subscription and advertisement management, enhancing user experience.
Patent Information
- Application Number
- JP2024141607
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-22
- Publication Date
- 2026-03-06
AI Technical Summary
Conventional AI prompt generation systems are inefficient for users to create, share, and evaluate prompts, and incorporating subscription or advertising models complicates management, reducing user convenience.
A system that includes means for receiving, storing, searching, downloading, rating, and displaying user-generated prompts, along with managing subscription plans and advertisements, to enhance user interaction and efficiency.
The system allows users to effectively create, share, and evaluate prompts, improving overall system usability and convenience by simplifying management and incorporating user feedback and advertisements.
Smart Images

Figure 2026038272000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] Conventional AI prompt generation systems make it difficult for users to efficiently create, share, and evaluate appropriate prompts, posing challenges in improving prompt quality and maximizing their use. Furthermore, incorporating a subscription or advertising model can complicate management, raising concerns that user convenience may be reduced. This invention aims to solve these challenges and provide a system that is easy to use for both users and prompt providers. [Means for solving the problem]
[0005] The present invention provides a system including means for receiving input data generated by a user, a database for storing the input data, means for searching for the input data stored in the database, and means for allowing the user to download or use the input data. The system further includes means for a user to select a subscription plan and input payment information, a payment gateway for processing the payment information, means for updating the user's subscription status, a database for managing the subscription status, and means for providing rewards to the user. The system also includes means for a user to input ratings for prompts, means for saving the rating data in a database, and means for displaying the rating data to other users, thereby improving the efficiency and convenience of the overall system.
[0006] "User" means any person or entity that uses the System to create, download, and evaluate prompts.
[0007] "Input data" refers to prompt content and configuration information that is generated by the user and sent to the system.
[0008] "Database" means a centralized storage system for storing and managing input data received from users.
[0009] A "search means" is a system component that provides a function to search input data stored in a database based on specific conditions.
[0010] The "downloading means" is a system component that provides a function for a user to obtain input data stored in a database and make it available for use.
[0011] A "subscription plan" is a fee structure that allows users to use certain services or benefits by paying a certain fee.
[0012] "Payment Information" means the credit card or other payment method information required by a User to pay for a Subscription Plan.
[0013] A "payment gateway" is an Internet service that processes payment information provided by a user and processes payments.
[0014] "Subscription status" is information indicating the status of a user's ability to use benefits and services provided based on a subscription plan.
[0015] "Benefits" are additional benefits or services provided to users who sign up for a subscription plan.
[0016] A "rating means" is a system component that provides the functionality for a user to rate a particular prompt.
[0017] "Rating data" is rating information (such as star ratings and comments) for a prompt made by a user.
[0018] A "display means" is a system component that provides the functionality to visually display information stored within the system to a user. [Brief explanation of the drawings]
[0019] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5]FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0020] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0021] First, the terms used in the following description will be explained.
[0022] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0023] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0024] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0025] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0026] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0027] [First embodiment]
[0028] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0029] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0030] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0031] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0032] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0033] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0034] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0035] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0036] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0037] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0038] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0039] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0040] This invention provides a system that allows users to effectively create, share, and evaluate prompts to be input to AI. Below, the system program and its processing are explained in natural language.
[0041] Creating and posting prompts
[0042] 1. Sign up as a prompt contributor
[0043] When a user accesses the sign-up page, the terminal displays an input form. The user enters their name, email address, password, etc. and clicks the sign-up button. The terminal sends the input information to the server, which verifies it and stores it in a database. A completion message is sent from the server to the terminal and displayed to the user.
[0044] 2. Create a prompt
[0045] When a user logs in and accesses the dashboard, the terminal displays a prompt creation form. The user enters the prompt details and clicks the submit button. The input information is sent from the terminal to the server, where it is validated and saved in the database. A save completion message is sent to the terminal and displayed.
[0046] 3. Managing prompts
[0047] When a user accesses the dashboard to manage the prompts posted by the user, the terminal requests the prompt information from the server, which retrieves the relevant prompt information from the database and sends it to the terminal, which then displays it to the user.
[0048] Find and download prompts
[0049] 1. Search for prompts
[0050] When a user accesses the search page, the terminal displays a search box. The user enters search keywords and clicks the search button. The search keywords are sent from the terminal to the server, and the server searches the database for the corresponding prompt and sends the results to the terminal. The terminal then displays the search results to the user.
[0051] 2. View and download prompt details
[0052] When the user selects a prompt they are interested in, the terminal sends the prompt ID to the server. The server retrieves the details of the prompt from the database and sends them to the terminal. The details are displayed to the user, and when the user clicks the download button, a download request is sent from the terminal to the server and the prompt data is sent to the terminal. The data is saved and a completion message is displayed to the user.
[0053] Prompt evaluation and feedback
[0054] 1. Evaluate the prompt
[0055] The user accesses a page for entering ratings in response to the prompt they used and enters the rating data. The rating data is sent from the terminal to the server, where it is stored in a database. A rating completion message is sent to the terminal and displayed.
[0056] 2. Viewing Feedback
[0057] When a user wants to see feedback for a specific prompt, the prompt ID is sent from the device to the server. The server retrieves the prompt's rating and feedback from the database and sends it to the device. The retrieved feedback information is then displayed to the user.
[0058] Subscriptions and Advertising
[0059] 1. Subscription Registration
[0060] When a user visits the subscription page, selects a plan, and enters payment information, the terminal sends it to the server, which then forwards the payment information to the payment gateway for processing, receives the result, and updates the subscription status in the database. A registration completion message is sent to the terminal and displayed to the user.
[0061] 2. Display of advertisements
[0062] When a user views a free prompt, the device sends the prompt ID currently displayed to the server. The server retrieves advertising data related to the prompt from the database and sends it to the device. The advertisement is then displayed to the user.
[0063] The processing flow will be explained below.
[0064] Creating and posting prompts
[0065] Prompt Contributor Sign-Up
[0066] Step 1:
[0067] A user visits the sign-up page.
[0068] Step 2:
[0069] The device displays the input form.
[0070] Step 3:
[0071] The user enters their name, email address, and password and clicks the Sign Up button.
[0072] Step 4:
[0073] The terminal sends the input information to the server.
[0074] Step 5:
[0075] The server validates the input information and stores it in a database.
[0076] Step 6:
[0077] The server sends a sign-up completion message to the terminal.
[0078] Step 7:
[0079] The terminal displays a completion message to the user.
[0080] Creating a Prompt
[0081] Step 1:
[0082] A user logs in and accesses the dashboard.
[0083] Step 2:
[0084] The terminal displays the prompt creation form.
[0085] Step 3:
[0086] The user enters the prompt details (title, description, content) and clicks the submit button.
[0087] Step 4:
[0088] The terminal sends the input information to the server.
[0089] Step 5:
[0090] The server validates the input information and stores it in a database.
[0091] Step 6:
[0092] The server sends a save completion message to the terminal.
[0093] Step 7:
[0094] The terminal displays a completion message to the user.
[0095] Managing Prompts
[0096] Step 1:
[0097] A user visits a dashboard.
[0098] Step 2:
[0099] The terminal requests prompt information for the currently logged-in user from the server.
[0100] Step 3:
[0101] The server retrieves the corresponding prompt information from the database and sends it to the terminal.
[0102] Step 4:
[0103] The terminal displays the obtained prompt information to the user.
[0104] Find and download prompts
[0105] Search prompts
[0106] Step 1:
[0107] A user visits a search page.
[0108] Step 2:
[0109] Your device will display a search box.
[0110] Step 3:
[0111] The user enters search keywords and clicks the search button.
[0112] Step 4:
[0113] The device sends the search keywords to the server.
[0114] Step 5:
[0115] The server searches the database for prompts based on the received keywords.
[0116] Step 6:
[0117] The server sends the search results to the terminal.
[0118] Step 7:
[0119] The terminal displays the search results to the user.
[0120] View and download prompt details
[0121] Step 1:
[0122] The user selects the prompt of interest from the search results.
[0123] Step 2:
[0124] The device sends the ID of the selected prompt to the server.
[0125] Step 3:
[0126] The server retrieves the detailed information of the corresponding prompt from the database and sends it to the terminal.
[0127] Step 4:
[0128] The terminal displays the detailed information to the user.
[0129] Step 5:
[0130] The user clicks the download button.
[0131] Step 6:
[0132] The device sends a download request to the server.
[0133] Step 7:
[0134] The server sends prompt data to the terminal.
[0135] Step 8:
[0136] The terminal saves the data and displays a completion message to the user.
[0137] Prompt evaluation and feedback
[0138] Evaluate prompts
[0139] Step 1:
[0140] A user visits the ratings page.
[0141] Step 2:
[0142] The terminal displays the evaluation input form.
[0143] Step 3:
[0144] The user enters the evaluation data and clicks the submit button.
[0145] Step 4:
[0146] The terminal transmits the evaluation data to the server.
[0147] Step 5:
[0148] The server stores the rating data in a database.
[0149] Step 6:
[0150] The server sends an evaluation completion message to the terminal.
[0151] Step 7:
[0152] The terminal displays a completion message to the user.
[0153] View Feedback
[0154] Step 1:
[0155] A user visits the prompt details page.
[0156] Step 2:
[0157] The device sends the prompt ID to the server.
[0158] Step 3:
[0159] The server retrieves the evaluation and feedback for the prompt from the database and sends it to the terminal.
[0160] Step 4:
[0161] The feedback information acquired by the terminal is displayed to the user.
[0162] Subscriptions and Advertising
[0163] Subscribe
[0164] Step 1:
[0165] A user visits the subscriptions page.
[0166] Step 2:
[0167] The device will display the subscription plan and payment form.
[0168] Step 3:
[0169] The user selects a plan, enters payment information, and clicks the Sign Up button.
[0170] Step 4:
[0171] The terminal sends the payment information to the server.
[0172] Step 5:
[0173] The server forwards the payment information to the payment gateway.
[0174] Step 6:
[0175] The server receives the payment result and updates the subscription status in the database.
[0176] Step 7:
[0177] The server sends a registration completion message to the terminal.
[0178] Step 8:
[0179] The terminal displays a completion message to the user.
[0180] Displaying ads
[0181] Step 1:
[0182] The user views a free prompt.
[0183] Step 2:
[0184] The terminal sends the prompt ID currently being displayed to the server.
[0185] Step 3:
[0186] The server retrieves advertising data related to the prompt from a database.
[0187] Step 4:
[0188] The server transmits the advertisement data to the terminal.
[0189] Step 5:
[0190] The terminal displays the advertisement data to the user.
[0191] Example 1
[0192] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0193] Previous systems required cumbersome operations for managing, searching, rating, and providing feedback on user-generated prompts, making them difficult to use efficiently. Furthermore, they did not properly manage user feedback and ratings to improve the quality of prompts. Furthermore, they lacked a mechanism for displaying appropriate advertisements to free users.
[0194] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0195] In this invention, the server includes means for receiving input data generated by a user, database means for saving the input data, means for searching for input data saved in the database, means for a user to display information related to the input data, means for the user to download or use the input data, means for inputting a rating for the input data, means for saving the rating data in a database, means for displaying the rating data to other users, means for displaying advertisement data, and database means for handling the advertisement data, thereby enabling a user to consistently and efficiently perform processes from creating, sharing, and rating prompts to displaying advertisements.
[0196] "User" means any person or entity that uses the System to create, manage, rate, and search prompts.
[0197] "Input Data" refers to all data such as prompts, ratings, and feedback that a user provides to the system.
[0198] "Database" refers to a digital storage system for storing and managing the input data, evaluation data, and advertising data.
[0199] "Means of searching" refers to the function that allows the system to search input data in the database based on specific keywords or conditions.
[0200] The term "means for displaying information" refers to a function that enables the terminal to visually display to the user the input data and evaluation data acquired from the database.
[0201] "Means for downloading or making available" refers to the system's ability to obtain input data from the user and store it in a format that can be used later.
[0202] "Means for inputting ratings" refers to the functionality that allows a user to input and provide rating data in response to a particular prompt.
[0203] "Rating data" refers to the rating information entered by the user in response to a prompt.
[0204] "Advertising Data" refers to commercial information displayed in connection with a particular prompt or user action.
[0205] "Payment Gateway" refers to a system for processing a user's payment information.
[0206] "Subscription Plan" means a subscription-based plan selected by a User to access certain features of the System.
[0207] "Benefits" means any additional benefits or services provided to you under your Subscription Plan.
[0208] The present invention relates to a system that enables users to effectively create, share, and evaluate prompts to be input to AI. The system is composed of a server, a terminal, and a user. Specific embodiments of the system are described below.
[0209] System configuration
[0210] 1. Server
[0211] The server has the following functions:
[0212] Ability to receive user-generated input data
[0213] A database for storing input data
[0214] Ability to search input data stored in a database
[0215] A function that displays information related to the input data to the user
[0216] Ability to allow users to download or use input data
[0217] A function to input evaluations for input data
[0218] Ability to save evaluation data to a database
[0219] Ability to display rating data to other users
[0220] Ability to display advertising data
[0221] Database function for handling advertising data
[0222] Ability to manage subscription plans
[0223] A payment gateway to process your payment information
[0224] 2. Terminal
[0225] The terminal has the following functions:
[0226] Displaying the input form
[0227] Sending and receiving information to and from the server
[0228] Displaying information to the user
[0229] Download function
[0230] 3. Users
[0231] The user performs the following operations:
[0232] Sign up and log in
[0233] Creating a Prompt
[0234] Managing Prompts
[0235] Search prompts
[0236] View and download prompt details
[0237] Prompt evaluation and feedback
[0238] Subscribe
[0239] Viewing ads
[0240] Processing flow
[0241] Creating and posting prompts
[0242] A user visits the sign-up page and signs up by entering their name, email address, and password. The device sends this information to the server, which stores the user information in a database. The user then logs in and accesses the dashboard. They enter the prompt details in the prompt creation form and click the submit button. The device sends the input information to the server, which stores the prompt in a database.
[0243] As an example, suppose the user enters the following prompt text:
[0244] Create a new AI assistant character. Tell us its name, characteristics, and special abilities.
[0245] Find and download prompts
[0246] The user accesses the search page, enters search keywords, and clicks the search button. The device sends the search keywords to the server, which searches the database for relevant prompts and sends the results to the device. The user selects a specific prompt, displays details, and downloads the prompt data.
[0247] As an example, a user enters the following search keywords:
[0248] "Python Beginner Project"
[0249] Prompt evaluation and feedback
[0250] The user provides a rating for the prompt and sends the rating data through the terminal to the server, which stores the rating data in a database and displays it to other users.
[0251] Subscriptions and Advertising
[0252] Users select a plan on the subscription page, enter their payment information, and the payment is processed through the server via a payment gateway. Free users are shown relevant ads, and the ad data is managed by the server.
[0253] The above is an embodiment of the present invention, which allows users to efficiently manage, search, and rate prompts, and improves the overall system usage experience.
[0254] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0255] Creating and posting prompts
[0256] Step 1:
[0257] A user visits a sign-up page. As input, the user enters their name, email address, and password. As output, data is generated that is sent to the server.
[0258] Specific behavior:
[0259] A user accesses a sign-up page in a browser and enters the name "Taro Yamada," the email address "taro@example.com," and the password "mypassword."
[0260] Step 2:
[0261] The terminal displays a sign-up form. The input contains the HTML data of the form. The output generates a web page that is displayed to the user.
[0262] Specific behavior:
[0263] The terminal displays a sign-up form in the user's browser and provides the above input fields.
[0264] Step 3:
[0265] The user clicks the sign-up button. The input contains the user's input data. The output generates the data sent from the device to the server.
[0266] Specific behavior:
[0267] The user clicks the "Sign Up" button and the entered data is sent to the server.
[0268] Step 4:
[0269] The device sends input information to the server. The input contains the user's input data. The output generates an HTTP request that is sent to the server.
[0270] Specific behavior:
[0271] The device sends the data entered by the user, including the name, email address, and password, to the server.
[0272] Step 5:
[0273] The server validates the input information. Input includes the submitted user data. Output is stored in a database or an error message is sent to the terminal.
[0274] Specific behavior:
[0275] The server checks for duplicate email addresses and password strength, and if there are no problems, it saves the user information in the database. If there are duplicates, it returns an error message.
[0276] Step 6:
[0277] The server saves the user information in the database. It contains the validated user data as input and produces a save completion status as output.
[0278] Specific behavior:
[0279] The server saves the name, email address, and password in the database and generates a save completion status.
[0280] Step 7:
[0281] The server sends a completion message to the terminal, containing the save completion status as input, and an HTTP response as output.
[0282] Specific behavior:
[0283] The server sends a message to the terminal saying "sign-up complete."
[0284] Step 8:
[0285] The terminal displays a completion message to the user. As input, it contains the completion message from the server. As output, it generates a web page that is displayed in the user's browser.
[0286] Specific behavior:
[0287] The device will display "Sign-up complete."
[0288] Find and download prompts
[0289] Step 1:
[0290] A user visits a search page. The input includes the URL of the search page. The output is a search form.
[0291] Specific behavior:
[0292] A user accesses the search page in a browser and displays the search form.
[0293] Step 2:
[0294] The device displays a search box containing the HTML data of the search form as input, and a web page as output.
[0295] Specific behavior:
[0296] The device displays a search box in the user's browser.
[0297] Step 3:
[0298] The user inputs a search keyword. The input contains the search keyword. The output is generated as data to be sent to the terminal.
[0299] Specific behavior:
[0300] A user types "Python beginner projects" into the search box and clicks the search button.
[0301] Step 4:
[0302] The device sends search keywords to the server. The input contains the search keywords entered by the user. The output is an HTTP request.
[0303] Specific behavior:
[0304] The terminal transmits the search keywords to the server.
[0305] Step 5:
[0306] The server performs a search in the database. The input includes the search keywords and the database information. The output is the search results.
[0307] Specific behavior:
[0308] The server searches the database for prompts for "Python beginner projects" and produces the appropriate results.
[0309] Step 6:
[0310] The server sends the search results to the terminal. The search result data is included as input. An HTTP response is generated as output.
[0311] Specific behavior:
[0312] The server sends the search results to the terminal.
[0313] Step 7:
[0314] The terminal displays the search results to the user. The input includes the search result data from the server. The output is a web page that is displayed in the user's browser.
[0315] Specific behavior:
[0316] The device will display the search result with the title "Python projects for beginners" and the description.
[0317] Step 8:
[0318] The user selects a specific prompt. As input, it contains the prompt ID. As output, it generates the data to be sent to the server.
[0319] Specific behavior:
[0320] The user selects "Python projects for beginners" from the search results and clicks the Show details button.
[0321] Step 9:
[0322] The device sends the prompt ID to the server. As input, it contains the prompt ID selected by the user. As output, an HTTP request is generated.
[0323] Specific behavior:
[0324] The terminal sends the prompt ID to the server.
[0325] Step 10:
[0326] The server retrieves prompt details from the database. As input, it contains the prompt ID. As output, it generates the prompt details.
[0327] Specific behavior:
[0328] The server retrieves the details of the corresponding prompt from the database.
[0329] Step 11:
[0330] The server sends the details to the terminal. As input, it contains the prompt details. As output, it generates an HTTP response.
[0331] Specific behavior:
[0332] The server sends the details of the prompt to the terminal.
[0333] Step 12:
[0334] The terminal displays the details to the user. As input, it contains the details from the server. As output, it generates a web page that is displayed in the user's browser.
[0335] Specific behavior:
[0336] The terminal will display detailed information about "Python projects for beginners."
[0337] Step 13:
[0338] The user clicks the download button. The input contains the prompt data. The output generates the data to be sent to the device.
[0339] Specific behavior:
[0340] The user clicks the "Download" button to retrieve the prompt data.
[0341] Step 14:
[0342] The device sends a download request to the server, which includes the prompt details as input, and generates an HTTP request as output.
[0343] Specific behavior:
[0344] The terminal sends a download request to the server.
[0345] Step 15:
[0346] The server sends prompt data to the terminal. As input, it contains prompt details. As output, it generates prompt data.
[0347] Specific behavior:
[0348] The server sends the prompt data to the terminal.
[0349] Step 16:
[0350] The terminal saves the data and displays a completion message to the user. Prompt data is included as input. A save completion message is generated as output.
[0351] Specific behavior:
[0352] The terminal saves the downloaded prompt data and displays a message to the user saying "download complete."
[0353] (Application example 1)
[0354] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0355] In the modern advertising industry, there is a need to quickly generate, evaluate, and optimize effective advertising creatives. However, the process of generating advertising creatives requires a lot of time and resources, making it difficult to establish an effective feedback loop. This makes it difficult to maximize the performance of advertising campaigns.
[0356] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0357] In this invention, the server includes means for receiving input data generated by a user, a database for storing the input data, means for searching for the input data stored in the database, means for allowing the user to download or use the input data, means for using a generative AI model to generate prompts for advertising creatives, means for sharing the generated prompts for advertising creatives within a team, and means for evaluating advertising effectiveness based on the prompts and storing the evaluation data in a database, thereby enabling advertising creatives to be quickly generated, evaluated, and shared.
[0358] "User" means a person or entity that utilizes the System to generate, evaluate, and share Input Data.
[0359] "Input Data" is text data that includes user-generated advertising creative and prompts.
[0360] The "database" is a storage device for storing and managing the input data and evaluation data.
[0361] "Generative AI model" refers to artificial intelligence technology that generates ad creatives based on user-entered prompts.
[0362] A "prompt" is a set of instructions or input data that a generative AI model uses to create advertising creative.
[0363] "Ad creative" refers to the marketing content, such as text, images, and videos, used in an advertising campaign.
[0364] "Evaluation Data" means performance metrics such as click rates and conversion rates that indicate the effectiveness of the prompts generated and used.
[0365] A "subscription plan" is a fee plan for a user to continue using the system, and may include various benefits.
[0366] "Payment Information" means payment instruments such as credit card information or bank account information used to process fees for Subscription Plans.
[0367] A "payment gateway" is a system that processes payment information and executes payments.
[0368] "Share with team" refers to sharing the generated ad creative prompt with other users involved in the same project or campaign.
[0369] The present invention is a system for effectively creating, sharing, and evaluating advertising creatives. The system receives user-generated input data and implements a series of processes to store, search, share, and evaluate it. Specifically, it uses a generative AI model to generate advertising creatives based on prompts, collects evaluation data, and optimizes them.
[0370] System Overview
[0371] The system includes the following main components:
[0372] 1. Hardware: Smartphone (iOS or ANDROID®), smart glasses (Google® Glass®, etc.).
[0373] 2. Software:
[0374] Front-end: Building the user interface using React Native.
[0375] Backend: Node.js and Express are used to realize server-side logic.
[0376] Database: MongoDB is used to store input and evaluation data.
[0377] Generative AI model: OpenAI® GPT is used to generate prompts for ad creative.
[0378] System Operation
[0379] 1. Prompt creation: The user enters a prompt for the ad creative through a dedicated application. For example, the user may enter, "Please create an ad copy for our new spring products."
[0380] 2. Prompt sending and processing: The prompt entered by the user is sent from the device to the server, which passes it to a generative AI model (OpenAI GPT) to generate ad copy.
[0381] 3. Sharing generated prompts: The generated ad copy is stored in a database and shared within the team via a link or QR code. Team members can access it in real time via their smartphones or smart glasses.
[0382] 4. Evaluation of advertising effectiveness: Once the generated advertising creative is used, evaluation data such as click-through rate and conversion rate are automatically collected. This data is stored in a database and can be viewed by users.
[0383] 5. Feedback of rating data: Rating data is fed back to prompt creators through the system and used to optimize advertising creatives.
[0384] Specific examples
[0385] For example, a marketer might enter:
[0386] "Write advertising copy for our new spring products."
[0387] The generative AI model then creates ad copy such as "Check out the new spring fashions now! Special offers!", which is then saved in a database and shared with the team. The generated ad copy is then used in actual campaigns, and evaluation data such as click-through rates and conversion rates is collected. This data is then fed back to the prompt creators to help them create future prompts.
[0388] In this way, the system consistently supports the process from the creation to evaluation of advertising creatives, enabling the realization of effective marketing campaigns.
[0389] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0390] Step 1:
[0391] The user inputs a prompt for the advertising creative. The user launches a dedicated application and inputs a prompt such as, "Please create advertising copy for our new spring products." The input data is sent from the device to the server.
[0392] Step 2:
[0393] The server receives the input data. The server receives the prompt sent by the user, validates its contents, and saves the input data to the database after confirming that it is valid.
[0394] Step 3:
[0395] The server uses the generative AI model to generate ad creative. Specifically, the server passes the prompt text saved earlier to the generative AI model (OpenAI GPT) and instructs it to generate ad copy. The AI model generates ad copy such as "Check out the new spring fashion now! Special offers!" This generated data is returned to the server.
[0396] Step 4:
[0397] The server stores the generated ad copy in a database. The ad copy received from the generative AI model is stored in a database for future searching and sharing. A message is sent to the device to confirm that the copy has been saved.
[0398] Step 5:
[0399] The device notifies the user of the generated ad copy and generates a sharing link. The device receives a save completion message from the server and notifies the user that the ad copy has been generated. At the same time, it generates a link or QR code for sharing the ad copy within the team and provides it to the user.
[0400] Step 6:
[0401] The user uses the generated ad copy to run an advertising campaign. The user uses the generated ad copy to launch a campaign on various advertising platforms. The user monitors the effectiveness of the campaign and makes adjustments as necessary.
[0402] Step 7:
[0403] The server collects advertising effectiveness data and stores it in a database. After an advertising campaign is run, effectiveness data such as click-through rates and conversion rates are automatically collected. This data is sent to the server and stored in a database.
[0404] Step 8:
[0405] The server provides feedback on the evaluation data to the prompt creator, who then visualizes the collected evaluation data and provides it to the prompt creator. This allows users to understand the effectiveness of the ad creative and helps them create prompts for the next time.
[0406] Through these steps, we provide a system that consistently supports the process from generating advertising creatives to evaluating them, enabling the realization of effective marketing campaigns.
[0407] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0408] This invention provides a system that allows users to efficiently create, share, and evaluate prompts that they input to AI, and also recognizes user emotions to improve system functionality. Below, the system program and its processing are explained in natural language.
[0409] Creating and posting prompts
[0410] 1. Sign up as a prompt contributor
[0411] When a user accesses the sign-up page, the terminal displays an input form. The user enters their name, email address, and password and clicks the sign-up button. The terminal sends the input information to the server, which verifies it and stores it in a database. A completion message is sent from the server to the terminal and displayed to the user.
[0412] 2. Create a prompt
[0413] When a user logs in and accesses the dashboard, the terminal displays a prompt creation form. The user enters the prompt details (title, description, content) and clicks the submit button. The entered information is sent from the terminal to the server, where it is validated and saved in the database. A save completion message is sent to the terminal and displayed.
[0414] 3. Managing prompts
[0415] When a user accesses the dashboard to manage the prompts posted by the user, the terminal requests the prompt information from the server, which retrieves the relevant prompt information from the database and sends it to the terminal, which then displays it to the user.
[0416] Find and download prompts
[0417] 1. Search for prompts
[0418] When a user accesses the search page, the terminal displays a search box. The user enters search keywords and clicks the search button. The search keywords are sent from the terminal to the server, and the server searches the database for the corresponding prompt and sends the results to the terminal. The terminal then displays the search results to the user.
[0419] 2. View and download prompt details
[0420] When the user selects a prompt they are interested in, the terminal sends the prompt ID to the server. The server retrieves the details of the prompt from the database and sends them to the terminal. The details are displayed to the user, and when the user clicks the download button, a download request is sent from the terminal to the server and the prompt data is sent to the terminal. The data is saved and a completion message is displayed to the user.
[0421] Prompt evaluation and feedback
[0422] 1. Evaluate the prompt
[0423] When a user accesses the rating page, the terminal displays a rating input form. The user enters rating data and clicks the submit button. The rating data is sent from the terminal to the server, where it is stored in a database. A rating completion message is sent to the terminal and displayed.
[0424] 2. Viewing Feedback
[0425] When a user wants to see feedback for a specific prompt, the prompt ID is sent from the device to the server. The server retrieves the prompt's rating and feedback from the database and sends it to the device. The retrieved feedback information is then displayed to the user.
[0426] Subscriptions and Advertising
[0427] 1. Subscription Registration
[0428] When a user visits the subscription page, selects a plan, and enters payment information, the terminal sends it to the server, which then forwards the payment information to the payment gateway for processing, receives the result, and updates the subscription status in the database. A registration completion message is sent to the terminal and displayed to the user.
[0429] 2. Display of advertisements
[0430] When a user views a free prompt, the device sends the prompt ID currently displayed to the server. The server retrieves advertising data related to the prompt from the database and sends it to the device. The advertisement is then displayed to the user.
[0431] Emotion engine that recognizes user emotions
[0432] 1. Acquiring Emotion Data
[0433] When a user uses the system, the device's built-in camera and microphone are used to collect the user's facial expressions and voice data. The device then sends this data to the emotion engine, which then analyzes the user's emotions. The analyzed emotion data is then sent from the device to the server, which stores it in a database.
[0434] 2. Customize prompts based on emotional data
[0435] The server customizes the search results for prompts based on the emotional data recognized by the emotion engine. For example, if the user is feeling stressed, prompts that help the user relax will be displayed preferentially. The device then displays the customized search results to the user.
[0436] 3. Adjusting suggestion prompts
[0437] The server adjusts the prompts it proposes to the user based on the emotion data recognized by the emotion engine. For example, if the user is feeling happy, it proposes a challenging prompt. The terminal displays the adjusted suggestion prompt to the user.
[0438] In this way, the present invention further enhances the user experience by recognizing the user's emotions and improving system functionality.
[0439] The processing flow will be explained below.
[0440] Emotion engine that recognizes user emotions
[0441] Acquiring emotion data
[0442] Step 1:
[0443] When a user uses the system, facial expressions and voice data are collected using the camera and microphone built into the device.
[0444] Step 2:
[0445] The facial expression and voice data collected by the device is sent to the emotion engine.
[0446] Step 3:
[0447] The emotion engine analyzes this data and identifies the user's emotion.
[0448] Step 4:
[0449] The emotion engine analyzes the emotion data and sends it to the device.
[0450] Step 5:
[0451] The emotion data received by the terminal is transmitted to the server.
[0452] Step 6:
[0453] The server stores the emotion data in a database.
[0454] Customize prompts based on sentiment data
[0455] Step 1:
[0456] The user searches for a prompt.
[0457] Step 2:
[0458] The terminal transmits the user's emotion data to the server.
[0459] Step 3:
[0460] The server uses the emotion data to search a database for prompts that match the user's current emotional state.
[0461] Step 4:
[0462] For example, if the user is feeling stressed, the server may prioritize prompts that help the user relax.
[0463] Step 5:
[0464] The server sends the customized search results to the device.
[0465] Step 6:
[0466] The terminal displays the search results to the user.
[0467] Adjusting suggestion prompts
[0468] Step 1:
[0469] The emotion engine analyzes the user's emotion data.
[0470] Step 2:
[0471] The terminal transmits the user's emotion data to the server.
[0472] Step 3:
[0473] The server generates a list based on the emotion data to suggest optimal prompts to the user.
[0474] Step 4:
[0475] For example, if the user is feeling happy, the server will include challenging prompts in the list.
[0476] Step 5:
[0477] The server sends a list of suggested prompts to the terminal.
[0478] Step 6:
[0479] The terminal displays a suggestion prompt to the user.
[0480] Creating and posting prompts
[0481] Prompt Contributor Sign-Up
[0482] Step 1:
[0483] A user visits the sign-up page.
[0484] Step 2:
[0485] The device displays the input form.
[0486] Step 3:
[0487] The user enters their name, email address, and password and clicks the Sign Up button.
[0488] Step 4:
[0489] The terminal sends the input information to the server.
[0490] Step 5:
[0491] The server validates the input information and stores it in a database.
[0492] Step 6:
[0493] The server sends a sign-up completion message to the terminal.
[0494] Step 7:
[0495] The terminal displays a completion message to the user.
[0496] Creating a Prompt
[0497] Step 1:
[0498] A user logs in and accesses the dashboard.
[0499] Step 2:
[0500] The terminal displays the prompt creation form.
[0501] Step 3:
[0502] The user enters the prompt details (title, description, content) and clicks the submit button.
[0503] Step 4:
[0504] The terminal sends the input information to the server.
[0505] Step 5:
[0506] The server validates the input information and stores it in a database.
[0507] Step 6:
[0508] The server sends a save completion message to the terminal.
[0509] Step 7:
[0510] The terminal displays a completion message to the user.
[0511] Managing Prompts
[0512] Step 1:
[0513] A user visits a dashboard.
[0514] Step 2:
[0515] The terminal requests prompt information for the currently logged-in user from the server.
[0516] Step 3:
[0517] The server retrieves the corresponding prompt information from the database and sends it to the terminal.
[0518] Step 4:
[0519] The terminal displays the obtained prompt information to the user.
[0520] Find and download prompts
[0521] Search prompts
[0522] Step 1:
[0523] A user visits a search page.
[0524] Step 2:
[0525] Your device will display a search box.
[0526] Step 3:
[0527] The user enters search keywords and clicks the search button.
[0528] Step 4:
[0529] The device sends the search keywords to the server.
[0530] Step 5:
[0531] The server searches the database for prompts based on the received keywords.
[0532] Step 6:
[0533] The server sends the search results to the terminal.
[0534] Step 7:
[0535] The terminal displays the search results to the user.
[0536] View and download prompt details
[0537] Step 1:
[0538] The user selects the prompt of interest from the search results.
[0539] Step 2:
[0540] The device sends the ID of the selected prompt to the server.
[0541] Step 3:
[0542] The server retrieves the detailed information of the corresponding prompt from the database and sends it to the terminal.
[0543] Step 4:
[0544] The terminal displays the detailed information to the user.
[0545] Step 5:
[0546] The user clicks the download button.
[0547] Step 6:
[0548] The device sends a download request to the server.
[0549] Step 7:
[0550] The server sends prompt data to the terminal.
[0551] Step 8:
[0552] The terminal saves the data and displays a completion message to the user.
[0553] Prompt evaluation and feedback
[0554] Evaluate prompts
[0555] Step 1:
[0556] A user visits the ratings page.
[0557] Step 2:
[0558] The terminal displays the evaluation input form.
[0559] Step 3:
[0560] The user enters the evaluation data and clicks the submit button.
[0561] Step 4:
[0562] The terminal transmits the evaluation data to the server.
[0563] Step 5:
[0564] The server stores the rating data in a database.
[0565] Step 6:
[0566] The server sends an evaluation completion message to the terminal.
[0567] Step 7:
[0568] The terminal displays a completion message to the user.
[0569] View Feedback
[0570] Step 1:
[0571] A user visits the prompt details page.
[0572] Step 2:
[0573] The device sends the prompt ID to the server.
[0574] Step 3:
[0575] The server retrieves the evaluation and feedback for the prompt from the database and sends it to the terminal.
[0576] Step 4:
[0577] The feedback information acquired by the terminal is displayed to the user.
[0578] Subscriptions and Advertising
[0579] Subscribe
[0580] Step 1:
[0581] A user visits the subscriptions page.
[0582] Step 2:
[0583] The device will display the subscription plan and payment form.
[0584] Step 3:
[0585] The user selects a plan, enters payment information, and clicks the Sign Up button.
[0586] Step 4:
[0587] The terminal sends the payment information to the server.
[0588] Step 5:
[0589] The server forwards the payment information to the payment gateway.
[0590] Step 6:
[0591] The server receives the payment result and updates the subscription status in the database.
[0592] Step 7:
[0593] The server sends a registration completion message to the terminal.
[0594] Step 8:
[0595] The terminal displays a completion message to the user.
[0596] Displaying ads
[0597] Step 1:
[0598] The user views a free prompt.
[0599] Step 2:
[0600] The terminal sends the prompt ID currently being displayed to the server.
[0601] Step 3:
[0602] The server retrieves advertising data related to the prompt from a database.
[0603] Step 4:
[0604] The server transmits the advertisement data to the terminal.
[0605] Step 5:
[0606] The terminal displays the advertisement data to the user.
[0607] Example 2
[0608] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0609] Conventional AI-generated prompt systems lack the ability to efficiently manage, share, and evaluate user-entered data. Furthermore, they lack the ability to recognize user emotions and optimize the system, resulting in a poor user experience. In particular, they face challenges in providing content that adapts to stressful situations and different emotional states.
[0610] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for receiving input data generated by a user, a database for storing the input data, means for searching for input data stored in the database, means for allowing the user to download or use the input data, means for collecting emotion data from an input device built into the terminal to recognize the user's emotion, emotion engine means for analyzing the emotion data, and means for customizing search results and suggested content based on the emotion data. This enables the user to receive appropriate content according to their emotional state, improving the user experience.
[0611] "User" means any individual or entity that utilizes the System to create, view, and evaluate Input Data.
[0612] "Input Data" means user-generated data, such as text, images, and audio, that is processed and stored by the system.
[0613] A "database" is a storage system for organizing and storing input data and related information, with search and retrieval capabilities.
[0614] The "receiving means" is a function that allows the server to receive input data sent from the user.
[0615] The "storage means" is a function for storing received input data in a database.
[0616] "Search means" refers to a function for searching input data in a database based on specific conditions.
[0617] "Downloading means" refers to a function that allows a user to download input data stored in the database to their own terminal.
[0618] "Means of use" refers to functions that allow a user to perform operations such as viewing, editing, and evaluating saved input data.
[0619] "Emotion data" refers to information about the user's emotional state analyzed from their facial expressions and voice.
[0620] An "emotion engine" is software or hardware that analyzes collected emotion data to determine a user's current emotional state.
[0621] "Customization tools" refers to functionality for tailoring search results and suggested content based on the emotional state identified by the emotion engine.
[0622] "Payment Gateway" means a system for processing user-entered payment information and updating subscription status.
[0623] "Subscription Plan" means a service contract plan that a User can select and that provides certain benefits.
[0624] "Benefit provision means" refers to a function for providing benefits to users based on a subscription plan.
[0625] "Rating data" refers to information about the ratings that users give to other prompts.
[0626] The "display means" refers to a function for visually presenting collected information such as emotion data and evaluation data to the user.
[0627] The present invention provides a system for efficiently creating, sharing, and rating prompts that users input to AI models, and for recognizing user emotions to improve system functionality. Specific embodiments for implementing the present invention will now be described.
[0628] Overall system overview
[0629] This system mainly consists of a server, user terminals, a database, and an emotion engine. The server receives, stores, searches, downloads, and manages ratings of input data. The user terminal creates prompts, searches, downloads, and collects ratings and emotion data. The database manages input data, rating data, and subscription information. The emotion engine analyzes the user's emotional state and adjusts the functions of the entire system.
[0630] Hardware and Software Used
[0631] Server: The server is built using web server software (e.g., Apache, Nginx) and a backend framework (e.g., Node.js, Django). A database system (e.g., MongoDB, PostgreSQL) is also used for data processing and storage management.
[0632] Terminal: User terminals are devices such as PCs, smartphones, and tablets. These terminals communicate with the server via a web browser and provide functionality using front-end technologies (e.g., HTML, CSS, JavaScript®).
[0633] Emotion Engine: The emotion engine is built using AI models (e.g., TENSORFLOW®, PyTorch) to analyze the user's facial and voice data.
[0634] Creating and sharing prompts
[0635] A user accesses the sign-up page using a device, enters the required information into the sign-up form, and sends it to the server, which validates the information and stores it in a database. Once the sign-up is complete, the user can log in and access the dashboard.
[0636] The dashboard displays a prompt creation form, where the user enters the title, description, and content of the prompt and clicks the submit button. The terminal sends the prompt data to the server, which validates it and stores it in the database.
[0637] Find and download prompts
[0638] When a user accesses the search page, the terminal displays a search form, and the user enters keywords to perform a search. The server searches the database based on the keywords and sends the results to the terminal. The user can select prompts of interest from the search results, and view and download detailed information.
[0639] Prompt evaluation and feedback
[0640] Users enter ratings for the prompts and send them to the server, which stores the ratings in a database and makes them available for other users to view.
[0641] User Emotion Recognition
[0642] While a user is using the system, the device's built-in camera and microphone collect emotional data. The emotion engine analyzes this data and sends the results to the server. The server then customizes search results and suggestions based on the emotional data to provide content that is appropriate for the user.
[0643] Examples of concrete examples and prompts
[0644] For example, if a user were to create a "Research prompt on new AI technologies," they would enter the following information:
[0645] Title: "Research into new AI technologies"
[0646] Description: "Dig deep into the latest trends and applications of AI technology"
[0647] What it is: "Providing insights into cutting-edge AI techniques using generative AI models."
[0648] Example prompts to be input to the generative AI model:
[0649] "Topic: Safety of self-driving cars"
[0650] Description: "Use AI to analyze safety issues associated with the rise of self-driving cars."
[0651] In this way, the present invention recognizes user emotions and improves system functionality, thereby further enhancing the user experience.
[0652] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0653] Creating and posting prompts
[0654] Step 1: Sign-up process
[0655] 1. The terminal displays an input form.
[0656] Input: The user visits the sign-up page.
[0657] Data processing: Rendering input forms using HTML and CSS.
[0658] Output: The user is presented with a sign-up form.
[0659] 2. The user enters and submits the information.
[0660] Input: A user enters their name, email address, and password and clicks the Sign Up button.
[0661] Data processing: Convert the input data into JSON format using JavaScript and send it to the server.
[0662] Output: Data is sent to the server.
[0663] 3. The server validates the data.
[0664] Input: User information sent from the device in JSON format.
[0665] Data processing: Validate the data using the validation library.
[0666] Output: If validation is successful, instructions to save the data to the database.
[0667] 4. The server stores the data in a database.
[0668] Input: Successfully verified user information.
[0669] Data processing: Save data to a database using SQL or NoSQL commands.
[0670] Output: A successful save message is generated.
[0671] 5. The server sends a completion message.
[0672] Input: Save successful message.
[0673] Data processing: Convert the message into JSON format and send it to the device.
[0674] Output: A completion message is displayed on the terminal.
[0675] Step 2: The prompt creation process
[0676] 1. A user visits the dashboard.
[0677] Input: Dashboard access after successful login.
[0678] Data processing: Dashboard HTML and JavaScript are loaded.
[0679] Output: The user sees the dashboard.
[0680] 2. The user enters and submits the prompt.
[0681] Enter: The user enters the prompt title, description, and content and clicks the submit button.
[0682] Data processing: Convert the input data into JSON format using JavaScript and send it to the server.
[0683] Output: Data is sent to the server.
[0684] 3. The server validates the data.
[0685] Input: Prompt information sent from the terminal in JSON format.
[0686] Data processing: Validate the data using the validation library.
[0687] Output: If validation is successful, instructions to save the data to the database.
[0688] 4. The server stores the data in a database.
[0689] Input: The prompt data that was successfully validated.
[0690] Data processing: Save data to a database using SQL or NoSQL commands.
[0691] Output: A successful save message is generated.
[0692] 5. The server sends a completion message.
[0693] Input: Save successful message.
[0694] Data processing: Convert the message into JSON format and send it to the device.
[0695] Output: A completion message is displayed on the terminal.
[0696] Step 3: Prompt Management Process
[0697] 1. A user visits the dashboard.
[0698] Input: A user visits a dashboard.
[0699] Data processing: Dashboard HTML and JS are loaded.
[0700] Output: The dashboard is displayed to the user.
[0701] 2. The terminal requests prompt information from the server.
[0702] Input: Request from the dashboard.
[0703] Data processing: The server receives the request.
[0704] Output: A request is sent to the server.
[0705] 3. The server retrieves the prompt information from the database.
[0706] Input: A query based on the user ID.
[0707] Data manipulation: Execute queries using SQL and NoSQL commands.
[0708] Output: The prompt information is retrieved.
[0709] 4. The server sends the prompt information to the terminal.
[0710] Input: The retrieved prompt information.
[0711] Data processing: Convert data into JSON format and send it to the device.
[0712] Output: Prompt information is sent to the terminal.
[0713] 5. The terminal will display the prompt information.
[0714] Input: Prompt information received from the server.
[0715] Data Manipulation: Rendering prompt information using HTML and JavaScript.
[0716] Output: The prompt information is displayed to the user.
[0717] Find and download prompts
[0718] Step 1: Prompt search process
[0719] 1. The user visits the search page.
[0720] Input: Access to the search page.
[0721] Data processing: HTML and JS for the search page are loaded.
[0722] Output: The search box is displayed to the user.
[0723] 2. The user enters a search keyword and submits it.
[0724] Input: When a user types keywords into the search box and clicks the search button.
[0725] Data processing: Convert input data into JSON format and send it to the server.
[0726] Output: Data is sent to the server.
[0727] 3. The server performs a lookup in the database.
[0728] Input: Search keyword.
[0729] Data manipulation: Perform searches using SQL or NoSQL commands in the database.
[0730] Output: Search results are retrieved.
[0731] 4. The server sends the search results to the terminal.
[0732] Input: Search results.
[0733] Data processing: Convert data into JSON format and send it to the terminal.
[0734] Output: The results are sent to the terminal.
[0735] 5. The device will display the search results.
[0736] Input: Search results received from the server.
[0737] Data processing: Rendering search results using HTML and JavaScript.
[0738] Output: Search results are displayed to the user.
[0739] Step 2: Prompt details and download process
[0740] 1. The user selects a prompt.
[0741] Input: Select the prompt from the search results.
[0742] Data processing: The selected prompt ID is retrieved.
[0743] Output: The prompt ID is sent to the server.
[0744] 2. The device sends the prompt ID to the server.
[0745] Input: The selected prompt ID.
[0746] Data processing: Convert the prompt ID into JSON format and send it to the server.
[0747] Output: The prompt ID is sent to the server.
[0748] 3. The server retrieves the details from the database.
[0749] Input: A query based on the prompt ID.
[0750] Data manipulation: Execute queries using SQL and NoSQL commands.
[0751] Output: The prompt details are retrieved.
[0752] 4. The server sends the detailed information to the terminal.
[0753] Input: The retrieved prompt details.
[0754] Data processing: Convert data into JSON format and send it to the terminal.
[0755] Output: Detailed information is sent to the terminal.
[0756] 5. The terminal will display detailed information.
[0757] Input: The details received from the server.
[0758] Data manipulation: Render detailed information using HTML and JavaScript.
[0759] Output: Detailed information is displayed to the user.
[0760] 6. The user performs the download.
[0761] Input: User clicks the download button.
[0762] Data processing: Send a download request to the server.
[0763] Output: Prompt data is sent to the terminal and saved.
[0764] (Application example 2)
[0765] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0766] While existing systems can manage and share user-generated input data, they lack the ability to customize it based on the user's emotional state. Furthermore, there is a lack of systems that can recognize the user's emotions and provide appropriate feedback and suggestions. This can result in a lack of improvement in the user experience and a decline in the value of the system.
[0767] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0768] In this invention, the server includes means for receiving input data generated by a user, a database for storing the input data, means for searching for input data stored in the database, means for allowing the user to download or use the input data, means for recognizing and analyzing the user's emotions, means for customizing prompts based on the analyzed emotional data, and means for providing the customized prompts to the user, thereby enabling prompts to be created or suggested according to the user's emotional state, thereby improving the user experience.
[0769] "Input data" refers to user-generated information such as text, audio, and images.
[0770] "Database" refers to a system for efficiently storing and managing input data and related information.
[0771] "Search means" refers to the function of searching for input data in a database based on specific keywords or conditions.
[0772] "Downloading means" refers to a function for obtaining the input data required by the user onto his / her own terminal.
[0773] "User emotion" refers to the emotional and mental state expressed by the user, and is primarily analyzed from facial expressions and voice data.
[0774] "Means for analyzing" refers to algorithms and techniques for analyzing the user's emotional data and generating the results.
[0775] "Means of customization" refers to the ability to tailor prompts and suggestions based on analyzed emotional data.
[0776] "Means for providing" refers to the functionality for presenting customized prompts and suggestions to the user.
[0777] To implement this invention, it is necessary to build a system that receives, stores, and manages user-generated input data. This system consists of terminals, a server, and software operated by these.
[0778] First, the server receives input data generated by the user using a terminal. The terminal can be a device such as a smartphone or a head-mounted display. Next, the input data is stored in a database by the server. The database is a system for processing large amounts of data, and a relational database management system such as MySQL (registered trademark) or PostgreSQL is used.
[0779] Users can search the database via their terminals to retrieve stored input data. This search function is implemented using a search engine such as ElasticSearch (registered trademark).
[0780] Furthermore, the system is equipped with a function to recognize and analyze the user's emotions. This function is achieved by capturing the user's facial expressions and voice data using the device's camera and microphone, and analyzing this data using a deep learning model. Machine learning frameworks such as Keras are used for emotion analysis. The analyzed emotion data is sent to a server and stored in a database.
[0781] The server customizes prompts based on this emotional data and provides them to the user. For example, customization can be done by preferentially displaying prompts that will help the user relax if they are feeling stressed. As a specific example, the following prompt sentences can be input into the generative AI model:
[0782] Example prompt sentence:
[0783] If the user is feeling stressed, create a prompt that offers a video of a relaxing getaway.
[0784] In this way, prompts are dynamically adjusted according to the user's emotional state, resulting in a more personalized user experience. This has potential applications in a variety of areas, such as supporting relaxation and improving safety while driving.
[0785] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0786] Step 1:
[0787] The user generates and sends input data using a terminal. The user generates data such as text, audio, or images and sends it to the server through the terminal. The input data is sent from the terminal to the server, and the next process begins.
[0788] Step 2:
[0789] The server stores the input data it receives in a database. The server first validates the data it receives to ensure it is in the proper format. It then uses a database management system to store the data. The input is the data sent by the user and the output is the record in the database.
[0790] Step 3:
[0791] A user uses a terminal to search a database. The server receives the search query and searches for corresponding data in the database using a search engine. The search results are sent from the server to the terminal and displayed to the user. The input is the search query and the output is the search result data.
[0792] Step 4:
[0793] The device uses a camera and microphone to collect facial and voice data from the user. These data are acquired in real time for emotion recognition. The input is the user's facial and voice data, and the output is to send these data to a server.
[0794] Step 5:
[0795] The server sends the received facial and voice data to the emotion analysis engine to recognize emotions. The emotion analysis engine uses a deep learning model to analyze emotions and generate results. The input is facial and voice data, and the output is analyzed emotion data.
[0796] Step 6:
[0797] The server customizes prompts based on the analyzed emotional data. The server selects appropriate prompts and suggestions depending on the user's emotional state. For example, if the user is feeling stressed, it will prioritize prompts that will help them relax. The input is the analyzed emotional data, and the output is customized prompts.
[0798] Step 7:
[0799] The server sends the customized prompt to the terminal and provides it to the user. The terminal receives the prompt and displays it on the screen or outputs it as speech. The input is the customized prompt, and the output is the prompt provided to the user.
[0800] Through this step, users can receive appropriate emotional prompts and entertainment content to maintain a relaxed state inside the self-driving vehicle.
[0801] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0802] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0803] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0804] [Second embodiment]
[0805] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0806] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0807] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0808] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0809] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0810] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0811] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0812] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0813] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0814] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0815] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0816] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0817] This invention provides a system that allows users to effectively create, share, and evaluate prompts to be input to AI. Below, the system program and its processing are explained in natural language.
[0818] Creating and posting prompts
[0819] 1. Sign up as a prompt contributor
[0820] When a user accesses the sign-up page, the terminal displays an input form. The user enters their name, email address, password, etc. and clicks the sign-up button. The terminal sends the input information to the server, which verifies it and stores it in a database. A completion message is sent from the server to the terminal and displayed to the user.
[0821] 2. Create a prompt
[0822] When a user logs in and accesses the dashboard, the terminal displays a prompt creation form. The user enters the prompt details and clicks the submit button. The input information is sent from the terminal to the server, where it is validated and saved in the database. A save completion message is sent to the terminal and displayed.
[0823] 3. Managing prompts
[0824] When a user accesses the dashboard to manage the prompts posted by the user, the terminal requests the prompt information from the server, which retrieves the relevant prompt information from the database and sends it to the terminal, which then displays it to the user.
[0825] Find and download prompts
[0826] 1. Search for prompts
[0827] When a user accesses the search page, the terminal displays a search box. The user enters search keywords and clicks the search button. The search keywords are sent from the terminal to the server, and the server searches the database for the corresponding prompt and sends the results to the terminal. The terminal then displays the search results to the user.
[0828] 2. View and download prompt details
[0829] When the user selects a prompt they are interested in, the terminal sends the prompt ID to the server. The server retrieves the details of the prompt from the database and sends them to the terminal. The details are displayed to the user, and when the user clicks the download button, a download request is sent from the terminal to the server and the prompt data is sent to the terminal. The data is saved and a completion message is displayed to the user.
[0830] Prompt evaluation and feedback
[0831] 1. Evaluate the prompt
[0832] The user accesses a page for entering ratings in response to the prompt they used and enters the rating data. The rating data is sent from the terminal to the server, where it is stored in a database. A rating completion message is sent to the terminal and displayed.
[0833] 2. Viewing Feedback
[0834] When a user wants to see feedback for a specific prompt, the prompt ID is sent from the device to the server. The server retrieves the prompt's rating and feedback from the database and sends it to the device. The retrieved feedback information is then displayed to the user.
[0835] Subscriptions and Advertising
[0836] 1. Subscription Registration
[0837] When a user visits the subscription page, selects a plan, and enters payment information, the terminal sends it to the server, which then forwards the payment information to the payment gateway for processing, receives the result, and updates the subscription status in the database. A registration completion message is sent to the terminal and displayed to the user.
[0838] 2. Display of advertisements
[0839] When a user views a free prompt, the device sends the prompt ID currently displayed to the server. The server retrieves advertising data related to the prompt from the database and sends it to the device. The advertisement is then displayed to the user.
[0840] The processing flow will be explained below.
[0841] Creating and posting prompts
[0842] Prompt Contributor Sign-Up
[0843] Step 1:
[0844] A user visits the sign-up page.
[0845] Step 2:
[0846] The device displays the input form.
[0847] Step 3:
[0848] The user enters their name, email address, and password and clicks the Sign Up button.
[0849] Step 4:
[0850] The terminal sends the input information to the server.
[0851] Step 5:
[0852] The server validates the input information and stores it in a database.
[0853] Step 6:
[0854] The server sends a sign-up completion message to the terminal.
[0855] Step 7:
[0856] The terminal displays a completion message to the user.
[0857] Creating a Prompt
[0858] Step 1:
[0859] A user logs in and accesses the dashboard.
[0860] Step 2:
[0861] The terminal displays the prompt creation form.
[0862] Step 3:
[0863] The user enters the prompt details (title, description, content) and clicks the submit button.
[0864] Step 4:
[0865] The terminal sends the input information to the server.
[0866] Step 5:
[0867] The server validates the input information and stores it in a database.
[0868] Step 6:
[0869] The server sends a save completion message to the terminal.
[0870] Step 7:
[0871] The terminal displays a completion message to the user.
[0872] Managing Prompts
[0873] Step 1:
[0874] A user visits a dashboard.
[0875] Step 2:
[0876] The terminal requests prompt information for the currently logged-in user from the server.
[0877] Step 3:
[0878] The server retrieves the corresponding prompt information from the database and sends it to the terminal.
[0879] Step 4:
[0880] The terminal displays the obtained prompt information to the user.
[0881] Find and download prompts
[0882] Search prompts
[0883] Step 1:
[0884] A user visits a search page.
[0885] Step 2:
[0886] Your device will display a search box.
[0887] Step 3:
[0888] The user enters search keywords and clicks the search button.
[0889] Step 4:
[0890] The device sends the search keywords to the server.
[0891] Step 5:
[0892] The server searches the database for prompts based on the received keywords.
[0893] Step 6:
[0894] The server sends the search results to the terminal.
[0895] Step 7:
[0896] The terminal displays the search results to the user.
[0897] View and download prompt details
[0898] Step 1:
[0899] The user selects the prompt of interest from the search results.
[0900] Step 2:
[0901] The device sends the ID of the selected prompt to the server.
[0902] Step 3:
[0903] The server retrieves the detailed information of the corresponding prompt from the database and sends it to the terminal.
[0904] Step 4:
[0905] The terminal displays the detailed information to the user.
[0906] Step 5:
[0907] The user clicks the download button.
[0908] Step 6:
[0909] The device sends a download request to the server.
[0910] Step 7:
[0911] The server sends prompt data to the terminal.
[0912] Step 8:
[0913] The terminal saves the data and displays a completion message to the user.
[0914] Prompt evaluation and feedback
[0915] Evaluate prompts
[0916] Step 1:
[0917] A user visits the ratings page.
[0918] Step 2:
[0919] The terminal displays the evaluation input form.
[0920] Step 3:
[0921] The user enters the evaluation data and clicks the submit button.
[0922] Step 4:
[0923] The terminal transmits the evaluation data to the server.
[0924] Step 5:
[0925] The server stores the rating data in a database.
[0926] Step 6:
[0927] The server sends an evaluation completion message to the terminal.
[0928] Step 7:
[0929] The terminal displays a completion message to the user.
[0930] View Feedback
[0931] Step 1:
[0932] A user visits the prompt details page.
[0933] Step 2:
[0934] The device sends the prompt ID to the server.
[0935] Step 3:
[0936] The server retrieves the evaluation and feedback for the prompt from the database and sends it to the terminal.
[0937] Step 4:
[0938] The feedback information acquired by the terminal is displayed to the user.
[0939] Subscriptions and Advertising
[0940] Subscribe
[0941] Step 1:
[0942] A user visits the subscriptions page.
[0943] Step 2:
[0944] The device will display the subscription plan and payment form.
[0945] Step 3:
[0946] The user selects a plan, enters payment information, and clicks the Sign Up button.
[0947] Step 4:
[0948] The terminal sends the payment information to the server.
[0949] Step 5:
[0950] The server forwards the payment information to the payment gateway.
[0951] Step 6:
[0952] The server receives the payment result and updates the subscription status in the database.
[0953] Step 7:
[0954] The server sends a registration completion message to the terminal.
[0955] Step 8:
[0956] The terminal displays a completion message to the user.
[0957] Displaying ads
[0958] Step 1:
[0959] The user views a free prompt.
[0960] Step 2:
[0961] The terminal sends the prompt ID currently being displayed to the server.
[0962] Step 3:
[0963] The server retrieves advertising data related to the prompt from a database.
[0964] Step 4:
[0965] The server transmits the advertisement data to the terminal.
[0966] Step 5:
[0967] The terminal displays the advertisement data to the user.
[0968] Example 1
[0969] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0970] Previous systems required cumbersome operations for managing, searching, rating, and providing feedback on user-generated prompts, making them difficult to use efficiently. Furthermore, they did not properly manage user feedback and ratings to improve the quality of prompts. Furthermore, they lacked a mechanism for displaying appropriate advertisements to free users.
[0971] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0972] In this invention, the server includes means for receiving input data generated by a user, database means for saving the input data, means for searching for input data saved in the database, means for a user to display information related to the input data, means for the user to download or use the input data, means for inputting a rating for the input data, means for saving the rating data in a database, means for displaying the rating data to other users, means for displaying advertisement data, and database means for handling the advertisement data, thereby enabling a user to consistently and efficiently perform processes from creating, sharing, and rating prompts to displaying advertisements.
[0973] "User" means any person or entity that uses the System to create, manage, rate, and search prompts.
[0974] "Input Data" refers to all data such as prompts, ratings, and feedback that a user provides to the system.
[0975] "Database" refers to a digital storage system for storing and managing the input data, evaluation data, and advertising data.
[0976] "Means of searching" refers to the function that allows the system to search input data in the database based on specific keywords or conditions.
[0977] The term "means for displaying information" refers to a function that enables the terminal to visually display to the user the input data and evaluation data acquired from the database.
[0978] "Means for downloading or making available" refers to the system's ability to obtain input data from the user and store it in a format that can be used later.
[0979] "Means for inputting ratings" refers to the functionality that allows a user to input and provide rating data in response to a particular prompt.
[0980] "Rating data" refers to the rating information entered by the user in response to a prompt.
[0981] "Advertising Data" refers to commercial information displayed in connection with a particular prompt or user action.
[0982] "Payment Gateway" refers to a system for processing a user's payment information.
[0983] "Subscription Plan" means a subscription-based plan selected by a User to access certain features of the System.
[0984] "Benefits" means any additional benefits or services provided to you under your Subscription Plan.
[0985] The present invention relates to a system that enables users to effectively create, share, and evaluate prompts to be input to AI. The system is composed of a server, a terminal, and a user. Specific embodiments of the system are described below.
[0986] System configuration
[0987] 1. Server
[0988] The server has the following functions:
[0989] Ability to receive user-generated input data
[0990] A database for storing input data
[0991] Ability to search input data stored in a database
[0992] A function that displays information related to the input data to the user
[0993] Ability to allow users to download or use input data
[0994] A function to input evaluations for input data
[0995] Ability to save evaluation data to a database
[0996] Ability to display rating data to other users
[0997] Ability to display advertising data
[0998] Database function for handling advertising data
[0999] Ability to manage subscription plans
[1000] A payment gateway to process your payment information
[1001] 2. Terminal
[1002] The terminal has the following functions:
[1003] Displaying the input form
[1004] Sending and receiving information to and from the server
[1005] Displaying information to the user
[1006] Download function
[1007] 3. Users
[1008] The user performs the following operations:
[1009] Sign up and log in
[1010] Creating a Prompt
[1011] Managing Prompts
[1012] Search prompts
[1013] View and download prompt details
[1014] Prompt evaluation and feedback
[1015] Subscribe
[1016] Viewing ads
[1017] Processing flow
[1018] Creating and posting prompts
[1019] A user visits the sign-up page and signs up by entering their name, email address, and password. The device sends this information to the server, which stores the user information in a database. The user then logs in and accesses the dashboard. They enter the prompt details in the prompt creation form and click the submit button. The device sends the input information to the server, which stores the prompt in a database.
[1020] As an example, suppose the user enters the following prompt text:
[1021] Create a new AI assistant character. Tell us its name, characteristics, and special abilities.
[1022] Find and download prompts
[1023] The user accesses the search page, enters search keywords, and clicks the search button. The device sends the search keywords to the server, which searches the database for relevant prompts and sends the results to the device. The user selects a specific prompt, displays details, and downloads the prompt data.
[1024] As an example, a user enters the following search keywords:
[1025] "Python Beginner Project"
[1026] Prompt evaluation and feedback
[1027] The user provides a rating for the prompt and sends the rating data through the terminal to the server, which stores the rating data in a database and displays it to other users.
[1028] Subscriptions and Advertising
[1029] Users select a plan on the subscription page, enter their payment information, and the payment is processed through the server via a payment gateway. Free users are shown relevant ads, and the ad data is managed by the server.
[1030] The above is an embodiment of the present invention, which allows users to efficiently manage, search, and rate prompts, and improves the overall system usage experience.
[1031] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1032] Creating and posting prompts
[1033] Step 1:
[1034] A user visits a sign-up page. As input, the user enters their name, email address, and password. As output, data is generated that is sent to the server.
[1035] Specific behavior:
[1036] A user accesses a sign-up page in a browser and enters the name "Taro Yamada," the email address "taro@example.com," and the password "mypassword."
[1037] Step 2:
[1038] The terminal displays a sign-up form. The input contains the HTML data of the form. The output generates a web page that is displayed to the user.
[1039] Specific behavior:
[1040] The terminal displays a sign-up form in the user's browser and provides the above input fields.
[1041] Step 3:
[1042] The user clicks the sign-up button. The input contains the user's input data. The output generates the data sent from the device to the server.
[1043] Specific behavior:
[1044] The user clicks the "Sign Up" button and the entered data is sent to the server.
[1045] Step 4:
[1046] The device sends input information to the server. The input contains the user's input data. The output generates an HTTP request that is sent to the server.
[1047] Specific behavior:
[1048] The device sends the data entered by the user, including the name, email address, and password, to the server.
[1049] Step 5:
[1050] The server validates the input information. Input includes the submitted user data. Output is stored in a database or an error message is sent to the terminal.
[1051] Specific behavior:
[1052] The server checks for duplicate email addresses and password strength, and if there are no problems, it saves the user information in the database. If there are duplicates, it returns an error message.
[1053] Step 6:
[1054] The server saves the user information in the database. It contains the validated user data as input and produces a save completion status as output.
[1055] Specific behavior:
[1056] The server saves the name, email address, and password in the database and generates a save completion status.
[1057] Step 7:
[1058] The server sends a completion message to the terminal, containing the save completion status as input, and an HTTP response as output.
[1059] Specific behavior:
[1060] The server sends a message to the terminal saying "sign-up complete."
[1061] Step 8:
[1062] The terminal displays a completion message to the user. As input, it contains the completion message from the server. As output, it generates a web page that is displayed in the user's browser.
[1063] Specific behavior:
[1064] The device will display "Sign-up complete."
[1065] Find and download prompts
[1066] Step 1:
[1067] A user visits a search page. The input includes the URL of the search page. The output is a search form.
[1068] Specific behavior:
[1069] A user accesses the search page in a browser and displays the search form.
[1070] Step 2:
[1071] The device displays a search box containing the HTML data of the search form as input, and a web page as output.
[1072] Specific behavior:
[1073] The device displays a search box in the user's browser.
[1074] Step 3:
[1075] The user inputs a search keyword. The input contains the search keyword. The output is generated as data to be sent to the terminal.
[1076] Specific behavior:
[1077] A user types "Python beginner projects" into the search box and clicks the search button.
[1078] Step 4:
[1079] The device sends search keywords to the server. The input contains the search keywords entered by the user. The output is an HTTP request.
[1080] Specific behavior:
[1081] The terminal transmits the search keywords to the server.
[1082] Step 5:
[1083] The server performs a search in the database. The input includes the search keywords and the database information. The output is the search results.
[1084] Specific behavior:
[1085] The server searches the database for prompts for "Python beginner projects" and produces the appropriate results.
[1086] Step 6:
[1087] The server sends the search results to the terminal. The search result data is included as input. An HTTP response is generated as output.
[1088] Specific behavior:
[1089] The server sends the search results to the terminal.
[1090] Step 7:
[1091] The terminal displays the search results to the user. The input includes the search result data from the server. The output is a web page that is displayed in the user's browser.
[1092] Specific behavior:
[1093] The device will display the search result with the title "Python projects for beginners" and the description.
[1094] Step 8:
[1095] The user selects a specific prompt. As input, it contains the prompt ID. As output, it generates the data to be sent to the server.
[1096] Specific behavior:
[1097] The user selects "Python projects for beginners" from the search results and clicks the Show details button.
[1098] Step 9:
[1099] The device sends the prompt ID to the server. As input, it contains the prompt ID selected by the user. As output, an HTTP request is generated.
[1100] Specific behavior:
[1101] The terminal sends the prompt ID to the server.
[1102] Step 10:
[1103] The server retrieves prompt details from the database. As input, it contains the prompt ID. As output, it generates the prompt details.
[1104] Specific behavior:
[1105] The server retrieves the details of the corresponding prompt from the database.
[1106] Step 11:
[1107] The server sends the details to the terminal. As input, it contains the prompt details. As output, it generates an HTTP response.
[1108] Specific behavior:
[1109] The server sends the details of the prompt to the terminal.
[1110] Step 12:
[1111] The terminal displays the details to the user. As input, it contains the details from the server. As output, it generates a web page that is displayed in the user's browser.
[1112] Specific behavior:
[1113] The terminal will display detailed information about "Python projects for beginners."
[1114] Step 13:
[1115] The user clicks the download button. The input contains the prompt data. The output generates the data to be sent to the device.
[1116] Specific behavior:
[1117] The user clicks the "Download" button to retrieve the prompt data.
[1118] Step 14:
[1119] The device sends a download request to the server, which includes the prompt details as input, and generates an HTTP request as output.
[1120] Specific behavior:
[1121] The terminal sends a download request to the server.
[1122] Step 15:
[1123] The server sends prompt data to the terminal. As input, it contains prompt details. As output, it generates prompt data.
[1124] Specific behavior:
[1125] The server sends the prompt data to the terminal.
[1126] Step 16:
[1127] The terminal saves the data and displays a completion message to the user. Prompt data is included as input. A save completion message is generated as output.
[1128] Specific behavior:
[1129] The terminal saves the downloaded prompt data and displays a message to the user saying "download complete."
[1130] (Application example 1)
[1131] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1132] In the modern advertising industry, there is a need to quickly generate, evaluate, and optimize effective advertising creatives. However, the process of generating advertising creatives requires a lot of time and resources, making it difficult to establish an effective feedback loop. This makes it difficult to maximize the performance of advertising campaigns.
[1133] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1134] In this invention, the server includes means for receiving input data generated by a user, a database for storing the input data, means for searching for the input data stored in the database, means for allowing the user to download or use the input data, means for using a generative AI model to generate prompts for advertising creatives, means for sharing the generated prompts for advertising creatives within a team, and means for evaluating advertising effectiveness based on the prompts and storing the evaluation data in a database, thereby enabling advertising creatives to be quickly generated, evaluated, and shared.
[1135] "User" means a person or entity that utilizes the System to generate, evaluate, and share Input Data.
[1136] "Input Data" is text data that includes user-generated advertising creative and prompts.
[1137] The "database" is a storage device for storing and managing the input data and evaluation data.
[1138] "Generative AI model" refers to artificial intelligence technology that generates ad creatives based on user-entered prompts.
[1139] A "prompt" is a set of instructions or input data that a generative AI model uses to create advertising creative.
[1140] "Ad creative" refers to the marketing content, such as text, images, and videos, used in an advertising campaign.
[1141] "Evaluation Data" means performance metrics such as click rates and conversion rates that indicate the effectiveness of the prompts generated and used.
[1142] A "subscription plan" is a fee plan for a user to continue using the system, and may include various benefits.
[1143] "Payment Information" means payment instruments such as credit card information or bank account information used to process fees for Subscription Plans.
[1144] A "payment gateway" is a system that processes payment information and executes payments.
[1145] "Share with team" refers to sharing the generated ad creative prompt with other users involved in the same project or campaign.
[1146] The present invention is a system for effectively creating, sharing, and evaluating advertising creatives. The system receives user-generated input data and implements a series of processes to store, search, share, and evaluate it. Specifically, it uses a generative AI model to generate advertising creatives based on prompts, collects evaluation data, and optimizes them.
[1147] System Overview
[1148] The system includes the following main components:
[1149] 1. Hardware: Smartphone (iOS or Android), smart glasses (e.g., Google Glass).
[1150] 2. Software:
[1151] Front-end: Building the user interface using React Native.
[1152] Backend: Node.js and Express are used to realize server-side logic.
[1153] Database: MongoDB is used to store input and evaluation data.
[1154] Generative AI model: Uses OpenAI GPT to generate prompts for ad creative.
[1155] System Operation
[1156] 1. Prompt creation: The user enters a prompt for the ad creative through a dedicated application. For example, the user may enter, "Please create an ad copy for our new spring products."
[1157] 2. Prompt sending and processing: The prompt entered by the user is sent from the device to the server, which passes it to a generative AI model (OpenAI GPT) to generate ad copy.
[1158] 3. Sharing generated prompts: The generated ad copy is stored in a database and shared with the team via a link or QR code, which team members can access in real time via their smartphones or smart glasses.
[1159] 4. Evaluation of advertising effectiveness: Once the generated advertising creative is used, evaluation data such as click-through rate and conversion rate are automatically collected. This data is stored in a database and can be viewed by users.
[1160] 5. Feedback of rating data: Rating data is fed back to prompt creators through the system and used to optimize advertising creatives.
[1161] Specific examples
[1162] For example, a marketer might enter:
[1163] "Write advertising copy for our new spring products."
[1164] The generative AI model then creates ad copy such as "Check out the new spring fashions now! Special offers!", which is then saved in a database and shared with the team. The generated ad copy is then used in actual campaigns, and evaluation data such as click-through rates and conversion rates is collected. This data is then fed back to the prompt creators to help them create future prompts.
[1165] In this way, the system consistently supports the process from the creation to evaluation of advertising creatives, enabling the realization of effective marketing campaigns.
[1166] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1167] Step 1:
[1168] The user inputs a prompt for the advertising creative. The user launches a dedicated application and inputs a prompt such as, "Please create advertising copy for our new spring products." The input data is sent from the device to the server.
[1169] Step 2:
[1170] The server receives the input data. The server receives the prompt sent by the user, validates its contents, and saves the input data to the database after confirming that it is valid.
[1171] Step 3:
[1172] The server uses the generative AI model to generate ad creative. Specifically, the server passes the prompt text saved earlier to the generative AI model (OpenAI GPT) and instructs it to generate ad copy. The AI model generates ad copy such as "Check out the new spring fashion now! Special offers!" This generated data is returned to the server.
[1173] Step 4:
[1174] The server stores the generated ad copy in a database. The ad copy received from the generative AI model is stored in a database for future searching and sharing. A message is sent to the device to confirm that the copy has been saved.
[1175] Step 5:
[1176] The device notifies the user of the generated ad copy and generates a sharing link. The device receives a save completion message from the server and notifies the user that the ad copy has been generated. At the same time, it generates a link or QR code for sharing the ad copy within the team and provides it to the user.
[1177] Step 6:
[1178] The user uses the generated ad copy to run an advertising campaign. The user uses the generated ad copy to launch a campaign on various advertising platforms. The user monitors the effectiveness of the campaign and makes adjustments as necessary.
[1179] Step 7:
[1180] The server collects advertising effectiveness data and stores it in a database. After an advertising campaign is run, effectiveness data such as click-through rates and conversion rates are automatically collected. This data is sent to the server and stored in a database.
[1181] Step 8:
[1182] The server provides feedback on the evaluation data to the prompt creator, who then visualizes the collected evaluation data and provides it to the prompt creator. This allows users to understand the effectiveness of the ad creative and helps them create prompts for the next time.
[1183] Through these steps, we provide a system that consistently supports the process from generating advertising creatives to evaluating them, enabling the realization of effective marketing campaigns.
[1184] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1185] This invention provides a system that allows users to efficiently create, share, and evaluate prompts that they input to AI, and also recognizes user emotions to improve system functionality. Below, the system program and its processing are explained in natural language.
[1186] Creating and posting prompts
[1187] 1. Sign up as a prompt contributor
[1188] When a user accesses the sign-up page, the terminal displays an input form. The user enters their name, email address, and password and clicks the sign-up button. The terminal sends the input information to the server, which verifies it and stores it in a database. A completion message is sent from the server to the terminal and displayed to the user.
[1189] 2. Create a prompt
[1190] When a user logs in and accesses the dashboard, the terminal displays a prompt creation form. The user enters the prompt details (title, description, content) and clicks the submit button. The entered information is sent from the terminal to the server, where it is validated and saved in the database. A save completion message is sent to the terminal and displayed.
[1191] 3. Managing prompts
[1192] When a user accesses the dashboard to manage the prompts posted by the user, the terminal requests the prompt information from the server, which retrieves the relevant prompt information from the database and sends it to the terminal, which then displays it to the user.
[1193] Find and download prompts
[1194] 1. Search for prompts
[1195] When a user accesses the search page, the terminal displays a search box. The user enters search keywords and clicks the search button. The search keywords are sent from the terminal to the server, and the server searches the database for the corresponding prompt and sends the results to the terminal. The terminal then displays the search results to the user.
[1196] 2. View and download prompt details
[1197] When the user selects a prompt they are interested in, the terminal sends the prompt ID to the server. The server retrieves the details of the prompt from the database and sends them to the terminal. The details are displayed to the user, and when the user clicks the download button, a download request is sent from the terminal to the server and the prompt data is sent to the terminal. The data is saved and a completion message is displayed to the user.
[1198] Prompt evaluation and feedback
[1199] 1. Evaluate the prompt
[1200] When a user accesses the rating page, the terminal displays a rating input form. The user enters rating data and clicks the submit button. The rating data is sent from the terminal to the server, where it is stored in a database. A rating completion message is sent to the terminal and displayed.
[1201] 2. Viewing Feedback
[1202] When a user wants to see feedback for a specific prompt, the prompt ID is sent from the device to the server. The server retrieves the prompt's rating and feedback from the database and sends it to the device. The retrieved feedback information is then displayed to the user.
[1203] Subscriptions and Advertising
[1204] 1. Subscription Registration
[1205] When a user visits the subscription page, selects a plan, and enters payment information, the terminal sends it to the server, which then forwards the payment information to the payment gateway for processing, receives the result, and updates the subscription status in the database. A registration completion message is sent to the terminal and displayed to the user.
[1206] 2. Display of advertisements
[1207] When a user views a free prompt, the device sends the prompt ID currently displayed to the server. The server retrieves advertising data related to the prompt from the database and sends it to the device. The advertisement is then displayed to the user.
[1208] Emotion engine that recognizes user emotions
[1209] 1. Acquiring Emotion Data
[1210] When a user uses the system, the device's built-in camera and microphone are used to collect the user's facial expressions and voice data. The device then sends this data to the emotion engine, which then analyzes the user's emotions. The analyzed emotion data is then sent from the device to the server, which stores it in a database.
[1211] 2. Customize prompts based on emotional data
[1212] The server customizes the search results for prompts based on the emotional data recognized by the emotion engine. For example, if the user is feeling stressed, prompts that help the user relax will be displayed preferentially. The device then displays the customized search results to the user.
[1213] 3. Adjusting suggestion prompts
[1214] The server adjusts the prompts it proposes to the user based on the emotion data recognized by the emotion engine. For example, if the user is feeling happy, it proposes a challenging prompt. The terminal displays the adjusted suggestion prompt to the user.
[1215] In this way, the present invention further enhances the user experience by recognizing the user's emotions and improving system functionality.
[1216] The processing flow will be explained below.
[1217] Emotion engine that recognizes user emotions
[1218] Acquiring emotion data
[1219] Step 1:
[1220] When a user uses the system, facial expressions and voice data are collected using the camera and microphone built into the device.
[1221] Step 2:
[1222] The facial expression and voice data collected by the device is sent to the emotion engine.
[1223] Step 3:
[1224] The emotion engine analyzes this data and identifies the user's emotion.
[1225] Step 4:
[1226] The emotion engine analyzes the emotion data and sends it to the device.
[1227] Step 5:
[1228] The emotion data received by the terminal is transmitted to the server.
[1229] Step 6:
[1230] The server stores the emotion data in a database.
[1231] Customize prompts based on sentiment data
[1232] Step 1:
[1233] The user searches for a prompt.
[1234] Step 2:
[1235] The terminal transmits the user's emotion data to the server.
[1236] Step 3:
[1237] The server uses the emotion data to search a database for prompts that match the user's current emotional state.
[1238] Step 4:
[1239] For example, if the user is feeling stressed, the server may prioritize prompts that help the user relax.
[1240] Step 5:
[1241] The server sends the customized search results to the device.
[1242] Step 6:
[1243] The terminal displays the search results to the user.
[1244] Adjusting suggestion prompts
[1245] Step 1:
[1246] The emotion engine analyzes the user's emotion data.
[1247] Step 2:
[1248] The terminal transmits the user's emotion data to the server.
[1249] Step 3:
[1250] The server generates a list based on the emotion data to suggest optimal prompts to the user.
[1251] Step 4:
[1252] For example, if the user is feeling happy, the server will include challenging prompts in the list.
[1253] Step 5:
[1254] The server sends a list of suggested prompts to the terminal.
[1255] Step 6:
[1256] The terminal displays a suggestion prompt to the user.
[1257] Creating and posting prompts
[1258] Prompt Contributor Sign-Up
[1259] Step 1:
[1260] A user visits the sign-up page.
[1261] Step 2:
[1262] The device displays the input form.
[1263] Step 3:
[1264] The user enters their name, email address, and password and clicks the Sign Up button.
[1265] Step 4:
[1266] The terminal sends the input information to the server.
[1267] Step 5:
[1268] The server validates the input information and stores it in a database.
[1269] Step 6:
[1270] The server sends a sign-up completion message to the terminal.
[1271] Step 7:
[1272] The terminal displays a completion message to the user.
[1273] Creating a Prompt
[1274] Step 1:
[1275] A user logs in and accesses the dashboard.
[1276] Step 2:
[1277] The terminal displays the prompt creation form.
[1278] Step 3:
[1279] The user enters the prompt details (title, description, content) and clicks the submit button.
[1280] Step 4:
[1281] The terminal sends the input information to the server.
[1282] Step 5:
[1283] The server validates the input information and stores it in a database.
[1284] Step 6:
[1285] The server sends a save completion message to the terminal.
[1286] Step 7:
[1287] The terminal displays a completion message to the user.
[1288] Managing Prompts
[1289] Step 1:
[1290] A user visits a dashboard.
[1291] Step 2:
[1292] The terminal requests prompt information for the currently logged-in user from the server.
[1293] Step 3:
[1294] The server retrieves the corresponding prompt information from the database and sends it to the terminal.
[1295] Step 4:
[1296] The terminal displays the obtained prompt information to the user.
[1297] Find and download prompts
[1298] Search prompts
[1299] Step 1:
[1300] A user visits a search page.
[1301] Step 2:
[1302] Your device will display a search box.
[1303] Step 3:
[1304] The user enters search keywords and clicks the search button.
[1305] Step 4:
[1306] The device sends the search keywords to the server.
[1307] Step 5:
[1308] The server searches the database for prompts based on the received keywords.
[1309] Step 6:
[1310] The server sends the search results to the terminal.
[1311] Step 7:
[1312] The terminal displays the search results to the user.
[1313] View and download prompt details
[1314] Step 1:
[1315] The user selects the prompt of interest from the search results.
[1316] Step 2:
[1317] The device sends the ID of the selected prompt to the server.
[1318] Step 3:
[1319] The server retrieves the detailed information of the corresponding prompt from the database and sends it to the terminal.
[1320] Step 4:
[1321] The terminal displays the detailed information to the user.
[1322] Step 5:
[1323] The user clicks the download button.
[1324] Step 6:
[1325] The device sends a download request to the server.
[1326] Step 7:
[1327] The server sends prompt data to the terminal.
[1328] Step 8:
[1329] The terminal saves the data and displays a completion message to the user.
[1330] Prompt evaluation and feedback
[1331] Evaluate prompts
[1332] Step 1:
[1333] A user visits the ratings page.
[1334] Step 2:
[1335] The terminal displays the evaluation input form.
[1336] Step 3:
[1337] The user enters the evaluation data and clicks the submit button.
[1338] Step 4:
[1339] The terminal transmits the evaluation data to the server.
[1340] Step 5:
[1341] The server stores the rating data in a database.
[1342] Step 6:
[1343] The server sends an evaluation completion message to the terminal.
[1344] Step 7:
[1345] The terminal displays a completion message to the user.
[1346] View Feedback
[1347] Step 1:
[1348] A user visits the prompt details page.
[1349] Step 2:
[1350] The device sends the prompt ID to the server.
[1351] Step 3:
[1352] The server retrieves the evaluation and feedback for the prompt from the database and sends it to the terminal.
[1353] Step 4:
[1354] The feedback information acquired by the terminal is displayed to the user.
[1355] Subscriptions and Advertising
[1356] Subscribe
[1357] Step 1:
[1358] A user visits the subscriptions page.
[1359] Step 2:
[1360] The device will display the subscription plan and payment form.
[1361] Step 3:
[1362] The user selects a plan, enters payment information, and clicks the Sign Up button.
[1363] Step 4:
[1364] The terminal sends the payment information to the server.
[1365] Step 5:
[1366] The server forwards the payment information to the payment gateway.
[1367] Step 6:
[1368] The server receives the payment result and updates the subscription status in the database.
[1369] Step 7:
[1370] The server sends a registration completion message to the terminal.
[1371] Step 8:
[1372] The terminal displays a completion message to the user.
[1373] Displaying ads
[1374] Step 1:
[1375] The user views a free prompt.
[1376] Step 2:
[1377] The terminal sends the prompt ID currently being displayed to the server.
[1378] Step 3:
[1379] The server retrieves advertising data related to the prompt from a database.
[1380] Step 4:
[1381] The server transmits the advertisement data to the terminal.
[1382] Step 5:
[1383] The terminal displays the advertisement data to the user.
[1384] Example 2
[1385] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1386] Conventional AI-generated prompt systems lack the ability to efficiently manage, share, and evaluate user-entered data. Furthermore, they lack the ability to recognize user emotions and optimize the system, resulting in a poor user experience. In particular, they face challenges in providing content that adapts to stressful situations and different emotional states.
[1387] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for receiving input data generated by a user, a database for storing the input data, means for searching for input data stored in the database, means for allowing the user to download or use the input data, means for collecting emotion data from an input device built into the terminal to recognize the user's emotion, emotion engine means for analyzing the emotion data, and means for customizing search results and suggested content based on the emotion data. This enables the user to receive appropriate content according to their emotional state, improving the user experience.
[1388] "User" means any individual or entity that utilizes the System to create, view, and evaluate Input Data.
[1389] "Input Data" means user-generated data, such as text, images, and audio, that is processed and stored by the system.
[1390] A "database" is a storage system for organizing and storing input data and related information, with search and retrieval capabilities.
[1391] The "receiving means" is a function that allows the server to receive input data sent from the user.
[1392] The "storage means" is a function for storing received input data in a database.
[1393] "Search means" refers to a function for searching input data in a database based on specific conditions.
[1394] "Downloading means" refers to a function that allows a user to download input data stored in the database to their own terminal.
[1395] "Means of use" refers to functions that allow a user to perform operations such as viewing, editing, and evaluating saved input data.
[1396] "Emotion data" refers to information about the user's emotional state analyzed from their facial expressions and voice.
[1397] An "emotion engine" is software or hardware that analyzes collected emotion data to determine a user's current emotional state.
[1398] "Customization tools" refers to functionality for tailoring search results and suggested content based on the emotional state identified by the emotion engine.
[1399] "Payment Gateway" means a system for processing user-entered payment information and updating subscription status.
[1400] "Subscription Plan" means a service contract plan that a User can select and that provides certain benefits.
[1401] "Benefit provision means" refers to a function for providing benefits to users based on a subscription plan.
[1402] "Rating data" refers to information about the ratings that users give to other prompts.
[1403] The "display means" refers to a function for visually presenting collected information such as emotion data and evaluation data to the user.
[1404] The present invention provides a system for efficiently creating, sharing, and rating prompts that users input to AI models, and for recognizing user emotions to improve system functionality. Specific embodiments for implementing the present invention will now be described.
[1405] Overall system overview
[1406] This system mainly consists of a server, user terminals, a database, and an emotion engine. The server receives, stores, searches, downloads, and manages ratings of input data. The user terminal creates prompts, searches, downloads, and collects ratings and emotion data. The database manages input data, rating data, and subscription information. The emotion engine analyzes the user's emotional state and adjusts the functions of the entire system.
[1407] Hardware and Software Used
[1408] Server: The server is built using web server software (e.g., Apache, Nginx) and a backend framework (e.g., Node.js, Django). A database system (e.g., MongoDB, PostgreSQL) is also used for data processing and storage management.
[1409] Terminal: User terminals are devices such as PCs, smartphones, and tablets. These terminals communicate with the server via a web browser and provide functionality using front-end technologies (e.g., HTML, CSS, JavaScript).
[1410] Emotion Engine: The emotion engine is built using AI models (e.g., TensorFlow, PyTorch) to analyze the user's facial and voice data.
[1411] Creating and sharing prompts
[1412] A user accesses the sign-up page using a device, enters the required information into the sign-up form, and sends it to the server, which validates the information and stores it in a database. Once the sign-up is complete, the user can log in and access the dashboard.
[1413] The dashboard displays a prompt creation form, where the user enters the title, description, and content of the prompt and clicks the submit button. The terminal sends the prompt data to the server, which validates it and stores it in the database.
[1414] Find and download prompts
[1415] When a user accesses the search page, the terminal displays a search form, and the user enters keywords to perform a search. The server searches the database based on the keywords and sends the results to the terminal. The user can select prompts of interest from the search results, and view and download detailed information.
[1416] Prompt evaluation and feedback
[1417] Users enter ratings for the prompts and send them to the server, which stores the ratings in a database and makes them available for other users to view.
[1418] User Emotion Recognition
[1419] While a user is using the system, the device's built-in camera and microphone collect emotional data. The emotion engine analyzes this data and sends the results to the server. The server then customizes search results and suggestions based on the emotional data to provide content that is appropriate for the user.
[1420] Examples of concrete examples and prompts
[1421] For example, if a user were to create a "Research prompt on new AI technologies," they would enter the following information:
[1422] Title: "Research into new AI technologies"
[1423] Description: "Dig deep into the latest trends and applications of AI technology"
[1424] What it is: "Providing insights into cutting-edge AI techniques using generative AI models."
[1425] Example prompts to be input to the generative AI model:
[1426] "Topic: Safety of self-driving cars"
[1427] Description: "Use AI to analyze safety issues associated with the rise of self-driving cars."
[1428] In this way, the present invention recognizes user emotions and improves system functionality, thereby further enhancing the user experience.
[1429] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1430] Creating and posting prompts
[1431] Step 1: Sign-up process
[1432] 1. The terminal displays an input form.
[1433] Input: The user visits the sign-up page.
[1434] Data processing: Rendering input forms using HTML and CSS.
[1435] Output: The user is presented with a sign-up form.
[1436] 2. The user enters and submits the information.
[1437] Input: A user enters their name, email address, and password and clicks the Sign Up button.
[1438] Data processing: Convert the input data into JSON format using JavaScript and send it to the server.
[1439] Output: Data is sent to the server.
[1440] 3. The server validates the data.
[1441] Input: User information sent from the device in JSON format.
[1442] Data processing: Validate the data using the validation library.
[1443] Output: If validation is successful, instructions to save the data to the database.
[1444] 4. The server stores the data in a database.
[1445] Input: Successfully verified user information.
[1446] Data processing: Save data to a database using SQL or NoSQL commands.
[1447] Output: A successful save message is generated.
[1448] 5. The server sends a completion message.
[1449] Input: Save successful message.
[1450] Data processing: Convert the message into JSON format and send it to the device.
[1451] Output: A completion message is displayed on the terminal.
[1452] Step 2: The prompt creation process
[1453] 1. A user visits the dashboard.
[1454] Input: Dashboard access after successful login.
[1455] Data processing: Dashboard HTML and JavaScript are loaded.
[1456] Output: The user sees the dashboard.
[1457] 2. The user enters and submits the prompt.
[1458] Enter: The user enters the prompt title, description, and content and clicks the submit button.
[1459] Data processing: Convert the input data into JSON format using JavaScript and send it to the server.
[1460] Output: Data is sent to the server.
[1461] 3. The server validates the data.
[1462] Input: Prompt information sent from the terminal in JSON format.
[1463] Data processing: Validate the data using the validation library.
[1464] Output: If validation is successful, instructions to save the data to the database.
[1465] 4. The server stores the data in a database.
[1466] Input: The prompt data that was successfully validated.
[1467] Data processing: Save data to a database using SQL or NoSQL commands.
[1468] Output: A successful save message is generated.
[1469] 5. The server sends a completion message.
[1470] Input: Save successful message.
[1471] Data processing: Convert the message into JSON format and send it to the device.
[1472] Output: A completion message is displayed on the terminal.
[1473] Step 3: Prompt Management Process
[1474] 1. A user visits the dashboard.
[1475] Input: A user visits a dashboard.
[1476] Data processing: Dashboard HTML and JS are loaded.
[1477] Output: The dashboard is displayed to the user.
[1478] 2. The terminal requests prompt information from the server.
[1479] Input: Request from the dashboard.
[1480] Data processing: The server receives the request.
[1481] Output: A request is sent to the server.
[1482] 3. The server retrieves the prompt information from the database.
[1483] Input: A query based on the user ID.
[1484] Data manipulation: Execute queries using SQL and NoSQL commands.
[1485] Output: The prompt information is retrieved.
[1486] 4. The server sends the prompt information to the terminal.
[1487] Input: The retrieved prompt information.
[1488] Data processing: Convert data into JSON format and send it to the device.
[1489] Output: Prompt information is sent to the terminal.
[1490] 5. The terminal will display the prompt information.
[1491] Input: Prompt information received from the server.
[1492] Data Manipulation: Rendering prompt information using HTML and JavaScript.
[1493] Output: The prompt information is displayed to the user.
[1494] Find and download prompts
[1495] Step 1: Prompt search process
[1496] 1. The user visits the search page.
[1497] Input: Access to the search page.
[1498] Data processing: HTML and JS for the search page are loaded.
[1499] Output: The search box is displayed to the user.
[1500] 2. The user enters a search keyword and submits it.
[1501] Input: When a user types keywords into the search box and clicks the search button.
[1502] Data processing: Convert input data into JSON format and send it to the server.
[1503] Output: Data is sent to the server.
[1504] 3. The server performs a lookup in the database.
[1505] Input: Search keyword.
[1506] Data manipulation: Perform searches using SQL or NoSQL commands in the database.
[1507] Output: Search results are retrieved.
[1508] 4. The server sends the search results to the terminal.
[1509] Input: Search results.
[1510] Data processing: Convert data into JSON format and send it to the terminal.
[1511] Output: The results are sent to the terminal.
[1512] 5. The device will display the search results.
[1513] Input: Search results received from the server.
[1514] Data processing: Rendering search results using HTML and JavaScript.
[1515] Output: Search results are displayed to the user.
[1516] Step 2: Prompt details and download process
[1517] 1. The user selects a prompt.
[1518] Input: Select the prompt from the search results.
[1519] Data processing: The selected prompt ID is retrieved.
[1520] Output: The prompt ID is sent to the server.
[1521] 2. The device sends the prompt ID to the server.
[1522] Input: The selected prompt ID.
[1523] Data processing: Convert the prompt ID into JSON format and send it to the server.
[1524] Output: The prompt ID is sent to the server.
[1525] 3. The server retrieves the details from the database.
[1526] Input: A query based on the prompt ID.
[1527] Data manipulation: Execute queries using SQL and NoSQL commands.
[1528] Output: The prompt details are retrieved.
[1529] 4. The server sends the detailed information to the terminal.
[1530] Input: The retrieved prompt details.
[1531] Data processing: Convert data into JSON format and send it to the terminal.
[1532] Output: Detailed information is sent to the terminal.
[1533] 5. The terminal will display detailed information.
[1534] Input: The details received from the server.
[1535] Data manipulation: Render detailed information using HTML and JavaScript.
[1536] Output: Detailed information is displayed to the user.
[1537] 6. The user performs the download.
[1538] Input: User clicks the download button.
[1539] Data processing: Send a download request to the server.
[1540] Output: Prompt data is sent to the terminal and saved.
[1541] (Application example 2)
[1542] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1543] While existing systems can manage and share user-generated input data, they lack the ability to customize it based on the user's emotional state. Furthermore, there is a lack of systems that can recognize the user's emotions and provide appropriate feedback and suggestions. This can result in a lack of improvement in the user experience and a decline in the value of the system.
[1544] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1545] In this invention, the server includes means for receiving input data generated by a user, a database for storing the input data, means for searching for input data stored in the database, means for allowing the user to download or use the input data, means for recognizing and analyzing the user's emotions, means for customizing prompts based on the analyzed emotional data, and means for providing the customized prompts to the user, thereby enabling prompts to be created or suggested according to the user's emotional state, thereby improving the user experience.
[1546] "Input data" refers to user-generated information such as text, audio, and images.
[1547] "Database" refers to a system for efficiently storing and managing input data and related information.
[1548] "Search means" refers to the function of searching for input data in a database based on specific keywords or conditions.
[1549] "Downloading means" refers to a function for obtaining the input data required by the user onto his / her own terminal.
[1550] "User emotion" refers to the emotional and mental state expressed by the user, and is primarily analyzed from facial expressions and voice data.
[1551] "Means for analyzing" refers to algorithms and techniques for analyzing the user's emotional data and generating the results.
[1552] "Means of customization" refers to the ability to tailor prompts and suggestions based on analyzed emotional data.
[1553] "Means for providing" refers to the functionality for presenting customized prompts and suggestions to the user.
[1554] To implement this invention, it is necessary to build a system that receives, stores, and manages user-generated input data. This system consists of terminals, a server, and software operated by these.
[1555] First, the server receives input data generated by the user using a terminal. The terminal can be a device such as a smartphone or head-mounted display. Next, the input data is stored in a database by the server. A database is a system for processing large amounts of data, and a relational database management system such as MySQL or PostgreSQL is used.
[1556] Users can search the database via their terminal to retrieve stored input data. This search functionality is implemented using a search engine such as ElasticSearch.
[1557] Furthermore, the system is equipped with a function to recognize and analyze the user's emotions. This function is achieved by capturing the user's facial expressions and voice data using the device's camera and microphone, and analyzing this data using a deep learning model. Machine learning frameworks such as Keras are used for emotion analysis. The analyzed emotion data is sent to a server and stored in a database.
[1558] The server customizes prompts based on this emotional data and provides them to the user. For example, customization can be done by preferentially displaying prompts that will help the user relax if they are feeling stressed. As a specific example, the following prompt sentences can be input into the generative AI model:
[1559] Example prompt sentence:
[1560] If the user is feeling stressed, create a prompt that offers a video of a relaxing getaway.
[1561] In this way, prompts are dynamically adjusted according to the user's emotional state, resulting in a more personalized user experience. This has potential applications in a variety of areas, such as supporting relaxation and improving safety while driving.
[1562] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1563] Step 1:
[1564] The user generates and sends input data using a terminal. The user generates data such as text, audio, or images and sends it to the server through the terminal. The input data is sent from the terminal to the server, and the next process begins.
[1565] Step 2:
[1566] The server stores the input data it receives in a database. The server first validates the data it receives to ensure it is in the proper format. It then uses a database management system to store the data. The input is the data sent by the user and the output is the record in the database.
[1567] Step 3:
[1568] A user uses a terminal to search a database. The server receives the search query and searches for corresponding data in the database using a search engine. The search results are sent from the server to the terminal and displayed to the user. The input is the search query and the output is the search result data.
[1569] Step 4:
[1570] The device uses a camera and microphone to collect facial and voice data from the user. These data are acquired in real time for emotion recognition. The input is the user's facial and voice data, and the output is to send these data to a server.
[1571] Step 5:
[1572] The server sends the received facial and voice data to the emotion analysis engine to recognize emotions. The emotion analysis engine uses a deep learning model to analyze emotions and generate results. The input is facial and voice data, and the output is analyzed emotion data.
[1573] Step 6:
[1574] The server customizes prompts based on the analyzed emotional data. The server selects appropriate prompts and suggestions depending on the user's emotional state. For example, if the user is feeling stressed, it will prioritize prompts that will help them relax. The input is the analyzed emotional data, and the output is customized prompts.
[1575] Step 7:
[1576] The server sends the customized prompt to the terminal and provides it to the user. The terminal receives the prompt and displays it on the screen or outputs it as speech. The input is the customized prompt, and the output is the prompt provided to the user.
[1577] Through this step, users can receive appropriate emotional prompts and entertainment content to maintain a relaxed state inside the self-driving vehicle.
[1578] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1579] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1580] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[1581] [Third embodiment]
[1582] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[1583] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.
[1584] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1585] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[1586] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1587] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1588] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1589] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1590] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1591] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1592] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1593] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[1594] This invention provides a system that allows users to effectively create, share, and evaluate prompts to be input to AI. Below, the system program and its processing are explained in natural language.
[1595] Creating and posting prompts
[1596] 1. Sign up as a prompt contributor
[1597] When a user accesses the sign-up page, the terminal displays an input form. The user enters their name, email address, password, etc. and clicks the sign-up button. The terminal sends the input information to the server, which verifies it and stores it in a database. A completion message is sent from the server to the terminal and displayed to the user.
[1598] 2. Create a prompt
[1599] When a user logs in and accesses the dashboard, the terminal displays a prompt creation form. The user enters the prompt details and clicks the submit button. The input information is sent from the terminal to the server, where it is validated and saved in the database. A save completion message is sent to the terminal and displayed.
[1600] 3. Managing prompts
[1601] When a user accesses the dashboard to manage the prompts posted by the user, the terminal requests the prompt information from the server, which retrieves the relevant prompt information from the database and sends it to the terminal, which then displays it to the user.
[1602] Find and download prompts
[1603] 1. Search for prompts
[1604] When a user accesses the search page, the terminal displays a search box. The user enters search keywords and clicks the search button. The search keywords are sent from the terminal to the server, and the server searches the database for the corresponding prompt and sends the results to the terminal. The terminal then displays the search results to the user.
[1605] 2. View and download prompt details
[1606] When the user selects a prompt they are interested in, the terminal sends the prompt ID to the server. The server retrieves the details of the prompt from the database and sends them to the terminal. The details are displayed to the user, and when the user clicks the download button, a download request is sent from the terminal to the server and the prompt data is sent to the terminal. The data is saved and a completion message is displayed to the user.
[1607] Prompt evaluation and feedback
[1608] 1. Evaluate the prompt
[1609] The user accesses a page for entering ratings in response to the prompt they used and enters the rating data. The rating data is sent from the terminal to the server, where it is stored in a database. A rating completion message is sent to the terminal and displayed.
[1610] 2. Viewing Feedback
[1611] When a user wants to see feedback for a specific prompt, the prompt ID is sent from the device to the server. The server retrieves the prompt's rating and feedback from the database and sends it to the device. The retrieved feedback information is then displayed to the user.
[1612] Subscriptions and Advertising
[1613] 1. Subscription Registration
[1614] When a user visits the subscription page, selects a plan, and enters payment information, the terminal sends it to the server, which then forwards the payment information to the payment gateway for processing, receives the result, and updates the subscription status in the database. A registration completion message is sent to the terminal and displayed to the user.
[1615] 2. Display of advertisements
[1616] When a user views a free prompt, the device sends the prompt ID currently displayed to the server. The server retrieves advertising data related to the prompt from the database and sends it to the device. The advertisement is then displayed to the user.
[1617] The processing flow will be explained below.
[1618] Creating and posting prompts
[1619] Prompt Contributor Sign-Up
[1620] Step 1:
[1621] A user visits the sign-up page.
[1622] Step 2:
[1623] The device displays the input form.
[1624] Step 3:
[1625] The user enters their name, email address, and password and clicks the Sign Up button.
[1626] Step 4:
[1627] The terminal sends the input information to the server.
[1628] Step 5:
[1629] The server validates the input information and stores it in a database.
[1630] Step 6:
[1631] The server sends a sign-up completion message to the terminal.
[1632] Step 7:
[1633] The terminal displays a completion message to the user.
[1634] Creating a Prompt
[1635] Step 1:
[1636] A user logs in and accesses the dashboard.
[1637] Step 2:
[1638] The terminal displays the prompt creation form.
[1639] Step 3:
[1640] The user enters the prompt details (title, description, content) and clicks the submit button.
[1641] Step 4:
[1642] The terminal sends the input information to the server.
[1643] Step 5:
[1644] The server validates the input information and stores it in a database.
[1645] Step 6:
[1646] The server sends a save completion message to the terminal.
[1647] Step 7:
[1648] The terminal displays a completion message to the user.
[1649] Managing Prompts
[1650] Step 1:
[1651] A user visits a dashboard.
[1652] Step 2:
[1653] The terminal requests prompt information for the currently logged-in user from the server.
[1654] Step 3:
[1655] The server retrieves the corresponding prompt information from the database and sends it to the terminal.
[1656] Step 4:
[1657] The terminal displays the obtained prompt information to the user.
[1658] Find and download prompts
[1659] Search prompts
[1660] Step 1:
[1661] A user visits a search page.
[1662] Step 2:
[1663] Your device will display a search box.
[1664] Step 3:
[1665] The user enters search keywords and clicks the search button.
[1666] Step 4:
[1667] The device sends the search keywords to the server.
[1668] Step 5:
[1669] The server searches the database for prompts based on the received keywords.
[1670] Step 6:
[1671] The server sends the search results to the terminal.
[1672] Step 7:
[1673] The terminal displays the search results to the user.
[1674] View and download prompt details
[1675] Step 1:
[1676] The user selects the prompt of interest from the search results.
[1677] Step 2:
[1678] The device sends the ID of the selected prompt to the server.
[1679] Step 3:
[1680] The server retrieves the detailed information of the corresponding prompt from the database and sends it to the terminal.
[1681] Step 4:
[1682] The terminal displays the detailed information to the user.
[1683] Step 5:
[1684] The user clicks the download button.
[1685] Step 6:
[1686] The device sends a download request to the server.
[1687] Step 7:
[1688] The server sends prompt data to the terminal.
[1689] Step 8:
[1690] The terminal saves the data and displays a completion message to the user.
[1691] Prompt evaluation and feedback
[1692] Evaluate prompts
[1693] Step 1:
[1694] A user visits the ratings page.
[1695] Step 2:
[1696] The terminal displays the evaluation input form.
[1697] Step 3:
[1698] The user enters the evaluation data and clicks the submit button.
[1699] Step 4:
[1700] The terminal transmits the evaluation data to the server.
[1701] Step 5:
[1702] The server stores the rating data in a database.
[1703] Step 6:
[1704] The server sends an evaluation completion message to the terminal.
[1705] Step 7:
[1706] The terminal displays a completion message to the user.
[1707] View Feedback
[1708] Step 1:
[1709] A user visits the prompt details page.
[1710] Step 2:
[1711] The device sends the prompt ID to the server.
[1712] Step 3:
[1713] The server retrieves the evaluation and feedback for the prompt from the database and sends it to the terminal.
[1714] Step 4:
[1715] The feedback information acquired by the terminal is displayed to the user.
[1716] Subscriptions and Advertising
[1717] Subscribe
[1718] Step 1:
[1719] A user visits the subscriptions page.
[1720] Step 2:
[1721] The device will display the subscription plan and payment form.
[1722] Step 3:
[1723] The user selects a plan, enters payment information, and clicks the Sign Up button.
[1724] Step 4:
[1725] The terminal sends the payment information to the server.
[1726] Step 5:
[1727] The server forwards the payment information to the payment gateway.
[1728] Step 6:
[1729] The server receives the payment result and updates the subscription status in the database.
[1730] Step 7:
[1731] The server sends a registration completion message to the terminal.
[1732] Step 8:
[1733] The terminal displays a completion message to the user.
[1734] Displaying ads
[1735] Step 1:
[1736] The user views a free prompt.
[1737] Step 2:
[1738] The terminal sends the prompt ID currently being displayed to the server.
[1739] Step 3:
[1740] The server retrieves advertising data related to the prompt from a database.
[1741] Step 4:
[1742] The server transmits the advertisement data to the terminal.
[1743] Step 5:
[1744] The terminal displays the advertisement data to the user.
[1745] Example 1
[1746] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1747] Previous systems required cumbersome operations for managing, searching, rating, and providing feedback on user-generated prompts, making them difficult to use efficiently. Furthermore, they did not properly manage user feedback and ratings to improve the quality of prompts. Furthermore, they lacked a mechanism for displaying appropriate advertisements to free users.
[1748] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1749] In this invention, the server includes means for receiving input data generated by a user, database means for saving the input data, means for searching for input data saved in the database, means for a user to display information related to the input data, means for the user to download or use the input data, means for inputting a rating for the input data, means for saving the rating data in a database, means for displaying the rating data to other users, means for displaying advertisement data, and database means for handling the advertisement data, thereby enabling a user to consistently and efficiently perform processes from creating, sharing, and rating prompts to displaying advertisements.
[1750] "User" means any person or entity that uses the System to create, manage, rate, and search prompts.
[1751] "Input Data" refers to all data such as prompts, ratings, and feedback that a user provides to the system.
[1752] "Database" refers to a digital storage system for storing and managing the input data, evaluation data, and advertising data.
[1753] "Means of searching" refers to the function that allows the system to search input data in the database based on specific keywords or conditions.
[1754] The term "means for displaying information" refers to a function that enables the terminal to visually display to the user the input data and evaluation data acquired from the database.
[1755] "Means for downloading or making available" refers to the system's ability to obtain input data from the user and store it in a format that can be used later.
[1756] "Means for inputting ratings" refers to the functionality that allows a user to input and provide rating data in response to a particular prompt.
[1757] "Rating data" refers to the rating information entered by the user in response to a prompt.
[1758] "Advertising Data" refers to commercial information displayed in connection with a particular prompt or user action.
[1759] "Payment Gateway" refers to a system for processing a user's payment information.
[1760] "Subscription Plan" means a subscription-based plan selected by a User to access certain features of the System.
[1761] "Benefits" means any additional benefits or services provided to you under your Subscription Plan.
[1762] The present invention relates to a system that enables users to effectively create, share, and evaluate prompts to be input to AI. The system is composed of a server, a terminal, and a user. Specific embodiments of the system are described below.
[1763] System configuration
[1764] 1. Server
[1765] The server has the following functions:
[1766] Ability to receive user-generated input data
[1767] A database for storing input data
[1768] Ability to search input data stored in a database
[1769] A function that displays information related to the input data to the user
[1770] Ability to allow users to download or use input data
[1771] A function to input evaluations for input data
[1772] Ability to save evaluation data to a database
[1773] Ability to display rating data to other users
[1774] Ability to display advertising data
[1775] Database function for handling advertising data
[1776] Ability to manage subscription plans
[1777] A payment gateway to process your payment information
[1778] 2. Terminal
[1779] The terminal has the following functions:
[1780] Displaying the input form
[1781] Sending and receiving information to and from the server
[1782] Displaying information to the user
[1783] Download function
[1784] 3. Users
[1785] The user performs the following operations:
[1786] Sign up and log in
[1787] Creating a Prompt
[1788] Managing Prompts
[1789] Search prompts
[1790] View and download prompt details
[1791] Prompt evaluation and feedback
[1792] Subscribe
[1793] Viewing ads
[1794] Processing flow
[1795] Creating and posting prompts
[1796] A user visits the sign-up page and signs up by entering their name, email address, and password. The device sends this information to the server, which stores the user information in a database. The user then logs in and accesses the dashboard. They enter the prompt details in the prompt creation form and click the submit button. The device sends the input information to the server, which stores the prompt in a database.
[1797] As an example, suppose the user enters the following prompt text:
[1798] Create a new AI assistant character. Tell us its name, characteristics, and special abilities.
[1799] Find and download prompts
[1800] The user accesses the search page, enters search keywords, and clicks the search button. The device sends the search keywords to the server, which searches the database for relevant prompts and sends the results to the device. The user selects a specific prompt, displays details, and downloads the prompt data.
[1801] As an example, a user enters the following search keywords:
[1802] "Python Beginner Project"
[1803] Prompt evaluation and feedback
[1804] The user provides a rating for the prompt and sends the rating data through the terminal to the server, which stores the rating data in a database and displays it to other users.
[1805] Subscriptions and Advertising
[1806] Users select a plan on the subscription page, enter their payment information, and the payment is processed through the server via a payment gateway. Free users are shown relevant ads, and the ad data is managed by the server.
[1807] The above is an embodiment of the present invention, which allows users to efficiently manage, search, and rate prompts, and improves the overall system usage experience.
[1808] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1809] Creating and posting prompts
[1810] Step 1:
[1811] A user visits a sign-up page. As input, the user enters their name, email address, and password. As output, data is generated that is sent to the server.
[1812] Specific behavior:
[1813] A user accesses a sign-up page in a browser and enters the name "Taro Yamada," the email address "taro@example.com," and the password "mypassword."
[1814] Step 2:
[1815] The terminal displays a sign-up form. The input contains the HTML data of the form. The output generates a web page that is displayed to the user.
[1816] Specific behavior:
[1817] The terminal displays a sign-up form in the user's browser and provides the above input fields.
[1818] Step 3:
[1819] The user clicks the sign-up button. The input contains the user's input data. The output generates the data sent from the device to the server.
[1820] Specific behavior:
[1821] The user clicks the "Sign Up" button and the entered data is sent to the server.
[1822] Step 4:
[1823] The device sends input information to the server. The input contains the user's input data. The output generates an HTTP request that is sent to the server.
[1824] Specific behavior:
[1825] The device sends the data entered by the user, including the name, email address, and password, to the server.
[1826] Step 5:
[1827] The server validates the input information. Input includes the submitted user data. Output is stored in a database or an error message is sent to the terminal.
[1828] Specific behavior:
[1829] The server checks for duplicate email addresses and password strength, and if there are no problems, it saves the user information in the database. If there are duplicates, it returns an error message.
[1830] Step 6:
[1831] The server saves the user information in the database. It contains the validated user data as input and produces a save completion status as output.
[1832] Specific behavior:
[1833] The server saves the name, email address, and password in the database and generates a save completion status.
[1834] Step 7:
[1835] The server sends a completion message to the terminal, containing the save completion status as input, and an HTTP response as output.
[1836] Specific behavior:
[1837] The server sends a message to the terminal saying "sign-up complete."
[1838] Step 8:
[1839] The terminal displays a completion message to the user. As input, it contains the completion message from the server. As output, it generates a web page that is displayed in the user's browser.
[1840] Specific behavior:
[1841] The device will display "Sign-up complete."
[1842] Find and download prompts
[1843] Step 1:
[1844] A user visits a search page. The input includes the URL of the search page. The output is a search form.
[1845] Specific behavior:
[1846] A user accesses the search page in a browser and displays the search form.
[1847] Step 2:
[1848] The device displays a search box containing the HTML data of the search form as input, and a web page as output.
[1849] Specific behavior:
[1850] The device displays a search box in the user's browser.
[1851] Step 3:
[1852] The user inputs a search keyword. The input contains the search keyword. The output is generated as data to be sent to the terminal.
[1853] Specific behavior:
[1854] A user types "Python beginner projects" into the search box and clicks the search button.
[1855] Step 4:
[1856] The device sends search keywords to the server. The input contains the search keywords entered by the user. The output is an HTTP request.
[1857] Specific behavior:
[1858] The terminal transmits the search keywords to the server.
[1859] Step 5:
[1860] The server performs a search in the database. The input includes the search keywords and the database information. The output is the search results.
[1861] Specific behavior:
[1862] The server searches the database for prompts for "Python beginner projects" and produces the appropriate results.
[1863] Step 6:
[1864] The server sends the search results to the terminal. The search result data is included as input. An HTTP response is generated as output.
[1865] Specific behavior:
[1866] The server sends the search results to the terminal.
[1867] Step 7:
[1868] The terminal displays the search results to the user. The input includes the search result data from the server. The output is a web page that is displayed in the user's browser.
[1869] Specific behavior:
[1870] The device will display the search result with the title "Python projects for beginners" and the description.
[1871] Step 8:
[1872] The user selects a specific prompt. As input, it contains the prompt ID. As output, it generates the data to be sent to the server.
[1873] Specific behavior:
[1874] The user selects "Python projects for beginners" from the search results and clicks the Show details button.
[1875] Step 9:
[1876] The device sends the prompt ID to the server. As input, it contains the prompt ID selected by the user. As output, an HTTP request is generated.
[1877] Specific behavior:
[1878] The terminal sends the prompt ID to the server.
[1879] Step 10:
[1880] The server retrieves prompt details from the database. As input, it contains the prompt ID. As output, it generates the prompt details.
[1881] Specific behavior:
[1882] The server retrieves the details of the corresponding prompt from the database.
[1883] Step 11:
[1884] The server sends the details to the terminal. As input, it contains the prompt details. As output, it generates an HTTP response.
[1885] Specific behavior:
[1886] The server sends the details of the prompt to the terminal.
[1887] Step 12:
[1888] The terminal displays the details to the user. As input, it contains the details from the server. As output, it generates a web page that is displayed in the user's browser.
[1889] Specific behavior:
[1890] The terminal will display detailed information about "Python projects for beginners."
[1891] Step 13:
[1892] The user clicks the download button. The input contains the prompt data. The output generates the data to be sent to the device.
[1893] Specific behavior:
[1894] The user clicks the "Download" button to retrieve the prompt data.
[1895] Step 14:
[1896] The device sends a download request to the server, which includes the prompt details as input, and generates an HTTP request as output.
[1897] Specific behavior:
[1898] The terminal sends a download request to the server.
[1899] Step 15:
[1900] The server sends prompt data to the terminal. As input, it contains prompt details. As output, it generates prompt data.
[1901] Specific behavior:
[1902] The server sends the prompt data to the terminal.
[1903] Step 16:
[1904] The terminal saves the data and displays a completion message to the user. Prompt data is included as input. A save completion message is generated as output.
[1905] Specific behavior:
[1906] The terminal saves the downloaded prompt data and displays a message to the user saying "download complete."
[1907] (Application example 1)
[1908] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1909] In the modern advertising industry, there is a need to quickly generate, evaluate, and optimize effective advertising creatives. However, the process of generating advertising creatives requires a lot of time and resources, making it difficult to establish an effective feedback loop. This makes it difficult to maximize the performance of advertising campaigns.
[1910] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1911] In this invention, the server includes means for receiving input data generated by a user, a database for storing the input data, means for searching for the input data stored in the database, means for allowing the user to download or use the input data, means for using a generative AI model to generate prompts for advertising creatives, means for sharing the generated prompts for advertising creatives within a team, and means for evaluating advertising effectiveness based on the prompts and storing the evaluation data in a database, thereby enabling advertising creatives to be quickly generated, evaluated, and shared.
[1912] "User" means a person or entity that utilizes the System to generate, evaluate, and share Input Data.
[1913] "Input Data" is text data that includes user-generated advertising creative and prompts.
[1914] The "database" is a storage device for storing and managing the input data and evaluation data.
[1915] "Generative AI model" refers to artificial intelligence technology that generates ad creatives based on user-entered prompts.
[1916] A "prompt" is a set of instructions or input data that a generative AI model uses to create advertising creative.
[1917] "Ad creative" refers to the marketing content, such as text, images, and videos, used in an advertising campaign.
[1918] "Evaluation Data" means performance metrics such as click rates and conversion rates that indicate the effectiveness of the prompts generated and used.
[1919] A "subscription plan" is a fee plan for a user to continue using the system, and may include various benefits.
[1920] "Payment Information" means payment instruments such as credit card information or bank account information used to process fees for Subscription Plans.
[1921] A "payment gateway" is a system that processes payment information and executes payments.
[1922] "Share with team" refers to sharing the generated ad creative prompt with other users involved in the same project or campaign.
[1923] The present invention is a system for effectively creating, sharing, and evaluating advertising creatives. The system receives user-generated input data and implements a series of processes to store, search, share, and evaluate it. Specifically, it uses a generative AI model to generate advertising creatives based on prompts, collects evaluation data, and optimizes them.
[1924] System Overview
[1925] The system includes the following main components:
[1926] 1. Hardware: Smartphone (iOS or Android), smart glasses (e.g., Google Glass).
[1927] 2. Software:
[1928] Front-end: Building the user interface using React Native.
[1929] Backend: Node.js and Express are used to realize server-side logic.
[1930] Database: MongoDB is used to store input and evaluation data.
[1931] Generative AI model: Uses OpenAI GPT to generate prompts for ad creative.
[1932] System Operation
[1933] 1. Prompt creation: The user enters a prompt for the ad creative through a dedicated application. For example, the user may enter, "Please create an ad copy for our new spring products."
[1934] 2. Prompt sending and processing: The prompt entered by the user is sent from the device to the server, which passes it to a generative AI model (OpenAI GPT) to generate ad copy.
[1935] 3. Sharing generated prompts: The generated ad copy is stored in a database and shared with the team via a link or QR code, which team members can access in real time via their smartphones or smart glasses.
[1936] 4. Evaluation of advertising effectiveness: Once the generated advertising creative is used, evaluation data such as click-through rate and conversion rate are automatically collected. This data is stored in a database and can be viewed by users.
[1937] 5. Feedback of rating data: Rating data is fed back to prompt creators through the system and used to optimize advertising creatives.
[1938] Specific examples
[1939] For example, a marketer might enter:
[1940] "Write advertising copy for our new spring products."
[1941] The generative AI model then creates ad copy such as "Check out the new spring fashions now! Special offers!", which is then saved in a database and shared with the team. The generated ad copy is then used in actual campaigns, and evaluation data such as click-through rates and conversion rates is collected. This data is then fed back to the prompt creators to help them create future prompts.
[1942] In this way, the system consistently supports the process from the creation to evaluation of advertising creatives, enabling the realization of effective marketing campaigns.
[1943] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1944] Step 1:
[1945] The user inputs a prompt for the advertising creative. The user launches a dedicated application and inputs a prompt such as, "Please create advertising copy for our new spring products." The input data is sent from the device to the server.
[1946] Step 2:
[1947] The server receives the input data. The server receives the prompt sent by the user, validates its contents, and saves the input data to the database after confirming that it is valid.
[1948] Step 3:
[1949] The server uses the generative AI model to generate ad creative. Specifically, the server passes the prompt text saved earlier to the generative AI model (OpenAI GPT) and instructs it to generate ad copy. The AI model generates ad copy such as "Check out the new spring fashion now! Special offers!" This generated data is returned to the server.
[1950] Step 4:
[1951] The server stores the generated ad copy in a database. The ad copy received from the generative AI model is stored in a database for future searching and sharing. A message is sent to the device to confirm that the copy has been saved.
[1952] Step 5:
[1953] The device notifies the user of the generated ad copy and generates a sharing link. The device receives a save completion message from the server and notifies the user that the ad copy has been generated. At the same time, it generates a link or QR code for sharing the ad copy within the team and provides it to the user.
[1954] Step 6:
[1955] The user uses the generated ad copy to run an advertising campaign. The user uses the generated ad copy to launch a campaign on various advertising platforms. The user monitors the effectiveness of the campaign and makes adjustments as necessary.
[1956] Step 7:
[1957] The server collects advertising effectiveness data and stores it in a database. After an advertising campaign is run, effectiveness data such as click-through rates and conversion rates are automatically collected. This data is sent to the server and stored in a database.
[1958] Step 8:
[1959] The server provides feedback on the evaluation data to the prompt creator, who then visualizes the collected evaluation data and provides it to the prompt creator. This allows users to understand the effectiveness of the ad creative and helps them create prompts for the next time.
[1960] Through these steps, we provide a system that consistently supports the process from generating advertising creatives to evaluating them, enabling the realization of effective marketing campaigns.
[1961] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1962] This invention provides a system that allows users to efficiently create, share, and evaluate prompts that they input to AI, and also recognizes user emotions to improve system functionality. Below, the system program and its processing are explained in natural language.
[1963] Creating and posting prompts
[1964] 1. Sign up as a prompt contributor
[1965] When a user accesses the sign-up page, the terminal displays an input form. The user enters their name, email address, and password and clicks the sign-up button. The terminal sends the input information to the server, which verifies it and stores it in a database. A completion message is sent from the server to the terminal and displayed to the user.
[1966] 2. Create a prompt
[1967] When a user logs in and accesses the dashboard, the terminal displays a prompt creation form. The user enters the prompt details (title, description, content) and clicks the submit button. The entered information is sent from the terminal to the server, where it is validated and saved in the database. A save completion message is sent to the terminal and displayed.
[1968] 3. Managing prompts
[1969] When a user accesses the dashboard to manage the prompts posted by the user, the terminal requests the prompt information from the server, which retrieves the relevant prompt information from the database and sends it to the terminal, which then displays it to the user.
[1970] Find and download prompts
[1971] 1. Search for prompts
[1972] When a user accesses the search page, the terminal displays a search box. The user enters search keywords and clicks the search button. The search keywords are sent from the terminal to the server, and the server searches the database for the corresponding prompt and sends the results to the terminal. The terminal then displays the search results to the user.
[1973] 2. View and download prompt details
[1974] When the user selects a prompt they are interested in, the terminal sends the prompt ID to the server. The server retrieves the details of the prompt from the database and sends them to the terminal. The details are displayed to the user, and when the user clicks the download button, a download request is sent from the terminal to the server and the prompt data is sent to the terminal. The data is saved and a completion message is displayed to the user.
[1975] Prompt evaluation and feedback
[1976] 1. Evaluate the prompt
[1977] When a user accesses the rating page, the terminal displays a rating input form. The user enters rating data and clicks the submit button. The rating data is sent from the terminal to the server, where it is stored in a database. A rating completion message is sent to the terminal and displayed.
[1978] 2. Viewing Feedback
[1979] When a user wants to see feedback for a specific prompt, the prompt ID is sent from the device to the server. The server retrieves the prompt's rating and feedback from the database and sends it to the device. The retrieved feedback information is then displayed to the user.
[1980] Subscriptions and Advertising
[1981] 1. Subscription Registration
[1982] When a user visits the subscription page, selects a plan, and enters payment information, the terminal sends it to the server, which then forwards the payment information to the payment gateway for processing, receives the result, and updates the subscription status in the database. A registration completion message is sent to the terminal and displayed to the user.
[1983] 2. Display of advertisements
[1984] When a user views a free prompt, the device sends the prompt ID currently displayed to the server. The server retrieves advertising data related to the prompt from the database and sends it to the device. The advertisement is then displayed to the user.
[1985] Emotion engine that recognizes user emotions
[1986] 1. Acquiring Emotion Data
[1987] When a user uses the system, the device's built-in camera and microphone are used to collect the user's facial expressions and voice data. The device then sends this data to the emotion engine, which then analyzes the user's emotions. The analyzed emotion data is then sent from the device to the server, which stores it in a database.
[1988] 2. Customize prompts based on emotional data
[1989] The server customizes the search results for prompts based on the emotional data recognized by the emotion engine. For example, if the user is feeling stressed, prompts that help the user relax will be displayed preferentially. The device then displays the customized search results to the user.
[1990] 3. Adjusting suggestion prompts
[1991] The server adjusts the prompts it proposes to the user based on the emotion data recognized by the emotion engine. For example, if the user is feeling happy, it proposes a challenging prompt. The terminal displays the adjusted suggestion prompt to the user.
[1992] In this way, the present invention further enhances the user experience by recognizing the user's emotions and improving system functionality.
[1993] The processing flow will be explained below.
[1994] Emotion engine that recognizes user emotions
[1995] Acquiring emotion data
[1996] Step 1:
[1997] When a user uses the system, facial expressions and voice data are collected using the camera and microphone built into the device.
[1998] Step 2:
[1999] The facial expression and voice data collected by the device is sent to the emotion engine.
[2000] Step 3:
[2001] The emotion engine analyzes this data and identifies the user's emotion.
[2002] Step 4:
[2003] The emotion engine analyzes the emotion data and sends it to the device.
[2004] Step 5:
[2005] The emotion data received by the terminal is transmitted to the server.
[2006] Step 6:
[2007] The server stores the emotion data in a database.
[2008] Customize prompts based on sentiment data
[2009] Step 1:
[2010] The user searches for a prompt.
[2011] Step 2:
[2012] The terminal transmits the user's emotion data to the server.
[2013] Step 3:
[2014] The server uses the emotion data to search a database for prompts that match the user's current emotional state.
[2015] Step 4:
[2016] For example, if the user is feeling stressed, the server may prioritize prompts that help the user relax.
[2017] Step 5:
[2018] The server sends the customized search results to the device.
[2019] Step 6:
[2020] The terminal displays the search results to the user.
[2021] Adjusting suggestion prompts
[2022] Step 1:
[2023] The emotion engine analyzes the user's emotion data.
[2024] Step 2:
[2025] The terminal transmits the user's emotion data to the server.
[2026] Step 3:
[2027] The server generates a list based on the emotion data to suggest optimal prompts to the user.
[2028] Step 4:
[2029] For example, if the user is feeling happy, the server will include challenging prompts in the list.
[2030] Step 5:
[2031] The server sends a list of suggested prompts to the terminal.
[2032] Step 6:
[2033] The terminal displays a suggestion prompt to the user.
[2034] Creating and posting prompts
[2035] Prompt Contributor Sign-Up
[2036] Step 1:
[2037] A user visits the sign-up page.
[2038] Step 2:
[2039] The device displays the input form.
[2040] Step 3:
[2041] The user enters their name, email address, and password and clicks the Sign Up button.
[2042] Step 4:
[2043] The terminal sends the input information to the server.
[2044] Step 5:
[2045] The server validates the input information and stores it in a database.
[2046] Step 6:
[2047] The server sends a sign-up completion message to the terminal.
[2048] Step 7:
[2049] The terminal displays a completion message to the user.
[2050] Creating a Prompt
[2051] Step 1:
[2052] A user logs in and accesses the dashboard.
[2053] Step 2:
[2054] The terminal displays the prompt creation form.
[2055] Step 3:
[2056] The user enters the prompt details (title, description, content) and clicks the submit button.
[2057] Step 4:
[2058] The terminal sends the input information to the server.
[2059] Step 5:
[2060] The server validates the input information and stores it in a database.
[2061] Step 6:
[2062] The server sends a save completion message to the terminal.
[2063] Step 7:
[2064] The terminal displays a completion message to the user.
[2065] Managing Prompts
[2066] Step 1:
[2067] A user visits a dashboard.
[2068] Step 2:
[2069] The terminal requests prompt information for the currently logged-in user from the server.
[2070] Step 3:
[2071] The server retrieves the corresponding prompt information from the database and sends it to the terminal.
[2072] Step 4:
[2073] The terminal displays the obtained prompt information to the user.
[2074] Find and download prompts
[2075] Search prompts
[2076] Step 1:
[2077] A user visits a search page.
[2078] Step 2:
[2079] Your device will display a search box.
[2080] Step 3:
[2081] The user enters search keywords and clicks the search button.
[2082] Step 4:
[2083] The device sends the search keywords to the server.
[2084] Step 5:
[2085] The server searches the database for prompts based on the received keywords.
[2086] Step 6:
[2087] The server sends the search results to the terminal.
[2088] Step 7:
[2089] The terminal displays the search results to the user.
[2090] View and download prompt details
[2091] Step 1:
[2092] The user selects the prompt of interest from the search results.
[2093] Step 2:
[2094] The device sends the ID of the selected prompt to the server.
[2095] Step 3:
[2096] The server retrieves the detailed information of the corresponding prompt from the database and sends it to the terminal.
[2097] Step 4:
[2098] The terminal displays the detailed information to the user.
[2099] Step 5:
[2100] The user clicks the download button.
[2101] Step 6:
[2102] The device sends a download request to the server.
[2103] Step 7:
[2104] The server sends prompt data to the terminal.
[2105] Step 8:
[2106] The terminal saves the data and displays a completion message to the user.
[2107] Prompt evaluation and feedback
[2108] Evaluate prompts
[2109] Step 1:
[2110] A user visits the ratings page.
[2111] Step 2:
[2112] The terminal displays the evaluation input form.
[2113] Step 3:
[2114] The user enters the evaluation data and clicks the submit button.
[2115] Step 4:
[2116] The terminal transmits the evaluation data to the server.
[2117] Step 5:
[2118] The server stores the rating data in a database.
[2119] Step 6:
[2120] The server sends an evaluation completion message to the terminal.
[2121] Step 7:
[2122] The terminal displays a completion message to the user.
[2123] View Feedback
[2124] Step 1:
[2125] A user visits the prompt details page.
[2126] Step 2:
[2127] The device sends the prompt ID to the server.
[2128] Step 3:
[2129] The server retrieves the evaluation and feedback for the prompt from the database and sends it to the terminal.
[2130] Step 4:
[2131] The feedback information acquired by the terminal is displayed to the user.
[2132] Subscriptions and Advertising
[2133] Subscribe
[2134] Step 1:
[2135] A user visits the subscriptions page.
[2136] Step 2:
[2137] The device will display the subscription plan and payment form.
[2138] Step 3:
[2139] The user selects a plan, enters payment information, and clicks the Sign Up button.
[2140] Step 4:
[2141] The terminal sends the payment information to the server.
[2142] Step 5:
[2143] The server forwards the payment information to the payment gateway.
[2144] Step 6:
[2145] The server receives the payment result and updates the subscription status in the database.
[2146] Step 7:
[2147] The server sends a registration completion message to the terminal.
[2148] Step 8:
[2149] The terminal displays a completion message to the user.
[2150] Displaying ads
[2151] Step 1:
[2152] The user views a free prompt.
[2153] Step 2:
[2154] The terminal sends the prompt ID currently being displayed to the server.
[2155] Step 3:
[2156] The server retrieves advertising data related to the prompt from a database.
[2157] Step 4:
[2158] The server transmits the advertisement data to the terminal.
[2159] Step 5:
[2160] The terminal displays the advertisement data to the user.
[2161] Example 2
[2162] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[2163] Conventional AI-generated prompt systems lack the ability to efficiently manage, share, and evaluate user-entered data. Furthermore, they lack the ability to recognize user emotions and optimize the system, resulting in a poor user experience. In particular, they face challenges in providing content that adapts to stressful situations and different emotional states.
[2164] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for receiving input data generated by a user, a database for storing the input data, means for searching for input data stored in the database, means for allowing the user to download or use the input data, means for collecting emotion data from an input device built into the terminal to recognize the user's emotion, emotion engine means for analyzing the emotion data, and means for customizing search results and suggested content based on the emotion data. This enables the user to receive appropriate content according to their emotional state, improving the user experience.
[2165] "User" means any individual or entity that utilizes the System to create, view, and evaluate Input Data.
[2166] "Input Data" means user-generated data, such as text, images, and audio, that is processed and stored by the system.
[2167] A "database" is a storage system for organizing and storing input data and related information, with search and retrieval capabilities.
[2168] The "receiving means" is a function that allows the server to receive input data sent from the user.
[2169] The "storage means" is a function for storing received input data in a database.
[2170] "Search means" refers to a function for searching input data in a database based on specific conditions.
[2171] "Downloading means" refers to a function that allows a user to download input data stored in the database to their own terminal.
[2172] "Means of use" refers to functions that allow a user to perform operations such as viewing, editing, and evaluating saved input data.
[2173] "Emotion data" refers to information about the user's emotional state analyzed from their facial expressions and voice.
[2174] An "emotion engine" is software or hardware that analyzes collected emotion data to determine a user's current emotional state.
[2175] "Customization tools" refers to functionality for tailoring search results and suggested content based on the emotional state identified by the emotion engine.
[2176] "Payment Gateway" means a system for processing user-entered payment information and updating subscription status.
[2177] "Subscription Plan" means a service contract plan that a User can select and that provides certain benefits.
[2178] "Benefit provision means" refers to a function for providing benefits to users based on a subscription plan.
[2179] "Rating data" refers to information about the ratings that users give to other prompts.
[2180] The "display means" refers to a function for visually presenting collected information such as emotion data and evaluation data to the user.
[2181] The present invention provides a system for efficiently creating, sharing, and rating prompts that users input to AI models, and for recognizing user emotions to improve system functionality. Specific embodiments for implementing the present invention will now be described.
[2182] Overall system overview
[2183] This system mainly consists of a server, user terminals, a database, and an emotion engine. The server receives, stores, searches, downloads, and manages ratings of input data. The user terminal creates prompts, searches, downloads, and collects ratings and emotion data. The database manages input data, rating data, and subscription information. The emotion engine analyzes the user's emotional state and adjusts the functions of the entire system.
[2184] Hardware and Software Used
[2185] Server: The server is built using web server software (e.g., Apache, Nginx) and a backend framework (e.g., Node.js, Django). A database system (e.g., MongoDB, PostgreSQL) is also used for data processing and storage management.
[2186] Terminal: User terminals are devices such as PCs, smartphones, and tablets. These terminals communicate with the server via a web browser and provide functionality using front-end technologies (e.g., HTML, CSS, JavaScript).
[2187] Emotion Engine: The emotion engine is built using AI models (e.g., TensorFlow, PyTorch) to analyze the user's facial and voice data.
[2188] Creating and sharing prompts
[2189] A user accesses the sign-up page using a device, enters the required information into the sign-up form, and sends it to the server, which validates the information and stores it in a database. Once the sign-up is complete, the user can log in and access the dashboard.
[2190] The dashboard displays a prompt creation form, where the user enters the title, description, and content of the prompt and clicks the submit button. The terminal sends the prompt data to the server, which validates it and stores it in the database.
[2191] Find and download prompts
[2192] When a user accesses the search page, the terminal displays a search form, and the user enters keywords to perform a search. The server searches the database based on the keywords and sends the results to the terminal. The user can select prompts of interest from the search results, and view and download detailed information.
[2193] Prompt evaluation and feedback
[2194] Users enter ratings for the prompts and send them to the server, which stores the ratings in a database and makes them available for other users to view.
[2195] User Emotion Recognition
[2196] While a user is using the system, the device's built-in camera and microphone collect emotional data. The emotion engine analyzes this data and sends the results to the server. The server then customizes search results and suggestions based on the emotional data to provide content that is appropriate for the user.
[2197] Examples of concrete examples and prompts
[2198] For example, if a user were to create a "Research prompt on new AI technologies," they would enter the following information:
[2199] Title: "Research into new AI technologies"
[2200] Description: "Dig deep into the latest trends and applications of AI technology"
[2201] What it is: "Providing insights into cutting-edge AI techniques using generative AI models."
[2202] Example prompts to be input to the generative AI model:
[2203] "Topic: Safety of self-driving cars"
[2204] Description: "Use AI to analyze safety issues associated with the rise of self-driving cars."
[2205] In this way, the present invention recognizes user emotions and improves system functionality, thereby further enhancing the user experience.
[2206] The flow of the identification process in the second embodiment will be described with reference to FIG.
[2207] Creating and posting prompts
[2208] Step 1: Sign-up process
[2209] 1. The terminal displays an input form.
[2210] Input: The user visits the sign-up page.
[2211] Data processing: Rendering input forms using HTML and CSS.
[2212] Output: The user is presented with a sign-up form.
[2213] 2. The user enters and submits the information.
[2214] Input: A user enters their name, email address, and password and clicks the Sign Up button.
[2215] Data processing: Convert the input data into JSON format using JavaScript and send it to the server.
[2216] Output: Data is sent to the server.
[2217] 3. The server validates the data.
[2218] Input: User information sent from the device in JSON format.
[2219] Data processing: Validate the data using the validation library.
[2220] Output: If validation is successful, instructions to save the data to the database.
[2221] 4. The server stores the data in a database.
[2222] Input: Successfully verified user information.
[2223] Data processing: Save data to a database using SQL or NoSQL commands.
[2224] Output: A successful save message is generated.
[2225] 5. The server sends a completion message.
[2226] Input: Save successful message.
[2227] Data processing: Convert the message into JSON format and send it to the device.
[2228] Output: A completion message is displayed on the terminal.
[2229] Step 2: The prompt creation process
[2230] 1. A user visits the dashboard.
[2231] Input: Dashboard access after successful login.
[2232] Data processing: Dashboard HTML and JavaScript are loaded.
[2233] Output: The user sees the dashboard.
[2234] 2. The user enters and submits the prompt.
[2235] Enter: The user enters the prompt title, description, and content and clicks the submit button.
[2236] Data processing: Convert the input data into JSON format using JavaScript and send it to the server.
[2237] Output: Data is sent to the server.
[2238] 3. The server validates the data.
[2239] Input: Prompt information sent from the terminal in JSON format.
[2240] Data processing: Validate the data using the validation library.
[2241] Output: If validation is successful, instructions to save the data to the database.
[2242] 4. The server stores the data in a database.
[2243] Input: The prompt data that was successfully validated.
[2244] Data processing: Save data to a database using SQL or NoSQL commands.
[2245] Output: A successful save message is generated.
[2246] 5. The server sends a completion message.
[2247] Input: Save successful message.
[2248] Data processing: Convert the message into JSON format and send it to the device.
[2249] Output: A completion message is displayed on the terminal.
[2250] Step 3: Prompt Management Process
[2251] 1. A user visits the dashboard.
[2252] Input: A user visits a dashboard.
[2253] Data processing: Dashboard HTML and JS are loaded.
[2254] Output: The dashboard is displayed to the user.
[2255] 2. The terminal requests prompt information from the server.
[2256] Input: Request from the dashboard.
[2257] Data processing: The server receives the request.
[2258] Output: A request is sent to the server.
[2259] 3. The server retrieves the prompt information from the database.
[2260] Input: A query based on the user ID.
[2261] Data manipulation: Execute queries using SQL and NoSQL commands.
[2262] Output: The prompt information is retrieved.
[2263] 4. The server sends the prompt information to the terminal.
[2264] Input: The retrieved prompt information.
[2265] Data processing: Convert data into JSON format and send it to the device.
[2266] Output: Prompt information is sent to the terminal.
[2267] 5. The terminal will display the prompt information.
[2268] Input: Prompt information received from the server.
[2269] Data Manipulation: Rendering prompt information using HTML and JavaScript.
[2270] Output: The prompt information is displayed to the user.
[2271] Find and download prompts
[2272] Step 1: Prompt search process
[2273] 1. The user visits the search page.
[2274] Input: Access to the search page.
[2275] Data processing: HTML and JS for the search page are loaded.
[2276] Output: The search box is displayed to the user.
[2277] 2. The user enters a search keyword and submits it.
[2278] Input: When a user types keywords into the search box and clicks the search button.
[2279] Data processing: Convert input data into JSON format and send it to the server.
[2280] Output: Data is sent to the server.
[2281] 3. The server performs a lookup in the database.
[2282] Input: Search keyword.
[2283] Data manipulation: Perform searches using SQL or NoSQL commands in the database.
[2284] Output: Search results are retrieved.
[2285] 4. The server sends the search results to the terminal.
[2286] Input: Search results.
[2287] Data processing: Convert data into JSON format and send it to the terminal.
[2288] Output: The results are sent to the terminal.
[2289] 5. The device will display the search results.
[2290] Input: Search results received from the server.
[2291] Data processing: Rendering search results using HTML and JavaScript.
[2292] Output: Search results are displayed to the user.
[2293] Step 2: Prompt details and download process
[2294] 1. The user selects a prompt.
[2295] Input: Select the prompt from the search results.
[2296] Data processing: The selected prompt ID is retrieved.
[2297] Output: The prompt ID is sent to the server.
[2298] 2. The device sends the prompt ID to the server.
[2299] Input: The selected prompt ID.
[2300] Data processing: Convert the prompt ID into JSON format and send it to the server.
[2301] Output: The prompt ID is sent to the server.
[2302] 3. The server retrieves the details from the database.
[2303] Input: A query based on the prompt ID.
[2304] Data manipulation: Execute queries using SQL and NoSQL commands.
[2305] Output: The prompt details are retrieved.
[2306] 4. The server sends the detailed information to the terminal.
[2307] Input: The retrieved prompt details.
[2308] Data processing: Convert data into JSON format and send it to the terminal.
[2309] Output: Detailed information is sent to the terminal.
[2310] 5. The terminal will display detailed information.
[2311] Input: The details received from the server.
[2312] Data manipulation: Render detailed information using HTML and JavaScript.
[2313] Output: Detailed information is displayed to the user.
[2314] 6. The user performs the download.
[2315] Input: User clicks the download button.
[2316] Data processing: Send a download request to the server.
[2317] Output: Prompt data is sent to the terminal and saved.
[2318] (Application example 2)
[2319] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[2320] While existing systems can manage and share user-generated input data, they lack the ability to customize it based on the user's emotional state. Furthermore, there is a lack of systems that can recognize the user's emotions and provide appropriate feedback and suggestions. This can result in a lack of improvement in the user experience and a decline in the value of the system.
[2321] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[2322] In this invention, the server includes means for receiving input data generated by a user, a database for storing the input data, means for searching for input data stored in the database, means for allowing the user to download or use the input data, means for recognizing and analyzing the user's emotions, means for customizing prompts based on the analyzed emotional data, and means for providing the customized prompts to the user, thereby enabling prompts to be created or suggested according to the user's emotional state, thereby improving the user experience.
[2323] "Input data" refers to user-generated information such as text, audio, and images.
[2324] "Database" refers to a system for efficiently storing and managing input data and related information.
[2325] "Search means" refers to the function of searching for input data in a database based on specific keywords or conditions.
[2326] "Downloading means" refers to a function for obtaining the input data required by the user onto his / her own terminal.
[2327] "User emotion" refers to the emotional and mental state expressed by the user, and is primarily analyzed from facial expressions and voice data.
[2328] "Means for analyzing" refers to algorithms and techniques for analyzing the user's emotional data and generating the results.
[2329] "Means of customization" refers to the ability to tailor prompts and suggestions based on analyzed emotional data.
[2330] "Means for providing" refers to the functionality for presenting customized prompts and suggestions to the user.
[2331] To implement this invention, it is necessary to build a system that receives, stores, and manages user-generated input data. This system consists of terminals, a server, and software operated by these.
[2332] First, the server receives input data generated by the user using a terminal. The terminal can be a device such as a smartphone or head-mounted display. Next, the input data is stored in a database by the server. A database is a system for processing large amounts of data, and a relational database management system such as MySQL or PostgreSQL is used.
[2333] Users can search the database via their terminal to retrieve stored input data. This search functionality is implemented using a search engine such as ElasticSearch.
[2334] Furthermore, the system is equipped with a function to recognize and analyze the user's emotions. This function is achieved by capturing the user's facial expressions and voice data using the device's camera and microphone, and analyzing this data using a deep learning model. Machine learning frameworks such as Keras are used for emotion analysis. The analyzed emotion data is sent to a server and stored in a database.
[2335] The server customizes prompts based on this emotional data and provides them to the user. For example, customization can be done by preferentially displaying prompts that will help the user relax if they are feeling stressed. As a specific example, the following prompt sentences can be input into the generative AI model:
[2336] Example prompt sentence:
[2337] If the user is feeling stressed, create a prompt that offers a video of a relaxing getaway.
[2338] In this way, prompts are dynamically adjusted according to the user's emotional state, resulting in a more personalized user experience. This has potential applications in a variety of areas, such as supporting relaxation and improving safety while driving.
[2339] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[2340] Step 1:
[2341] The user generates and sends input data using a terminal. The user generates data such as text, audio, or images and sends it to the server through the terminal. The input data is sent from the terminal to the server, and the next process begins.
[2342] Step 2:
[2343] The server stores the input data it receives in a database. The server first validates the data it receives to ensure it is in the proper format. It then uses a database management system to store the data. The input is the data sent by the user and the output is the record in the database.
[2344] Step 3:
[2345] A user uses a terminal to search a database. The server receives the search query and searches for corresponding data in the database using a search engine. The search results are sent from the server to the terminal and displayed to the user. The input is the search query and the output is the search result data.
[2346] Step 4:
[2347] The device uses a camera and microphone to collect facial and voice data from the user. These data are acquired in real time for emotion recognition. The input is the user's facial and voice data, and the output is to send these data to a server.
[2348] Step 5:
[2349] The server sends the received facial and voice data to the emotion analysis engine to recognize emotions. The emotion analysis engine uses a deep learning model to analyze emotions and generate results. The input is facial and voice data, and the output is analyzed emotion data.
[2350] Step 6:
[2351] The server customizes prompts based on the analyzed emotional data. The server selects appropriate prompts and suggestions depending on the user's emotional state. For example, if the user is feeling stressed, it will prioritize prompts that will help them relax. The input is the analyzed emotional data, and the output is customized prompts.
[2352] Step 7:
[2353] The server sends the customized prompt to the terminal and provides it to the user. The terminal receives the prompt and displays it on the screen or outputs it as speech. The input is the customized prompt, and the output is the prompt provided to the user.
[2354] Through this step, users can receive appropriate emotional prompts and entertainment content to maintain a relaxed state inside the self-driving vehicle.
[2355] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[2356] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[2357] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[2358] [Fourth embodiment]
[2359] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[2360] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[2361] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[2362] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[2363] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[2364] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[2365] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[2366] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[2367] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[2368] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[2369] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[2370] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[2371] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2372] This invention provides a system that allows users to effectively create, share, and evaluate prompts to be input to AI. Below, the system program and its processing are explained in natural language.
[2373] Creating and posting prompts
[2374] 1. Sign up as a prompt contributor
[2375] When a user accesses the sign-up page, the terminal displays an input form. The user enters their name, email address, password, etc. and clicks the sign-up button. The terminal sends the input information to the server, which verifies it and stores it in a database. A completion message is sent from the server to the terminal and displayed to the user.
[2376] 2. Create a prompt
[2377] When a user logs in and accesses the dashboard, the terminal displays a prompt creation form. The user enters the prompt details and clicks the submit button. The input information is sent from the terminal to the server, where it is validated and saved in the database. A save completion message is sent to the terminal and displayed.
[2378] 3. Managing prompts
[2379] When a user accesses the dashboard to manage the prompts posted by the user, the terminal requests the prompt information from the server, which retrieves the relevant prompt information from the database and sends it to the terminal, which then displays it to the user.
[2380] Find and download prompts
[2381] 1. Search for prompts
[2382] When a user accesses the search page, the terminal displays a search box. The user enters search keywords and clicks the search button. The search keywords are sent from the terminal to the server, and the server searches the database for the corresponding prompt and sends the results to the terminal. The terminal then displays the search results to the user.
[2383] 2. View and download prompt details
[2384] When the user selects a prompt they are interested in, the terminal sends the prompt ID to the server. The server retrieves the details of the prompt from the database and sends them to the terminal. The details are displayed to the user, and when the user clicks the download button, a download request is sent from the terminal to the server and the prompt data is sent to the terminal. The data is saved and a completion message is displayed to the user.
[2385] Prompt evaluation and feedback
[2386] 1. Evaluate the prompt
[2387] The user accesses a page for entering ratings in response to the prompt they used and enters the rating data. The rating data is sent from the terminal to the server, where it is stored in a database. A rating completion message is sent to the terminal and displayed.
[2388] 2. Viewing Feedback
[2389] When a user wants to see feedback for a specific prompt, the prompt ID is sent from the device to the server. The server retrieves the prompt's rating and feedback from the database and sends it to the device. The retrieved feedback information is then displayed to the user.
[2390] Subscriptions and Advertising
[2391] 1. Subscription Registration
[2392] When a user visits the subscription page, selects a plan, and enters payment information, the terminal sends it to the server, which then forwards the payment information to the payment gateway for processing, receives the result, and updates the subscription status in the database. A registration completion message is sent to the terminal and displayed to the user.
[2393] 2. Display of advertisements
[2394] When a user views a free prompt, the device sends the prompt ID currently displayed to the server. The server retrieves advertising data related to the prompt from the database and sends it to the device. The advertisement is then displayed to the user.
[2395] The processing flow will be explained below.
[2396] Creating and posting prompts
[2397] Prompt Contributor Sign-Up
[2398] Step 1:
[2399] A user visits the sign-up page.
[2400] Step 2:
[2401] The device displays the input form.
[2402] Step 3:
[2403] The user enters their name, email address, and password and clicks the Sign Up button.
[2404] Step 4:
[2405] The terminal sends the input information to the server.
[2406] Step 5:
[2407] The server validates the input information and stores it in a database.
[2408] Step 6:
[2409] The server sends a sign-up completion message to the terminal.
[2410] Step 7:
[2411] The terminal displays a completion message to the user.
[2412] Creating a Prompt
[2413] Step 1:
[2414] A user logs in and accesses the dashboard.
[2415] Step 2:
[2416] The terminal displays the prompt creation form.
[2417] Step 3:
[2418] The user enters the prompt details (title, description, content) and clicks the submit button.
[2419] Step 4:
[2420] The terminal sends the input information to the server.
[2421] Step 5:
[2422] The server validates the input information and stores it in a database.
[2423] Step 6:
[2424] The server sends a save completion message to the terminal.
[2425] Step 7:
[2426] The terminal displays a completion message to the user.
[2427] Managing Prompts
[2428] Step 1:
[2429] A user visits a dashboard.
[2430] Step 2:
[2431] The terminal requests prompt information for the currently logged-in user from the server.
[2432] Step 3:
[2433] The server retrieves the corresponding prompt information from the database and sends it to the terminal.
[2434] Step 4:
[2435] The terminal displays the obtained prompt information to the user.
[2436] Find and download prompts
[2437] Search prompts
[2438] Step 1:
[2439] A user visits a search page.
[2440] Step 2:
[2441] Your device will display a search box.
[2442] Step 3:
[2443] The user enters search keywords and clicks the search button.
[2444] Step 4:
[2445] The device sends the search keywords to the server.
[2446] Step 5:
[2447] The server searches the database for prompts based on the received keywords.
[2448] Step 6:
[2449] The server sends the search results to the terminal.
[2450] Step 7:
[2451] The terminal displays the search results to the user.
[2452] View and download prompt details
[2453] Step 1:
[2454] The user selects the prompt of interest from the search results.
[2455] Step 2:
[2456] The device sends the ID of the selected prompt to the server.
[2457] Step 3:
[2458] The server retrieves the detailed information of the corresponding prompt from the database and sends it to the terminal.
[2459] Step 4:
[2460] The terminal displays the detailed information to the user.
[2461] Step 5:
[2462] The user clicks the download button.
[2463] Step 6:
[2464] The device sends a download request to the server.
[2465] Step 7:
[2466] The server sends prompt data to the terminal.
[2467] Step 8:
[2468] The terminal saves the data and displays a completion message to the user.
[2469] Prompt evaluation and feedback
[2470] Evaluate prompts
[2471] Step 1:
[2472] A user visits the ratings page.
[2473] Step 2:
[2474] The terminal displays the evaluation input form.
[2475] Step 3:
[2476] The user enters the evaluation data and clicks the submit button.
[2477] Step 4:
[2478] The terminal transmits the evaluation data to the server.
[2479] Step 5:
[2480] The server stores the rating data in a database.
[2481] Step 6:
[2482] The server sends an evaluation completion message to the terminal.
[2483] Step 7:
[2484] The terminal displays a completion message to the user.
[2485] View Feedback
[2486] Step 1:
[2487] A user visits the prompt details page.
[2488] Step 2:
[2489] The device sends the prompt ID to the server.
[2490] Step 3:
[2491] The server retrieves the evaluation and feedback for the prompt from the database and sends it to the terminal.
[2492] Step 4:
[2493] The feedback information acquired by the terminal is displayed to the user.
[2494] Subscriptions and Advertising
[2495] Subscribe
[2496] Step 1:
[2497] A user visits the subscriptions page.
[2498] Step 2:
[2499] The device will display the subscription plan and payment form.
[2500] Step 3:
[2501] The user selects a plan, enters payment information, and clicks the Sign Up button.
[2502] Step 4:
[2503] The terminal sends the payment information to the server.
[2504] Step 5:
[2505] The server forwards the payment information to the payment gateway.
[2506] Step 6:
[2507] The server receives the payment result and updates the subscription status in the database.
[2508] Step 7:
[2509] The server sends a registration completion message to the terminal.
[2510] Step 8:
[2511] The terminal displays a completion message to the user.
[2512] Displaying ads
[2513] Step 1:
[2514] The user views a free prompt.
[2515] Step 2:
[2516] The terminal sends the prompt ID currently being displayed to the server.
[2517] Step 3:
[2518] The server retrieves advertising data related to the prompt from a database.
[2519] Step 4:
[2520] The server transmits the advertisement data to the terminal.
[2521] Step 5:
[2522] The terminal displays the advertisement data to the user.
[2523] Example 1
[2524] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2525] Previous systems required cumbersome operations for managing, searching, rating, and providing feedback on user-generated prompts, making them difficult to use efficiently. Furthermore, they did not properly manage user feedback and ratings to improve the quality of prompts. Furthermore, they lacked a mechanism for displaying appropriate advertisements to free users.
[2526] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[2527] In this invention, the server includes means for receiving input data generated by a user, database means for saving the input data, means for searching for input data saved in the database, means for a user to display information related to the input data, means for the user to download or use the input data, means for inputting a rating for the input data, means for saving the rating data in a database, means for displaying the rating data to other users, means for displaying advertisement data, and database means for handling the advertisement data, thereby enabling a user to consistently and efficiently perform processes from creating, sharing, and rating prompts to displaying advertisements.
[2528] "User" means any person or entity that uses the System to create, manage, rate, and search prompts.
[2529] "Input Data" refers to all data such as prompts, ratings, and feedback that a user provides to the system.
[2530] "Database" refers to a digital storage system for storing and managing the input data, evaluation data, and advertising data.
[2531] "Means of searching" refers to the function that allows the system to search input data in the database based on specific keywords or conditions.
[2532] The term "means for displaying information" refers to a function that enables the terminal to visually display to the user the input data and evaluation data acquired from the database.
[2533] "Means for downloading or making available" refers to the system's ability to obtain input data from the user and store it in a format that can be used later.
[2534] "Means for inputting ratings" refers to the functionality that allows a user to input and provide rating data in response to a particular prompt.
[2535] "Rating data" refers to the rating information entered by the user in response to a prompt.
[2536] "Advertising Data" refers to commercial information displayed in connection with a particular prompt or user action.
[2537] "Payment Gateway" refers to a system for processing a user's payment information.
[2538] "Subscription Plan" means a subscription-based plan selected by a User to access certain features of the System.
[2539] "Benefits" means any additional benefits or services provided to you under your Subscription Plan.
[2540] The present invention relates to a system that enables users to effectively create, share, and evaluate prompts to be input to AI. The system is composed of a server, a terminal, and a user. Specific embodiments of the system are described below.
[2541] System configuration
[2542] 1. Server
[2543] The server has the following functions:
[2544] Ability to receive user-generated input data
[2545] A database for storing input data
[2546] Ability to search input data stored in a database
[2547] A function that displays information related to the input data to the user
[2548] Ability to allow users to download or use input data
[2549] A function to input evaluations for input data
[2550] Ability to save evaluation data to a database
[2551] Ability to display rating data to other users
[2552] Ability to display advertising data
[2553] Database function for handling advertising data
[2554] Ability to manage subscription plans
[2555] A payment gateway to process your payment information
[2556] 2. Terminal
[2557] The terminal has the following functions:
[2558] Displaying the input form
[2559] Sending and receiving information to and from the server
[2560] Displaying information to the user
[2561] Download function
[2562] 3. Users
[2563] The user performs the following operations:
[2564] Sign up and log in
[2565] Creating a Prompt
[2566] Managing Prompts
[2567] Search prompts
[2568] View and download prompt details
[2569] Prompt evaluation and feedback
[2570] Subscribe
[2571] Viewing ads
[2572] Processing flow
[2573] Creating and posting prompts
[2574] A user visits the sign-up page and signs up by entering their name, email address, and password. The device sends this information to the server, which stores the user information in a database. The user then logs in and accesses the dashboard. They enter the prompt details in the prompt creation form and click the submit button. The device sends the input information to the server, which stores the prompt in a database.
[2575] As an example, suppose the user enters the following prompt text:
[2576] Create a new AI assistant character. Tell us its name, characteristics, and special abilities.
[2577] Find and download prompts
[2578] The user accesses the search page, enters search keywords, and clicks the search button. The device sends the search keywords to the server, which searches the database for relevant prompts and sends the results to the device. The user selects a specific prompt, displays details, and downloads the prompt data.
[2579] As an example, a user enters the following search keywords:
[2580] "Python Beginner Project"
[2581] Prompt evaluation and feedback
[2582] The user provides a rating for the prompt and sends the rating data through the terminal to the server, which stores the rating data in a database and displays it to other users.
[2583] Subscriptions and Advertising
[2584] Users select a plan on the subscription page, enter their payment information, and the payment is processed through the server via a payment gateway. Free users are shown relevant ads, and the ad data is managed by the server.
[2585] The above is an embodiment of the present invention, which allows users to efficiently manage, search, and rate prompts, and improves the overall system usage experience.
[2586] The flow of the identification process in the first embodiment will be described with reference to FIG.
[2587] Creating and posting prompts
[2588] Step 1:
[2589] A user visits a sign-up page. As input, the user enters their name, email address, and password. As output, data is generated that is sent to the server.
[2590] Specific behavior:
[2591] A user accesses a sign-up page in a browser and enters the name "Taro Yamada," the email address "taro@example.com," and the password "mypassword."
[2592] Step 2:
[2593] The terminal displays a sign-up form. The input contains the HTML data of the form. The output generates a web page that is displayed to the user.
[2594] Specific behavior:
[2595] The terminal displays a sign-up form in the user's browser and provides the above input fields.
[2596] Step 3:
[2597] The user clicks the sign-up button. The input contains the user's input data. The output generates the data sent from the device to the server.
[2598] Specific behavior:
[2599] The user clicks the "Sign Up" button and the entered data is sent to the server.
[2600] Step 4:
[2601] The device sends input information to the server. The input contains the user's input data. The output generates an HTTP request that is sent to the server.
[2602] Specific behavior:
[2603] The device sends the data entered by the user, including the name, email address, and password, to the server.
[2604] Step 5:
[2605] The server validates the input information. Input includes the submitted user data. Output is stored in a database or an error message is sent to the terminal.
[2606] Specific behavior:
[2607] The server checks for duplicate email addresses and password strength, and if there are no problems, it saves the user information in the database. If there are duplicates, it returns an error message.
[2608] Step 6:
[2609] The server saves the user information in the database. It contains the validated user data as input and produces a save completion status as output.
[2610] Specific behavior:
[2611] The server saves the name, email address, and password in the database and generates a save completion status.
[2612] Step 7:
[2613] The server sends a completion message to the terminal, containing the save completion status as input, and an HTTP response as output.
[2614] Specific behavior:
[2615] The server sends a message to the terminal saying "sign-up complete."
[2616] Step 8:
[2617] The terminal displays a completion message to the user. As input, it contains the completion message from the server. As output, it generates a web page that is displayed in the user's browser.
[2618] Specific behavior:
[2619] The device will display "Sign-up complete."
[2620] Find and download prompts
[2621] Step 1:
[2622] A user visits a search page. The input includes the URL of the search page. The output is a search form.
[2623] Specific behavior:
[2624] A user accesses the search page in a browser and displays the search form.
[2625] Step 2:
[2626] The device displays a search box containing the HTML data of the search form as input, and a web page as output.
[2627] Specific behavior:
[2628] The device displays a search box in the user's browser.
[2629] Step 3:
[2630] The user inputs a search keyword. The input contains the search keyword. The output is generated as data to be sent to the terminal.
[2631] Specific behavior:
[2632] A user types "Python beginner projects" into the search box and clicks the search button.
[2633] Step 4:
[2634] The device sends search keywords to the server. The input contains the search keywords entered by the user. The output is an HTTP request.
[2635] Specific behavior:
[2636] The terminal transmits the search keywords to the server.
[2637] Step 5:
[2638] The server performs a search in the database. The input includes the search keywords and the database information. The output is the search results.
[2639] Specific behavior:
[2640] The server searches the database for prompts for "Python beginner projects" and produces the appropriate results.
[2641] Step 6:
[2642] The server sends the search results to the terminal. The search result data is included as input. An HTTP response is generated as output.
[2643] Specific behavior:
[2644] The server sends the search results to the terminal.
[2645] Step 7:
[2646] The terminal displays the search results to the user. The input includes the search result data from the server. The output is a web page that is displayed in the user's browser.
[2647] Specific behavior:
[2648] The device will display the search result with the title "Python projects for beginners" and the description.
[2649] Step 8:
[2650] The user selects a specific prompt. As input, it contains the prompt ID. As output, it generates the data to be sent to the server.
[2651] Specific behavior:
[2652] The user selects "Python projects for beginners" from the search results and clicks the Show details button.
[2653] Step 9:
[2654] The device sends the prompt ID to the server. As input, it contains the prompt ID selected by the user. As output, an HTTP request is generated.
[2655] Specific behavior:
[2656] The terminal sends the prompt ID to the server.
[2657] Step 10:
[2658] The server retrieves prompt details from the database. As input, it contains the prompt ID. As output, it generates the prompt details.
[2659] Specific behavior:
[2660] The server retrieves the details of the corresponding prompt from the database.
[2661] Step 11:
[2662] The server sends the details to the terminal. As input, it contains the prompt details. As output, it generates an HTTP response.
[2663] Specific behavior:
[2664] The server sends the details of the prompt to the terminal.
[2665] Step 12:
[2666] The terminal displays the details to the user. As input, it contains the details from the server. As output, it generates a web page that is displayed in the user's browser.
[2667] Specific behavior:
[2668] The terminal will display detailed information about "Python projects for beginners."
[2669] Step 13:
[2670] The user clicks the download button. The input contains the prompt data. The output generates the data to be sent to the device.
[2671] Specific behavior:
[2672] The user clicks the "Download" button to retrieve the prompt data.
[2673] Step 14:
[2674] The device sends a download request to the server, which includes the prompt details as input, and generates an HTTP request as output.
[2675] Specific behavior:
[2676] The terminal sends a download request to the server.
[2677] Step 15:
[2678] The server sends prompt data to the terminal. As input, it contains prompt details. As output, it generates prompt data.
[2679] Specific behavior:
[2680] The server sends the prompt data to the terminal.
[2681] Step 16:
[2682] The terminal saves the data and displays a completion message to the user. Prompt data is included as input. A save completion message is generated as output.
[2683] Specific behavior:
[2684] The terminal saves the downloaded prompt data and displays a message to the user saying "download complete."
[2685] (Application example 1)
[2686] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2687] In the modern advertising industry, there is a need to quickly generate, evaluate, and optimize effective advertising creatives. However, the process of generating advertising creatives requires a lot of time and resources, making it difficult to establish an effective feedback loop. This makes it difficult to maximize the performance of advertising campaigns.
[2688] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[2689] In this invention, the server includes means for receiving input data generated by a user, a database for storing the input data, means for searching for the input data stored in the database, means for allowing the user to download or use the input data, means for using a generative AI model to generate prompts for advertising creatives, means for sharing the generated prompts for advertising creatives within a team, and means for evaluating advertising effectiveness based on the prompts and storing the evaluation data in a database, thereby enabling advertising creatives to be quickly generated, evaluated, and shared.
[2690] "User" means a person or entity that utilizes the System to generate, evaluate, and share Input Data.
[2691] "Input Data" is text data that includes user-generated advertising creative and prompts.
[2692] The "database" is a storage device for storing and managing the input data and evaluation data.
[2693] "Generative AI model" refers to artificial intelligence technology that generates ad creatives based on user-entered prompts.
[2694] A "prompt" is a set of instructions or input data that a generative AI model uses to create advertising creative.
[2695] "Ad creative" refers to the marketing content, such as text, images, and videos, used in an advertising campaign.
[2696] "Evaluation Data" means performance metrics such as click rates and conversion rates that indicate the effectiveness of the prompts generated and used.
[2697] A "subscription plan" is a fee plan for a user to continue using the system, and may include various benefits.
[2698] "Payment Information" means payment instruments such as credit card information or bank account information used to process fees for Subscription Plans.
[2699] A "payment gateway" is a system that processes payment information and executes payments.
[2700] "Share with team" refers to sharing the generated ad creative prompt with other users involved in the same project or campaign.
[2701] The present invention is a system for effectively creating, sharing, and evaluating advertising creatives. The system receives user-generated input data and implements a series of processes to store, search, share, and evaluate it. Specifically, it uses a generative AI model to generate advertising creatives based on prompts, collects evaluation data, and optimizes them.
[2702] System Overview
[2703] The system includes the following main components:
[2704] 1. Hardware: Smartphone (iOS or Android), smart glasses (e.g., Google Glass).
[2705] 2. Software:
[2706] Front-end: Building the user interface using React Native.
[2707] Backend: Node.js and Express are used to realize server-side logic.
[2708] Database: MongoDB is used to store input and evaluation data.
[2709] Generative AI model: Uses OpenAI GPT to generate prompts for ad creative.
[2710] System Operation
[2711] 1. Prompt creation: The user enters a prompt for the ad creative through a dedicated application. For example, the user may enter, "Please create an ad copy for our new spring products."
[2712] 2. Prompt sending and processing: The prompt entered by the user is sent from the device to the server, which passes it to a generative AI model (OpenAI GPT) to generate ad copy.
[2713] 3. Sharing generated prompts: The generated ad copy is stored in a database and shared with the team via a link or QR code, which team members can access in real time via their smartphones or smart glasses.
[2714] 4. Evaluation of advertising effectiveness: Once the generated advertising creative is used, evaluation data such as click-through rate and conversion rate are automatically collected. This data is stored in a database and can be viewed by users.
[2715] 5. Feedback of rating data: Rating data is fed back to prompt creators through the system and used to optimize advertising creatives.
[2716] Specific examples
[2717] For example, a marketer might enter:
[2718] "Write advertising copy for our new spring products."
[2719] The generative AI model then creates ad copy such as "Check out the new spring fashions now! Special offers!", which is then saved in a database and shared with the team. The generated ad copy is then used in actual campaigns, and evaluation data such as click-through rates and conversion rates is collected. This data is then fed back to the prompt creators to help them create future prompts.
[2720] In this way, the system consistently supports the process from the creation to evaluation of advertising creatives, enabling the realization of effective marketing campaigns.
[2721] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[2722] Step 1:
[2723] The user inputs a prompt for the advertising creative. The user launches a dedicated application and inputs a prompt such as, "Please create advertising copy for our new spring products." The input data is sent from the device to the server.
[2724] Step 2:
[2725] The server receives the input data. The server receives the prompt sent by the user, validates its contents, and saves the input data to the database after confirming that it is valid.
[2726] Step 3:
[2727] The server uses the generative AI model to generate ad creative. Specifically, the server passes the prompt text saved earlier to the generative AI model (OpenAI GPT) and instructs it to generate ad copy. The AI model generates ad copy such as "Check out the new spring fashion now! Special offers!" This generated data is returned to the server.
[2728] Step 4:
[2729] The server stores the generated ad copy in a database. The ad copy received from the generative AI model is stored in a database for future searching and sharing. A message is sent to the device to confirm that the copy has been saved.
[2730] Step 5:
[2731] The device notifies the user of the generated ad copy and generates a sharing link. The device receives a save completion message from the server and notifies the user that the ad copy has been generated. At the same time, it generates a link or QR code for sharing the ad copy within the team and provides it to the user.
[2732] Step 6:
[2733] The user uses the generated ad copy to run an advertising campaign. The user uses the generated ad copy to launch a campaign on various advertising platforms. The user monitors the effectiveness of the campaign and makes adjustments as necessary.
[2734] Step 7:
[2735] The server collects advertising effectiveness data and stores it in a database. After an advertising campaign is run, effectiveness data such as click-through rates and conversion rates are automatically collected. This data is sent to the server and stored in a database.
[2736] Step 8:
[2737] The server provides feedback on the evaluation data to the prompt creator, who then visualizes the collected evaluation data and provides it to the prompt creator. This allows users to understand the effectiveness of the ad creative and helps them create prompts for the next time.
[2738] Through these steps, we provide a system that consistently supports the process from generating advertising creatives to evaluating them, enabling the realization of effective marketing campaigns.
[2739] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[2740] This invention provides a system that allows users to efficiently create, share, and evaluate prompts that they input to AI, and also recognizes user emotions to improve system functionality. Below, the system program and its processing are explained in natural language.
[2741] Creating and posting prompts
[2742] 1. Sign up as a prompt contributor
[2743] When a user accesses the sign-up page, the terminal displays an input form. The user enters their name, email address, and password and clicks the sign-up button. The terminal sends the input information to the server, which verifies it and stores it in a database. A completion message is sent from the server to the terminal and displayed to the user.
[2744] 2. Create a prompt
[2745] When a user logs in and accesses the dashboard, the terminal displays a prompt creation form. The user enters the prompt details (title, description, content) and clicks the submit button. The entered information is sent from the terminal to the server, where it is validated and saved in the database. A save completion message is sent to the terminal and displayed.
[2746] 3. Managing prompts
[2747] When a user accesses the dashboard to manage the prompts posted by the user, the terminal requests the prompt information from the server, which retrieves the relevant prompt information from the database and sends it to the terminal, which then displays it to the user.
[2748] Find and download prompts
[2749] 1. Search for prompts
[2750] When a user accesses the search page, the terminal displays a search box. The user enters search keywords and clicks the search button. The search keywords are sent from the terminal to the server, and the server searches the database for the corresponding prompt and sends the results to the terminal. The terminal then displays the search results to the user.
[2751] 2. View and download prompt details
[2752] When the user selects a prompt they are interested in, the terminal sends the prompt ID to the server. The server retrieves the details of the prompt from the database and sends them to the terminal. The details are displayed to the user, and when the user clicks the download button, a download request is sent from the terminal to the server and the prompt data is sent to the terminal. The data is saved and a completion message is displayed to the user.
[2753] Prompt evaluation and feedback
[2754] 1. Evaluate the prompt
[2755] When a user accesses the rating page, the terminal displays a rating input form. The user enters rating data and clicks the submit button. The rating data is sent from the terminal to the server, where it is stored in a database. A rating completion message is sent to the terminal and displayed.
[2756] 2. Viewing Feedback
[2757] When a user wants to see feedback for a specific prompt, the prompt ID is sent from the device to the server. The server retrieves the prompt's rating and feedback from the database and sends it to the device. The retrieved feedback information is then displayed to the user.
[2758] Subscriptions and Advertising
[2759] 1. Subscription Registration
[2760] When a user visits the subscription page, selects a plan, and enters payment information, the terminal sends it to the server, which then forwards the payment information to the payment gateway for processing, receives the result, and updates the subscription status in the database. A registration completion message is sent to the terminal and displayed to the user.
[2761] 2. Display of advertisements
[2762] When a user views a free prompt, the device sends the prompt ID currently displayed to the server. The server retrieves advertising data related to the prompt from the database and sends it to the device. The advertisement is then displayed to the user.
[2763] Emotion engine that recognizes user emotions
[2764] 1. Acquiring Emotion Data
[2765] When a user uses the system, the device's built-in camera and microphone are used to collect the user's facial expressions and voice data. The device then sends this data to the emotion engine, which then analyzes the user's emotions. The analyzed emotion data is then sent from the device to the server, which stores it in a database.
[2766] 2. Customize prompts based on emotional data
[2767] The server customizes the search results for prompts based on the emotional data recognized by the emotion engine. For example, if the user is feeling stressed, prompts that help the user relax will be displayed preferentially. The device then displays the customized search results to the user.
[2768] 3. Adjusting suggestion prompts
[2769] The server adjusts the prompts it proposes to the user based on the emotion data recognized by the emotion engine. For example, if the user is feeling happy, it proposes a challenging prompt. The terminal displays the adjusted suggestion prompt to the user.
[2770] In this way, the present invention further enhances the user experience by recognizing the user's emotions and improving system functionality.
[2771] The processing flow will be explained below.
[2772] Emotion engine that recognizes user emotions
[2773] Acquiring emotion data
[2774] Step 1:
[2775] When a user uses the system, facial expressions and voice data are collected using the camera and microphone built into the device.
[2776] Step 2:
[2777] The facial expression and voice data collected by the device is sent to the emotion engine.
[2778] Step 3:
[2779] The emotion engine analyzes this data and identifies the user's emotion.
[2780] Step 4:
[2781] The emotion engine analyzes the emotion data and sends it to the device.
[2782] Step 5:
[2783] The emotion data received by the terminal is transmitted to the server.
[2784] Step 6:
[2785] The server stores the emotion data in a database.
[2786] Customize prompts based on sentiment data
[2787] Step 1:
[2788] The user searches for a prompt.
[2789] Step 2:
[2790] The terminal transmits the user's emotion data to the server.
[2791] Step 3:
[2792] The server uses the emotion data to search a database for prompts that match the user's current emotional state.
[2793] Step 4:
[2794] For example, if the user is feeling stressed, the server may prioritize prompts that help the user relax.
[2795] Step 5:
[2796] The server sends the customized search results to the device.
[2797] Step 6:
[2798] The terminal displays the search results to the user.
[2799] Adjusting suggestion prompts
[2800] Step 1:
[2801] The emotion engine analyzes the user's emotion data.
[2802] Step 2:
[2803] The terminal transmits the user's emotion data to the server.
[2804] Step 3:
[2805] The server generates a list based on the emotion data to suggest optimal prompts to the user.
[2806] Step 4:
[2807] For example, if the user is feeling happy, the server will include challenging prompts in the list.
[2808] Step 5:
[2809] The server sends a list of suggested prompts to the terminal.
[2810] Step 6:
[2811] The terminal displays a suggestion prompt to the user.
[2812] Creating and posting prompts
[2813] Prompt Contributor Sign-Up
[2814] Step 1:
[2815] A user visits the sign-up page.
[2816] Step 2:
[2817] The device displays the input form.
[2818] Step 3:
[2819] The user enters their name, email address, and password and clicks the Sign Up button.
[2820] Step 4:
[2821] The terminal sends the input information to the server.
[2822] Step 5:
[2823] The server validates the input information and stores it in a database.
[2824] Step 6:
[2825] The server sends a sign-up completion message to the terminal.
[2826] Step 7:
[2827] The terminal displays a completion message to the user.
[2828] Creating a Prompt
[2829] Step 1:
[2830] A user logs in and accesses the dashboard.
[2831] Step 2:
[2832] The terminal displays the prompt creation form.
[2833] Step 3:
[2834] The user enters the prompt details (title, description, content) and clicks the submit button.
[2835] Step 4:
[2836] The terminal sends the input information to the server.
[2837] Step 5:
[2838] The server validates the input information and stores it in a database.
[2839] Step 6:
[2840] The server sends a save completion message to the terminal.
[2841] Step 7:
[2842] The terminal displays a completion message to the user.
[2843] Managing Prompts
[2844] Step 1:
[2845] A user visits a dashboard.
[2846] Step 2:
[2847] The terminal requests prompt information for the currently logged-in user from the server.
[2848] Step 3:
[2849] The server retrieves the corresponding prompt information from the database and sends it to the terminal.
[2850] Step 4:
[2851] The terminal displays the obtained prompt information to the user.
[2852] Find and download prompts
[2853] Search prompts
[2854] Step 1:
[2855] A user visits a search page.
[2856] Step 2:
[2857] Your device will display a search box.
[2858] Step 3:
[2859] The user enters search keywords and clicks the search button.
[2860] Step 4:
[2861] The device sends the search keywords to the server.
[2862] Step 5:
[2863] The server searches the database for prompts based on the received keywords.
[2864] Step 6:
[2865] The server sends the search results to the terminal.
[2866] Step 7:
[2867] The terminal displays the search results to the user.
[2868] View and download prompt details
[2869] Step 1:
[2870] The user selects the prompt of interest from the search results.
[2871] Step 2:
[2872] The device sends the ID of the selected prompt to the server.
[2873] Step 3:
[2874] The server retrieves the detailed information of the corresponding prompt from the database and sends it to the terminal.
[2875] Step 4:
[2876] The terminal displays the detailed information to the user.
[2877] Step 5:
[2878] The user clicks the download button.
[2879] Step 6:
[2880] The device sends a download request to the server.
[2881] Step 7:
[2882] The server sends prompt data to the terminal.
[2883] Step 8:
[2884] The terminal saves the data and displays a completion message to the user.
[2885] Prompt evaluation and feedback
[2886] Evaluate prompts
[2887] Step 1:
[2888] A user visits the ratings page.
[2889] Step 2:
[2890] The terminal displays the evaluation input form.
[2891] Step 3:
[2892] The user enters the evaluation data and clicks the submit button.
[2893] Step 4:
[2894] The terminal transmits the evaluation data to the server.
[2895] Step 5:
[2896] The server stores the rating data in a database.
[2897] Step 6:
[2898] The server sends an evaluation completion message to the terminal.
[2899] Step 7:
[2900] The terminal displays a completion message to the user.
[2901] View Feedback
[2902] Step 1:
[2903] A user visits the prompt details page.
[2904] Step 2:
[2905] The device sends the prompt ID to the server.
[2906] Step 3:
[2907] The server retrieves the evaluation and feedback for the prompt from the database and sends it to the terminal.
[2908] Step 4:
[2909] The feedback information acquired by the terminal is displayed to the user.
[2910] Subscriptions and Advertising
[2911] Subscribe
[2912] Step 1:
[2913] A user visits the subscriptions page.
[2914] Step 2:
[2915] The device will display the subscription plan and payment form.
[2916] Step 3:
[2917] The user selects a plan, enters payment information, and clicks the Sign Up button.
[2918] Step 4:
[2919] The terminal sends the payment information to the server.
[2920] Step 5:
[2921] The server forwards the payment information to the payment gateway.
[2922] Step 6:
[2923] The server receives the payment result and updates the subscription status in the database.
[2924] Step 7:
[2925] The server sends a registration completion message to the terminal.
[2926] Step 8:
[2927] The terminal displays a completion message to the user.
[2928] Displaying ads
[2929] Step 1:
[2930] The user views a free prompt.
[2931] Step 2:
[2932] The terminal sends the prompt ID currently being displayed to the server.
[2933] Step 3:
[2934] The server retrieves advertising data related to the prompt from a database.
[2935] Step 4:
[2936] The server transmits the advertisement data to the terminal.
[2937] Step 5:
[2938] The terminal displays the advertisement data to the user.
[2939] Example 2
[2940] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2941] Conventional AI-generated prompt systems lack the ability to efficiently manage, share, and evaluate user-entered data. Furthermore, they lack the ability to recognize user emotions and optimize the system, resulting in a poor user experience. In particular, they face challenges in providing content that adapts to stressful situations and different emotional states.
[2942] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for receiving input data generated by a user, a database for storing the input data, means for searching for input data stored in the database, means for allowing the user to download or use the input data, means for collecting emotion data from an input device built into the terminal to recognize the user's emotion, emotion engine means for analyzing the emotion data, and means for customizing search results and suggested content based on the emotion data. This enables the user to receive appropriate content according to their emotional state, improving the user experience.
[2943] "User" means any individual or entity that utilizes the System to create, view, and evaluate Input Data.
[2944] "Input Data" means user-generated data, such as text, images, and audio, that is processed and stored by the system.
[2945] A "database" is a storage system for organizing and storing input data and related information, with search and retrieval capabilities.
[2946] The "receiving means" is a function that allows the server to receive input data sent from the user.
[2947] The "storage means" is a function for storing received input data in a database.
[2948] "Search means" refers to a function for searching input data in a database based on specific conditions.
[2949] "Downloading means" refers to a function that allows a user to download input data stored in the database to their own terminal.
[2950] "Means of use" refers to functions that allow a user to perform operations such as viewing, editing, and evaluating saved input data.
[2951] "Emotion data" refers to information about the user's emotional state analyzed from their facial expressions and voice.
[2952] An "emotion engine" is software or hardware that analyzes collected emotion data to determine a user's current emotional state.
[2953] "Customization tools" refers to functionality for tailoring search results and suggested content based on the emotional state identified by the emotion engine.
[2954] "Payment Gateway" means a system for processing user-entered payment information and updating subscription status.
[2955] "Subscription Plan" means a service contract plan that a User can select and that provides certain benefits.
[2956] "Benefit provision means" refers to a function for providing benefits to users based on a subscription plan.
[2957] "Rating data" refers to information about the ratings that users give to other prompts.
[2958] The "display means" refers to a function for visually presenting collected information such as emotion data and evaluation data to the user.
[2959] The present invention provides a system for efficiently creating, sharing, and rating prompts that users input to AI models, and for recognizing user emotions to improve system functionality. Specific embodiments for implementing the present invention will now be described.
[2960] Overall system overview
[2961] This system mainly consists of a server, user terminals, a database, and an emotion engine. The server receives, stores, searches, downloads, and manages ratings of input data. The user terminal creates prompts, searches, downloads, and collects ratings and emotion data. The database manages input data, rating data, and subscription information. The emotion engine analyzes the user's emotional state and adjusts the functions of the entire system.
[2962] Hardware and Software Used
[2963] Server: The server is built using web server software (e.g., Apache, Nginx) and a backend framework (e.g., Node.js, Django). A database system (e.g., MongoDB, PostgreSQL) is also used for data processing and storage management.
[2964] Terminal: User terminals are devices such as PCs, smartphones, and tablets. These terminals communicate with the server via a web browser and provide functionality using front-end technologies (e.g., HTML, CSS, JavaScript).
[2965] Emotion Engine: The emotion engine is built using AI models (e.g., TensorFlow, PyTorch) to analyze the user's facial and voice data.
[2966] Creating and sharing prompts
[2967] A user accesses the sign-up page using a device, enters the required information into the sign-up form, and sends it to the server, which validates the information and stores it in a database. Once the sign-up is complete, the user can log in and access the dashboard.
[2968] The dashboard displays a prompt creation form, where the user enters the title, description, and content of the prompt and clicks the submit button. The terminal sends the prompt data to the server, which validates it and stores it in the database.
[2969] Find and download prompts
[2970] When a user accesses the search page, the terminal displays a search form, and the user enters keywords to perform a search. The server searches the database based on the keywords and sends the results to the terminal. The user can select prompts of interest from the search results, and view and download detailed information.
[2971] Prompt evaluation and feedback
[2972] Users enter ratings for the prompts and send them to the server, which stores the ratings in a database and makes them available for other users to view.
[2973] User Emotion Recognition
[2974] While a user is using the system, the device's built-in camera and microphone collect emotional data. The emotion engine analyzes this data and sends the results to the server. The server then customizes search results and suggestions based on the emotional data to provide content that is appropriate for the user.
[2975] Examples of concrete examples and prompts
[2976] For example, if a user were to create a "Research prompt on new AI technologies," they would enter the following information:
[2977] Title: "Research into new AI technologies"
[2978] Description: "Dig deep into the latest trends and applications of AI technology"
[2979] What it is: "Providing insights into cutting-edge AI techniques using generative AI models."
[2980] Example prompts to be input to the generative AI model:
[2981] "Topic: Safety of self-driving cars"
[2982] Description: "Use AI to analyze safety issues associated with the rise of self-driving cars."
[2983] In this way, the present invention recognizes user emotions and improves system functionality, thereby further enhancing the user experience.
[2984] The flow of the identification process in the second embodiment will be described with reference to FIG.
[2985] Creating and posting prompts
[2986] Step 1: Sign-up process
[2987] 1. The terminal displays an input form.
[2988] Input: The user visits the sign-up page.
[2989] Data processing: Rendering input forms using HTML and CSS.
[2990] Output: The user is presented with a sign-up form.
[2991] 2. The user enters and submits the information.
[2992] Input: A user enters their name, email address, and password and clicks the Sign Up button.
[2993] Data processing: Convert the input data into JSON format using JavaScript and send it to the server.
[2994] Output: Data is sent to the server.
[2995] 3. The server validates the data.
[2996] Input: User information sent from the device in JSON format.
[2997] Data processing: Validate the data using the validation library.
[2998] Output: If validation is successful, instructions to save the data to the database.
[2999] 4. The server stores the data in a database.
[3000] Input: Successfully verified user information.
[3001] Data processing: Save data to a database using SQL or NoSQL commands.
[3002] Output: A successful save message is generated.
[3003] 5. The server sends a completion message.
[3004] Input: Save successful message.
[3005] Data processing: Convert the message into JSON format and send it to the device.
[3006] Output: A completion message is displayed on the terminal.
[3007] Step 2: The prompt creation process
[3008] 1. A user visits the dashboard.
[3009] Input: Dashboard access after successful login.
[3010] Data processing: Dashboard HTML and JavaScript are loaded.
[3011] Output: The user sees the dashboard.
[3012] 2. The user enters and submits the prompt.
[3013] Enter: The user enters the prompt title, description, and content and clicks the submit button.
[3014] Data processing: Convert the input data into JSON format using JavaScript and send it to the server.
[3015] Output: Data is sent to the server.
[3016] 3. The server validates the data.
[3017] Input: Prompt information sent from the terminal in JSON format.
[3018] Data processing: Validate the data using the validation library.
[3019] Output: If validation is successful, instructions to save the data to the database.
[3020] 4. The server stores the data in a database.
[3021] Input: The prompt data that was successfully validated.
[3022] Data processing: Save data to a database using SQL or NoSQL commands.
[3023] Output: A successful save message is generated.
[3024] 5. The server sends a completion message.
[3025] Input: Save successful message.
[3026] Data processing: Convert the message into JSON format and send it to the device.
[3027] Output: A completion message is displayed on the terminal.
[3028] Step 3: Prompt Management Process
[3029] 1. A user visits the dashboard.
[3030] Input: A user visits a dashboard.
[3031] Data processing: Dashboard HTML and JS are loaded.
[3032] Output: The dashboard is displayed to the user.
[3033] 2. The terminal requests prompt information from the server.
[3034] Input: Request from the dashboard.
[3035] Data processing: The server receives the request.
[3036] Output: A request is sent to the server.
[3037] 3. The server retrieves the prompt information from the database.
[3038] Input: A query based on the user ID.
[3039] Data manipulation: Execute queries using SQL and NoSQL commands.
[3040] Output: The prompt information is retrieved.
[3041] 4. The server sends the prompt information to the terminal.
[3042] Input: The retrieved prompt information.
[3043] Data processing: Convert data into JSON format and send it to the device.
[3044] Output: Prompt information is sent to the terminal.
[3045] 5. The terminal will display the prompt information.
[3046] Input: Prompt information received from the server.
[3047] Data Manipulation: Rendering prompt information using HTML and JavaScript.
[3048] Output: The prompt information is displayed to the user.
[3049] Find and download prompts
[3050] Step 1: Prompt search process
[3051] 1. The user visits the search page.
[3052] Input: Access to the search page.
[3053] Data processing: HTML and JS for the search page are loaded.
[3054] Output: The search box is displayed to the user.
[3055] 2. The user enters a search keyword and submits it.
[3056] Input: When a user types keywords into the search box and clicks the search button.
[3057] Data processing: Convert input data into JSON format and send it to the server.
[3058] Output: Data is sent to the server.
[3059] 3. The server performs a lookup in the database.
[3060] Input: Search keyword.
[3061] Data manipulation: Perform searches using SQL or NoSQL commands in the database.
[3062] Output: Search results are retrieved.
[3063] 4. The server sends the search results to the terminal.
[3064] Input: Search results.
[3065] Data processing: Convert data into JSON format and send it to the terminal.
[3066] Output: The results are sent to the terminal.
[3067] 5. The device will display the search results.
[3068] Input: Search results received from the server.
[3069] Data processing: Rendering search results using HTML and JavaScript.
[3070] Output: Search results are displayed to the user.
[3071] Step 2: Prompt details and download process
[3072] 1. The user selects a prompt.
[3073] Input: Select the prompt from the search results.
[3074] Data processing: The selected prompt ID is retrieved.
[3075] Output: The prompt ID is sent to the server.
[3076] 2. The device sends the prompt ID to the server.
[3077] Input: The selected prompt ID.
[3078] Data processing: Convert the prompt ID into JSON format and send it to the server.
[3079] Output: The prompt ID is sent to the server.
[3080] 3. The server retrieves the details from the database.
[3081] Input: A query based on the prompt ID.
[3082] Data manipulation: Execute queries using SQL and NoSQL commands.
[3083] Output: The prompt details are retrieved.
[3084] 4. The server sends the detailed information to the terminal.
[3085] Input: The retrieved prompt details.
[3086] Data processing: Convert data into JSON format and send it to the terminal.
[3087] Output: Detailed information is sent to the terminal.
[3088] 5. The terminal will display detailed information.
[3089] Input: The details received from the server.
[3090] Data manipulation: Render detailed information using HTML and JavaScript.
[3091] Output: Detailed information is displayed to the user.
[3092] 6. The user performs the download.
[3093] Input: User clicks the download button.
[3094] Data processing: Send a download request to the server.
[3095] Output: Prompt data is sent to the terminal and saved.
[3096] (Application example 2)
[3097] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[3098] While existing systems can manage and share user-generated input data, they lack the ability to customize it based on the user's emotional state. Furthermore, there is a lack of systems that can recognize the user's emotions and provide appropriate feedback and suggestions. This can result in a lack of improvement in the user experience and a decline in the value of the system.
[3099] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[3100] In this invention, the server includes means for receiving input data generated by a user, a database for storing the input data, means for searching for input data stored in the database, means for allowing the user to download or use the input data, means for recognizing and analyzing the user's emotions, means for customizing prompts based on the analyzed emotional data, and means for providing the customized prompts to the user, thereby enabling prompts to be created or suggested according to the user's emotional state, thereby improving the user experience.
[3101] "Input data" refers to user-generated information such as text, audio, and images.
[3102] "Database" refers to a system for efficiently storing and managing input data and related information.
[3103] "Search means" refers to the function of searching for input data in a database based on specific keywords or conditions.
[3104] "Dow...
Claims
1. means for receiving user-generated input data; a database for storing the input data; means for searching input data stored in said database; means for allowing said user to download or make available said input data; A system including:
2. a means for a user to select a subscription plan and enter payment information; payment gateway means for processing said payment information; means for updating a subscription status of said user; a database means for managing the subscription status; means for providing a reward to the user; The system of claim 1 , comprising:
3. a means for the user to input a rating for the prompt; means for storing the evaluation data in a database; means for displaying the evaluation data to other users; The system of claim 1 , comprising:
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A