System
The system addresses the issue of unreliable AI services by integrating user and provider registration, review, and feedback mechanisms, enhancing the reliability and quality of AI services through automated evaluation and feedback storage.
Patent Information
- Application Number
- JP2024115272
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-07-18
- Publication Date
- 2026-01-29
AI Technical Summary
The AI service market faces issues with unreliable and inaccurate information, lack of standards for service evaluation, and insufficient means for users to determine the reliability and quality of AI services, leading to confusion and potential harm.
A system that integrates user registration, AI service provider registration, service review and verification, evaluation based on review criteria, and user feedback mechanisms to ensure legality and quality, using a generative AI model for automated feedback storage and evaluation.
This system enhances the reliability and quality of AI services by providing a unified platform for appropriate matching between users and providers, ensuring legality and quality through integrated review and feedback mechanisms, and automating the evaluation process.
Smart Images

Figure 2026014275000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] With the recent advancement of AI technology, many AI services have been provided, but these services face issues such as copyright issues and the need to display data sources. Furthermore, when users select an AI service, they lack the necessary standards and information to determine its reliability and quality. This could lead to a market flooded with services based on inaccurate information or inappropriate data. This could cause confusion and harm to users, so a system is needed to ensure a healthy match between AI service providers and users. [Means for solving the problem]
[0005] The present invention provides a system for sound and appropriate matching between AI service providers and users. The system includes a means for enabling users to register and log in, a means for enabling AI service providers to register their services, a means for reviewing and verifying registered AI services, a means for evaluating the legality and quality of AI services based on review criteria, a means for users to search for and view registered AI services, and a means for users to evaluate and provide feedback on AI services. This system provides review criteria, including confirmation of copyright legality and display of data sources, and improves the reliability of services based on user ratings and feedback, thereby maintaining the soundness of the entire AI service market.
[0006] "User" means any person who searches for, uses or evaluates AI services through this system.
[0007] "AI services" refers to the provision of various functions and software that utilize artificial intelligence technology, including image recognition, natural language processing, and data analysis.
[0008] "Provider" means a person or organization that develops an AI service and provides information to register it on the Marketplace.
[0009] "User registration" is the process by which a user enters information required to use the system (such as name, email address, and password) into the system and creates an account.
[0010] "Logging in" is the process by which a user accesses their account using account information already registered with the system.
[0011] "Service registration" is the process by which an AI service provider enters and saves information to register their AI service in the system.
[0012] "Review" is the process by which the system checks the information on AI services registered by providers and evaluates them based on legality and quality.
[0013] "Review criteria" are the standards the system uses to evaluate AI services, including copyright legality, accuracy of data sources, and exclusion of harmful content.
[0014] "Search" is the process by which users find AI services within the system using specific keywords or categories.
[0015] "Viewing" is the process by which a user checks detailed information about the AI services provided by the system.
[0016] "Evaluation" is the process by which users provide feedback on the AI services they have used and index the quality and reliability of the services.
[0017] "Feedback" refers to comments and ratings provided by users based on their experience using AI services, and is information that can be used as reference by other users and providers.
[0018] "Marketplace" means an online platform where users and providers can trade or use AI services.
[0019] A "database" is a system that systematically stores and manages user information, service information, evaluations, etc. within the system. [Brief explanation of the drawings]
[0020] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3]FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0021] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0022] First, the terms used in the following description will be explained.
[0023] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0024] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0025] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0026] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0027] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0028] [First embodiment]
[0029] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0030] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0031] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0032] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0033] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0034] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0035] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0036] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0037] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0038] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0039] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0040] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0041] The present invention is a system designed to enable users to use AI services in a healthy and appropriate manner. Specifically, the system includes various means for enabling users to register and log in, for AI service providers to register services, for the review and confirmation of registered AI services, for users to search for and view AI services, and for users to evaluate and provide feedback on AI services.
[0042] Program processing
[0043] 1. User Registration and Login
[0044] When a user uses this system for the first time, they enter the required information (such as name, email address, and password) into a form to register an account from their device and send it to the server. The server receives this information, checks whether it meets the requirements, and then stores it in a database. When logging in, the user enters the email address and password they used when registering, and the server verifies and authenticates them.
[0045] 2. Registering AI services
[0046] When an AI service provider registers a new service, they enter detailed service information (service name, description, source of usage data, price, etc.) from their device and send it to the server. The server receives this information and reviews the legality and quality of the AI service based on the review criteria. If the review passes, the server registers the service in its database and adds it to the marketplace.
[0047] 3. Browse and search the Marketplace
[0048] When a user browses the marketplace to use an AI service, they search using categories and keywords on their device. The server extracts services that match the search criteria from the database and displays the results on the device. Detailed information about each AI service (description, price, rating, etc.) is also displayed.
[0049] 4. Use and Evaluation of the Service
[0050] When a user wishes to use an AI service, they complete the purchase procedure on the service details page from their device. After the purchase is completed, the server grants permission to use the service. After using the service, the user fills out a form to provide feedback and a rating, and sends it to the server. The server stores this rating in a database and reflects it for other users' reference.
[0051] Specific examples
[0052] User Registration and Login
[0053] Device: To register an account, the user (Yamada) enters his name, email address, and password and clicks the "Register" button.
[0054] Server: Receives registration information, checks the conditions, saves it in the database, and sends a message that registration was successful.
[0055] Yamada: After receiving the registration success message, enter your email address and password on the login screen to log in.
[0056] Registering AI services
[0057] Terminal: The provider (Mr. Sato) enters details of the new image recognition AI service and presses the "Register" button.
[0058] Server: Receives service information and checks its legality based on the screening criteria. If it passes, it is registered in the database and added to the marketplace.
[0059] Search the Marketplace
[0060] Device: The user (Mr. Tanaka) searches for an AI service using the keyword "image recognition."
[0061] Server: Extracts matching services from the database and displays them as search results on Tanaka's device.
[0062] Service Use and Evaluation
[0063] Device: On the details page of the service that Mr. Tanaka is interested in, he clicks the "Purchase" button and completes the purchase procedure.
[0064] Server: Confirms the purchase and grants permission to use the service. Receives feedback provided by Mr. Tanaka after use and stores it in a database.
[0065] By implementing the invention through the above steps, providers and users of AI services will be matched in a healthy and appropriate manner, improving the reliability and quality of the entire market.
[0066] The processing flow will be explained below.
[0067] User Registration and Login
[0068] User Registration
[0069] Step 1:
[0070] The user opens the application and clicks the "Register an account" button on their device.
[0071] Step 2:
[0072] The terminal receives the input form for account registration from the server and displays it on the screen.
[0073] Step 3:
[0074] The user enters their name, email address, and password and clicks the "Register" button.
[0075] Step 4:
[0076] The terminal transmits the entered registration information to the server.
[0077] Step 5:
[0078] The server receives the registration information and verifies that it meets the requirements (such as validating the email address format).
[0079] Step 6:
[0080] After confirmation, the server stores the user data in a database and sends a message to the terminal indicating successful registration.
[0081] Step 7:
[0082] The terminal displays a registration success message to the user.
[0083] User Login
[0084] Step 1:
[0085] The user visits the application's login screen.
[0086] Step 2:
[0087] The user enters their email address and password and clicks the "Login" button.
[0088] Step 3:
[0089] The device sends the login information to the server.
[0090] Step 4:
[0091] The server authenticates the received login information by checking it against the account information in its database.
[0092] Step 5:
[0093] The server sends the authentication result (success or failure) to the terminal.
[0094] Step 6:
[0095] If the terminal is successfully logged in, the user dashboard screen is displayed, and if the login is unsuccessful, an error message is displayed.
[0096] Registering AI services
[0097] Step 1:
[0098] The user clicks the "Service Registration" button to display the service registration screen on the terminal.
[0099] Step 2:
[0100] The terminal receives an input form for service registration from the server and displays it on the screen.
[0101] Step 3:
[0102] The user (service provider) enters the service name, description, source of usage data, price, and other detailed information, and clicks the "Register" button.
[0103] Step 4:
[0104] The terminal transmits the input service information to the server.
[0105] Step 5:
[0106] The server inspects the information it receives to ensure it complies with regulations and guidelines.
[0107] Step 6:
[0108] After the server confirms the information, it provisionally registers the service information and starts the review process.
[0109] Step 7:
[0110] The server's internal review system evaluates the service content, verifying the source of data used, copyright legality, and other compliance with regulations.
[0111] Step 8:
[0112] The server notifies the user of the results of the review. If the service passes, it will be officially added to the marketplace. If it fails, the server will provide detailed instructions on how to fix the problem.
[0113] Browse and search the Marketplace
[0114] Step 1:
[0115] The user clicks on the Marketplace menu to view category information and a list of current popular items on their device.
[0116] Step 2:
[0117] The user enters keywords in the search bar, sets conditions, and clicks the "Search" button.
[0118] Step 3:
[0119] The terminal sends the search criteria to the server.
[0120] Step 4:
[0121] The server extracts AI services that match the search criteria from the database and generates a list of results.
[0122] Step 5:
[0123] The server sends the search results to the terminal and displays them to the user.
[0124] Service Use and Evaluation
[0125] Step 1:
[0126] Users can click on the AI service of their interest from the search results and view detailed information on their device.
[0127] Step 2:
[0128] The user checks the service details and, if it is a paid service, clicks the "Purchase" button to complete the purchase procedure.
[0129] Step 3:
[0130] The terminal transmits the purchase procedure information to the server.
[0131] Step 4:
[0132] The server verifies the checkout information and processes the payment.
[0133] Step 5:
[0134] The server sends a purchase confirmation and permission to use to the device.
[0135] Step 6:
[0136] After using the service, the user accesses the evaluation form and inputs evaluation points and comments.
[0137] Step 7:
[0138] The terminal transmits the evaluation information to the server.
[0139] Step 8:
[0140] The server stores the received evaluation information in a database and reflects it as evaluation information for the service.
[0141] Example 1
[0142] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0143] Conventional AI service platforms provide separate functions such as user registration and login, AI service registration, legality and quality review, service search and evaluation, and feedback storage, but these functions are not integrated, resulting in issues of lack of convenience and reliability. Another issue is that feedback information is not properly stored, making it impossible for other users to utilize it. In addition, there are insufficient automated tools for evaluating the legality and quality of AI services, making it difficult to ensure overall reliability.
[0144] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0145] In this invention, the server includes a means for enabling users to register and log in, a means for enabling AI service providers to register services, a means for reviewing and verifying registered AI services, a means for evaluating the legality and quality of AI services based on review criteria, a means for users to search and browse registered AI services, a means for users to rate and provide feedback on AI services, and a means for storing the ratings and feedback in a database for other users to refer to. This enables healthy and appropriate interaction between users and AI service providers on a unified platform. Furthermore, automating the storage and evaluation of feedback using a generative AI model provides a highly reliable service environment.
[0146] "User" refers to any individual or legal entity that registers and logs in to use the system and search, use, and evaluate AI services.
[0147] "Provider" refers to an individual or corporation that registers an AI service in the system and provides that service to users.
[0148] "AI services" refers to various software and platform services provided using artificial intelligence technology.
[0149] "User registration" refers to the process by which a user provides necessary information, such as name, email address, and password, to use the system and saves that information in the system.
[0150] "Login" refers to the process by which a registered user authenticates by entering an email address and password in order to access the system.
[0151] "Service registration" refers to the process by which a provider registers a new AI service on the system by providing information such as the service name, description, source of usage data, and price.
[0152] "Review Criteria" refers to the rules and guidelines used to evaluate the legality and quality of registered AI services.
[0153] "Lawfulness" refers to the criteria for determining whether an AI service complies with laws and regulations.
[0154] "Quality" refers to the criteria for evaluating whether the functions and performance provided by an AI service meet certain standards.
[0155] "Search" refers to the process of browsing the database using keywords and categories that users enter to find a specific AI service on the system.
[0156] "Viewing" refers to the act of a user checking detailed information about an AI service displayed as a search result on the system.
[0157] "Evaluation" refers to the act of expressing the satisfaction and quality of the AI service a user has used using numerical values or comments.
[0158] "Feedback" refers to the opinions and impressions provided by users after using the service, which are stored in a database for the benefit of other users.
[0159] "Database" refers to a system for efficiently storing and managing various data including user information, service information, ratings and feedback.
[0160] A "generative AI model" refers to a software algorithm that uses artificial intelligence techniques to automatically perform evaluation and data analysis.
[0161] The present invention is a system that aims to enable users to use AI services in a healthy and appropriate manner, and is a platform that integrates user registration, AI service provision, search, use, evaluation, and feedback. Specific embodiments of this system are described below.
[0162] 1. User Registration and Login
[0163] When a user uses the system for the first time, they register an account from their terminal. The user enters the required information, such as name, email address, and password, and sends it to the server. The server receives this information, checks the requirements, and stores it in a database. It then sends a registration success message to the user. When logging in, the user enters the email address and password used during registration, and the server verifies and authenticates them.
[0164] Specific behavior:
[0165] Terminal: The user fills in the form and clicks the "Register" button.
[0166] Server: Receives registration information, checks the conditions, saves it in the database, and sends a registration success message.
[0167] 2. Registering AI services
[0168] AI service providers register new services by entering details such as the service name, description, source of usage data, and price on their devices and sending them to the server. The server receives this information and reviews it for legality and quality based on its review criteria. If the review passes, the server registers the service in its database and adds it to the marketplace.
[0169] Specific behavior:
[0170] Terminal: The provider enters the service details and clicks the "Register" button.
[0171] Server: Receives service information and checks its legality and quality against the screening criteria. Passed information is stored in the database and added to the marketplace.
[0172] 3. Browse and search the Marketplace
[0173] When a user wants to use an AI service, they access the marketplace from their device and search by category or keyword. The server extracts services that match the search criteria from the database and displays the results on the device.
[0174] Specific behavior:
[0175] Device: A user searches for a keyword such as "image recognition."
[0176] Server: Extracts matching services from the database and displays the search results on the device.
[0177] 4. Use and Evaluation of the Service
[0178] When a user wants to use an AI service, they complete the purchase procedure on the service details page from their device. Once the purchase is complete, the server grants permission to use the service. After using the service, the user enters information into an evaluation and feedback form and sends it to the server. The server stores this information in a database and makes it available to other users.
[0179] Specific behavior:
[0180] Device: The user clicks the "Purchase" button on the service details page.
[0181] Server: Confirms the purchase procedure and grants permission to use. Receives feedback after use and stores it in a database.
[0182] Hardware and software used
[0183] The following technologies are used to realize this system:
[0184] Database: Use Amazon Web Services (AWS) RDS.
[0185] Generative AI models: Use Google Cloud AI to automate the storage and evaluation of feedback.
[0186] Specific examples
[0187] User Registration and Login
[0188] Device: A user registers an account by entering their name, email address, and password and clicking the "Register" button.
[0189] Server: Receives the registration information, checks the conditions, saves it in the database, and sends a registration success message to the user.
[0190] User: After receiving the registration success message, enter your email address and password on the login screen to log in.
[0191] Registering AI services
[0192] Device: The provider enters details of the new image recognition AI service and clicks the "Register" button.
[0193] Server: Receives service information and checks its legality based on the screening criteria. If it passes, it is registered in the database and added to the marketplace.
[0194] Search the Marketplace
[0195] Device: A user searches for an AI service using the keyword "image recognition."
[0196] Server: Extracts matching services from the database and displays them as search results on the terminal.
[0197] Service Use and Evaluation
[0198] Terminal: The user clicks the "Purchase" button on the details page of the service they are interested in and completes the purchase process.
[0199] Server: Confirms purchases and grants permission to use. Receives feedback provided by users after use and stores it in a database.
[0200] Example prompts to input to a generative AI model:
[0201] "Please assess the legality of image recognition services. Are the sources of the data used publicly available? What criteria should you use to assess the quality of the service?"
[0202] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0203] User Registration and Login
[0204] Step 1: Fill out the user registration form
[0205] Terminal: A user visits the system's user registration page and enters the required information, such as name, email address, password, etc. Simple client-side validation is also performed to ensure all input data is correct (e.g., checking for blank spaces, checking email address format).
[0206] Input: User information such as name, email address, and password
[0207] Output: Validated input data
[0208] Step 2: Send registration information to the server
[0209] Terminal: When the user clicks the "Register" button, information is sent to the server in JSON format using JavaScript.
[0210] Input: User information in JSON format
[0211] Output: Data sent to the server
[0212] Step 3: Check server requirements and save data
[0213] Server: Analyzes the received JSON data and checks whether all required fields have been entered, whether the email address format is correct, etc. If the conditions are met, the data is saved in a database such as MySQL.
[0214] Input: Parsed user information
[0215] Output: User information stored in the database and a successful registration status
[0216] Step 4: Send a registration success message
[0217] Server: When registration is complete, create a success message and return it to the user's device as an HTTP response.
[0218] Input: Registration success status
[0219] Output: Success message
[0220] Step 5: Fill in the login form
[0221] Device: The user accesses the login screen and enters their registered email address and password.
[0222] Input: Email address and password
[0223] Output: The entered credentials
[0224] Step 6: Authentication by the Server
[0225] Server: The server checks the entered authentication information against a database to authenticate the user. If authentication is successful, the server grants access to the user.
[0226] Input: The entered credentials
[0227] Output: Permission token or authentication error message
[0228] Registering AI services
[0229] Step 1: Fill out the service registration form
[0230] Device: The AI service provider fills in the registration form with the service name, description, source of usage data, price, etc.
[0231] Input: Service name, description, usage data source, price, etc.
[0232] Output: Validated input data
[0233] Step 2: Sending service information to the server
[0234] Terminal: The provider clicks the "Register" button, and information is sent to the server in JSON format using JavaScript.
[0235] Input: Service information in JSON format
[0236] Output: Data sent to the server
[0237] Step 3: Server checks for legitimacy and quality
[0238] Server: Validates received information based on screening criteria for legality and quality. This process may involve using generative AI models to assess the origin of the data used and the appropriateness of the service.
[0239] Input: Parsed service information
[0240] Output: Review results
[0241] Step 4: Save service information to the database
[0242] Server: Saves the service information that passed the review in a database.
[0243] Input: Service information that passed the review
[0244] Output: Service information stored in the database
[0245] Step 5: Add to Marketplace
[0246] Server: Adds the stored service information to the marketplace and makes it available to users.
[0247] Input: Service information stored in the database
[0248] Output: Service information added to the Marketplace
[0249] Browse and search the Marketplace
[0250] Step 1: Enter search keywords
[0251] Terminal: User enters keywords into the Marketplace search field.
[0252] Input: Search keyword
[0253] Output: Search query based on keywords
[0254] Step 2: Send a search query to the server
[0255] Terminal: After entering the keywords, click the "Search" button and the search query will be sent to the server.
[0256] Input: Search query
[0257] Output: The search query sent to the server
[0258] Step 3: Extracting matching services from the database
[0259] Server: Searches the database and extracts services that match the keywords.
[0260] Input: Search query
[0261] Output: Search results (list of service information)
[0262] Step 4: Display search results on your device
[0263] Server: Sends search results to the user's device and displays the results for the user to view.
[0264] Input: Search results (list of service information)
[0265] Output: Search results displayed on the device
[0266] Service Use and Evaluation
[0267] Step 1: Purchase on the service details page
[0268] Device: The user visits the details page of the service they are interested in and clicks the "Purchase" button.
[0269] Input: Service ID and user purchase information
[0270] Output: Purchase request
[0271] Step 2: The server confirms the purchase and grants permission to use it
[0272] Server: Confirms the purchase procedure and grants permission to use the service if payment is successful.
[0273] Input: Purchase request and payment information
[0274] Output: Permission granted
[0275] Step 3: Enter your feedback after use
[0276] Terminal: A user who has used the service enters their evaluation in a feedback form.
[0277] Input: Feedback and rating information
[0278] output: Input feedback information
[0279] Step 4: Send and store feedback to the server
[0280] Terminal: Sends the entered feedback to the server.
[0281] Input: Feedback and rating information
[0282] Output: Feedback information sent to the server
[0283] Server: Stores the received feedback in a database and reflects it to other users.
[0284] Input: Received feedback information
[0285] Output: Feedback information stored in a database
[0286] The above is a detailed description of the specific processing steps of the system program and the operations that accompany them.
[0287] (Application example 1)
[0288] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0289] In today's AI service market, many users want to use high-quality AI services. However, it is difficult for users to find trustworthy AI services, and providers have limited means to prove that their services are legitimate. In addition, users often have difficulty deciding which service to choose, and there is a lack of means to receive personalized recommendations.
[0290] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0291] In this invention, the server includes means for enabling user registration and login by users, means for enabling service registration by AI service providers, means for reviewing and confirming registered AI services, means for evaluating the legality and quality of AI services based on review criteria, means for users to search for and view registered AI services, means for users to evaluate and provide feedback on AI services, and means for making personalized product recommendations to users. This allows users to easily find reliable AI services and further enables personalized recommendations of optimal services to individual users.
[0292] "User registration" is the process by which a user creates an account by providing the information necessary to use the system.
[0293] "Login" is the procedure by which an already registered user enters authentication information to access the system.
[0294] "AI service provider" refers to an individual or organization that develops services based on AI technology and provides them on the system.
[0295] "Service registration" is the process by which an AI service provider registers and publicizes their service in the system.
[0296] "Review" is the process of verifying whether registered AI services meet established standards.
[0297] "Verification" is a procedure that determines, through review, that a service is legal and meets quality standards.
[0298] "Lawfulness" refers to the state in which an AI service does not violate legal requirements or regulations.
[0299] "Quality" is a comprehensive evaluation criterion that includes the performance, reliability, and user satisfaction of the AI services provided.
[0300] "Search" is the process by which a user searches for an AI service using specific keywords or categories.
[0301] "Viewing" refers to the act of a user checking search results or service detail pages.
[0302] "Evaluation" refers to the user's opinion about the satisfaction and effectiveness of the AI service they used.
[0303] "Feedback" is the act of a user providing opinions, including suggestions for improvement and impressions, to a provider.
[0304] "Personalization" is a technique for individually recommending specific services based on a user's preferences and past behavior.
[0305] 1. Overview of the entire system
[0306] This invention is a system for enabling users to use AI services in a healthy and appropriate manner. The system provides functions for user registration and login, AI service registration and review, search and browsing, use and evaluation, and personalized recommendations.
[0307] 2. Hardware and Software Used
[0308] Hardware: Smartphones, general purpose servers.
[0309] Software: Flask (Python web framework), SQLAlchemy (database management).
[0310] 3. User Registration and Login
[0311] When a user uses this system for the first time, they enter the required information (name, email address, password, etc.) into the account registration form from their terminal and send it to the server. The server receives this information, checks whether it meets the requirements, and then stores it in a database. When logging in, the user enters the email address and password they used when registering, and the server verifies and authenticates them.
[0312] 4. AI Service Registration and Review
[0313] AI service providers input detailed service information (service name, description, source of usage data, price, etc.) from their devices and send it to the server. The server receives this information and evaluates its legality and quality based on its screening criteria. If the service passes the screening, the server registers it in its database and adds it to the marketplace.
[0314] 5. Search and Browse the Marketplace
[0315] When a user browses the marketplace to use an AI service, they search using categories and keywords on their device. The server extracts services that match the search criteria from the database and displays the results on the device. Detailed information about each AI service (description, price, rating, etc.) is also displayed.
[0316] 6. Use and Evaluation of the Service
[0317] When a user wishes to use an AI service, they complete the purchase procedure on the service details page from their device. After the purchase is completed, the server grants permission to use the service. After using the service, the user fills out a form to provide feedback and a rating, and sends it to the server. The server stores this rating in a database and reflects it for other users' reference.
[0318] 7. Personalized Product Recommendations
[0319] The server provides personalized product recommendations based on the user's past behavior and ratings, which improves the user experience and helps them use reliable services.
[0320] Specific examples
[0321] 1. User Registration
[0322] Device: The user enters their name, email address, and password and clicks the "Register" button.
[0323] Server: Receives registration information, checks the conditions, saves it in the database, and sends a message indicating successful registration.
[0324] User: After receiving the registration success message, they log in by entering their email address and password on the login screen.
[0325] 2. Service Search
[0326] Device: A user searches for an AI service using the keyword "image recognition."
[0327] Server: Retrieves matching services from the database and displays the search results.
[0328] 3. Service Recommendation
[0329] System: Randomly presents recommended AI services to users.
[0330] Example prompts for generative AI models
[0331] "Please register a new account using the following user information: Username: 'Yamada Taro', Email address: 'taro@example.com', Password: 'password123'"
[0332] "Search for available AI services using the keyword 'image recognition'."
[0333] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0334] Step 1:
[0335] User Registration and Login
[0336] Input: The user enters their name, email address, and password.
[0337] Processing: The terminal sends the entered information to the server, which verifies the received information and stores it in a database if it meets the requirements.
[0338] Output: A registration success message is displayed on the terminal. The user enters their email address and password on the login screen and submits them again to the server. The server validates them again and allows the user to access the system if authentication is successful.
[0339] What it does: The server uses SQLAlchemy to save the new user information to the database and returns a success message to the user. When logging in, it receives an authentication request from the front end and uses Flask to query the user database for authentication.
[0340] Step 2:
[0341] AI service registration and screening
[0342] Input: The AI service provider enters details about the service (service name, description, source of usage data, price, etc.).
[0343] Processing: The device sends the entered information to the server, which then evaluates the received information based on its screening criteria to verify its legitimacy and quality.
[0344] Output: If the review is successful, the service is registered in the database and added to the marketplace.
[0345] Specific operation: The server receives the service data and uses its internal logic to check whether the content complies with the review criteria. If legality and quality are confirmed, the service information is added to the database using SQLAlchemy and reflected in the marketplace.
[0346] Step 3:
[0347] Search and browse the marketplace
[0348] Input: A user searches using categories and keywords.
[0349] Processing: The device sends search criteria to the server. The server extracts services that match the search criteria from the database and sends the results to the device.
[0350] Output: A list of matching services will be displayed on the terminal, along with detailed information about each service (description, price, rating, etc.).
[0351] Specific operation: Receives keywords entered by the user from the front end, executes a database query using Flask, returns the search results in JSON format to the front end, and displays them.
[0352] Step 4:
[0353] Service Use and Evaluation
[0354] Input: The user selects the service of interest and completes the purchase process.
[0355] Processing: The device sends purchase information to the server. The server confirms the purchase and grants permission. After using the service, the user provides feedback and a rating.
[0356] Output: A confirmation message and authorization will be displayed on the device. Feedback and ratings will be stored in the database.
[0357] Specific operations: The server receives the purchase information and processes the payment. It then records the service permission in the database and returns a feedback form to the user. It also stores the rating and feedback received from the device in the database.
[0358] Step 5:
[0359] Personalized product recommendations
[0360] Input: User's past behavioral data and rating data.
[0361] Processing: The server analyzes the user's behavioral data and recommends appropriate AI services.
[0362] Output: The personalized recommendation is displayed on the user's device.
[0363] Specific operation: The server runs the recommendation algorithm using a generative AI model based on past behavioral data, returns the results to the front end using Flask, and displays the recommendation results on the device.
[0364] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0365] The present invention is a system designed to enable users to use AI services in a healthy and appropriate manner, specifically including various means for user registration and login, service registration by AI service providers, review and confirmation of registered AI services, user search and browsing of AI services, and user evaluation and feedback on AI services. Furthermore, the present invention improves the reliability and quality evaluation of AI services by obtaining emotional feedback from users through the combination of an emotion engine that recognizes user emotions.
[0366] Program processing
[0367] 1. User Registration and Login
[0368] When a user uses this system for the first time, they enter the required information (such as name, email address, and password) into a form to register an account from their device and send it to the server. The server receives this information, checks whether it meets the requirements, and then stores it in a database. When logging in, the user enters the email address and password they used when registering, and the server verifies and authenticates them.
[0369] 2. Registering AI services
[0370] When an AI service provider registers a new service, they enter detailed service information (service name, description, source of usage data, price, etc.) from their device and send it to the server. The server receives this information and reviews the legality and quality of the AI service based on the review criteria. If the review passes, the server registers the service in its database and adds it to the marketplace.
[0371] 3. Browse and search the Marketplace
[0372] When a user browses the marketplace to use an AI service, they search using categories and keywords on their device. The server extracts services that match the search criteria from the database and displays the results on the device. Detailed information about each AI service (description, price, rating, etc.) is also displayed.
[0373] 4. Operation of the Emotion Engine
[0374] While using the AI service, the emotion engine is activated and analyzes the user's facial expressions and voice using a camera or microphone. The analyzed emotion data is sent to the server in real time, and the server recognizes the user's emotional state based on that data. This recognition result is reflected in the evaluation and feedback of the AI service.
[0375] 5. Use and Evaluation of the Service
[0376] When a user wishes to use an AI service, they complete the purchase procedure on the service details page from their device. After the purchase is completed, the server grants permission to use the service. After using the service, the user fills out a form to provide feedback and a rating, and sends it to the server. In addition, the emotion data recognized by the emotion engine is also reflected in the rating. The server stores this rating and emotion data in a database and reflects it for other users' reference.
[0377] Specific examples
[0378] User Registration and Login
[0379] Device: To register an account, the user (Yamada) enters his name, email address, and password and clicks the "Register" button.
[0380] Server: Receives registration information, checks the conditions, saves it in the database, and sends a message indicating successful registration.
[0381] Yamada: Enter your email address and password on the login screen to log in.
[0382] Registering AI services
[0383] Terminal: The provider (Mr. Sato) enters details of the new image recognition AI service and presses the "Register" button.
[0384] Server: Receives service information and reviews it based on the review criteria. If it passes, it is registered in the database and added to the marketplace.
[0385] Search the Marketplace
[0386] Device: The user (Mr. Tanaka) searches for an AI service using the keyword "image recognition."
[0387] Server: Extracts matching services from the database and displays them as search results.
[0388] Emotion Engine Operation
[0389] Device: When Tanaka uses the service, the camera and microphone are activated and facial expressions and voice are analyzed.
[0390] Server: Receives the analysis results in real time and recognizes Tanaka's emotional data.
[0391] Service Use and Evaluation
[0392] Device: On the details page of the service that Mr. Tanaka is interested in, he clicks the "Purchase" button and completes the purchase procedure.
[0393] Server: Confirms the purchase and grants permission to use the app. Receives feedback provided by Tanaka after use and stores the rating and sentiment data.
[0394] By implementing the above steps, the invention will ensure a healthy and appropriate match between AI service providers and users, improving the reliability and quality of the entire market. By combining it with an emotion engine, emotional feedback can also be incorporated, resulting in more detailed and reliable evaluations.
[0395] The processing flow will be explained below.
[0396] User Registration and Login
[0397] User Registration
[0398] Step 1:
[0399] The user opens the application and clicks the "Register an account" button on their device.
[0400] Step 2:
[0401] The terminal receives the input form for account registration from the server and displays it on the screen.
[0402] Step 3:
[0403] The user enters their name, email address, and password and clicks the "Register" button.
[0404] Step 4:
[0405] The terminal transmits the entered registration information to the server.
[0406] Step 5:
[0407] The server receives the registration information and verifies that it meets the requirements (such as validating the email address format).
[0408] Step 6:
[0409] After confirmation, the server stores the user data in a database and sends a message to the terminal indicating successful registration.
[0410] Step 7:
[0411] The terminal displays a registration success message to the user.
[0412] User Login
[0413] Step 1:
[0414] The user visits the application's login screen.
[0415] Step 2:
[0416] The user enters their email address and password and clicks the "Login" button.
[0417] Step 3:
[0418] The device sends the login information to the server.
[0419] Step 4:
[0420] The server authenticates the received login information by checking it against the account information in its database.
[0421] Step 5:
[0422] The server sends the authentication result (success or failure) to the terminal.
[0423] Step 6:
[0424] If the terminal is successfully logged in, the user dashboard screen is displayed, and if the login is unsuccessful, an error message is displayed.
[0425] Registering AI services
[0426] Step 1:
[0427] The user clicks the "Service Registration" button to display the service registration screen on the terminal.
[0428] Step 2:
[0429] The terminal receives an input form for service registration from the server and displays it on the screen.
[0430] Step 3:
[0431] The user (service provider) enters the service name, description, source of usage data, price, and other detailed information, and clicks the "Register" button.
[0432] Step 4:
[0433] The terminal transmits the input service information to the server.
[0434] Step 5:
[0435] The server inspects the information it receives to ensure it complies with regulations and guidelines.
[0436] Step 6:
[0437] After the server confirms the information, it provisionally registers the service information and starts the review process.
[0438] Step 7:
[0439] The server's internal review system evaluates the service content, verifying the source of data used, copyright legality, and other compliance with regulations.
[0440] Step 8:
[0441] The server notifies the user of the results of the review. If the service passes, it will be officially added to the marketplace. If it fails, the server will provide detailed instructions on how to fix the problem.
[0442] Browse and search the Marketplace
[0443] Step 1:
[0444] The user clicks on the Marketplace menu to view category information and a list of current popular items on their device.
[0445] Step 2:
[0446] The user enters keywords in the search bar, sets conditions, and clicks the "Search" button.
[0447] Step 3:
[0448] The terminal sends the search criteria to the server.
[0449] Step 4:
[0450] The server extracts AI services that match the search criteria from the database and generates a list of results.
[0451] Step 5:
[0452] The server sends the search results to the terminal and displays them to the user.
[0453] Emotion Engine Operation
[0454] Step 1:
[0455] While a user is using an AI service, emotional data is collected using the device's camera or microphone.
[0456] Step 2:
[0457] The device analyzes facial expression data or voice data collected in real time to identify emotional states.
[0458] Step 3:
[0459] The terminal transmits the identified user's emotion data to the server.
[0460] Step 4:
[0461] Based on the emotion data received by the server, the user's emotional state at that time is recorded.
[0462] Step 5:
[0463] The server stores the recorded emotional data as a usage evaluation of the AI service and makes it available to other users as a reference.
[0464] Service Use and Evaluation
[0465] Step 1:
[0466] Users can select the AI service of interest from the search results and detailed information will be displayed on their device.
[0467] Step 2:
[0468] The user checks the service details and, if it is a paid service, clicks the "Purchase" button to complete the purchase procedure.
[0469] Step 3:
[0470] The terminal transmits the purchase procedure information to the server.
[0471] Step 4:
[0472] The server confirms the purchase procedure, completes the payment process, and then transmits usage permission to the terminal.
[0473] Step 5:
[0474] Once the user has finished using the service, they will access a screen where they can enter their feedback and rating.
[0475] Step 6:
[0476] The user inputs evaluation points and comments, and the terminal transmits the information to the server.
[0477] Step 7:
[0478] The server stores the received feedback and rating data in a database, and the emotion data collected by the emotion engine is also reflected in the rating.
[0479] Example 2
[0480] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0481] Currently, when using AI services, concerns about reliability and quality often arise between providers and users. Furthermore, due to a lack of verification of the legality of services and transparency in evaluations, it is difficult for users to use the services with peace of mind. Furthermore, conventional feedback systems do not easily reflect users' emotional feedback in their evaluations, making it difficult to grasp true user satisfaction.
[0482] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for enabling user registration and login, a means for enabling service registration by AI service providers, a means for reviewing and confirming registered AI services, a means for evaluating the legality and quality of AI services based on review criteria, a means for users to search for and browse registered AI services, a means for users to evaluate and provide feedback on AI services, and a means for obtaining feedback using an emotion engine that recognizes user emotions and reflecting it in the evaluation. This enables reliable matching between AI service providers and users, improving the reliability and quality of the entire market, and reflecting users' emotional feedback in the evaluation, making it possible to more accurately grasp satisfaction levels.
[0483] "User registration" is the process by which a new user enters their information (such as name, email address, and password) into the system to create an account.
[0484] "Login" is the process by which an already registered user enters authentication information (email address and password) and is authenticated in order to access the system.
[0485] "AI services" is a general term for various functions and applications provided based on artificial intelligence technology.
[0486] "Service registration" is the process by which an AI service provider enters details of a new service into the system, which then stores and manages that information in its database.
[0487] "Review and verification" is the process by which the system checks the content of registered AI services and verifies whether they comply with legality and quality standards.
[0488] "Search" is the process by which a user enters specific criteria (categories or keywords) and finds matching AI services within the system.
[0489] "Viewing" refers to a user displaying and checking search results and detailed information about registered AI services on a screen.
[0490] "Evaluation and feedback" is the process by which, after a user uses an AI service, they enter their opinions, impressions, and evaluation scores about the service into the system, which then stores them in a database.
[0491] "Emotion engine" refers to technology that analyzes and recognizes a user's emotional state from their facial expressions and voice.
[0492] "Means of obtaining feedback and reflecting it in the evaluation" refers to the process of using user emotional data analyzed by the emotion engine to reflect it in the evaluation of the AI service.
[0493] The present invention is a system that aims to enable users to use artificial intelligence (AI) services in a healthy and appropriate manner. The system operates as follows.
[0494] First, in order to use the system, a user must register from their terminal. The user enters their name, email address, and password and clicks the "Register" button. This information is sent from the terminal to the server, which verifies the received data and stores it in a database. The user then enters their email address and password on the login screen, and the server performs authentication.
[0495] Next, the AI service provider registers their service. The provider enters information such as the service name, description, source of usage data, and price on their device, and then presses the "Register" button. This information is also sent to the server, which reviews the service for legality and quality. The review is conducted based on the review criteria, and if it passes, it is registered in the database and displayed on the marketplace.
[0496] Users browse the marketplace and search for AI services by category or keyword. The server retrieves matching services from the database and displays them on the device. Detailed information about each service (description, price, ratings, etc.) is also displayed.
[0497] When a user uses the service, the emotion engine operates using the camera and microphone installed on the device. The user's facial expressions and voice are analyzed in real time during use, and the data is sent to the server. The server recognizes the user's emotional state based on the received data and reflects that emotional data in evaluations and feedback.
[0498] When a user purchases a service, they complete the purchase procedure on the service's details page from their device. The server verifies the purchase information and records it in a database. Once the purchase is complete, the user is authorized to use the service and provides feedback and a rating after subsequent use. This rating and feedback is sent from the device to the server, which stores it in a database. The stored data is reflected in the marketplace so that other users can refer to it.
[0499] Specifically, for example, if a user inputs the prompt, "Please tell me how to use the emotion engine to analyze user feedback in detail and use it to evaluate AI services," the system will analyze the emotion data acquired by the emotion engine and reflect the results in the user's feedback. In this way, trust and quality are improved between AI service providers and users, and users' emotional feedback is also reflected in evaluations, enabling a more accurate understanding of satisfaction levels.
[0500] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0501] Step 1:
[0502] The user enters their name, email address, and password and clicks the "Register" button. The device sends this information to the server. The server validates the information and checks whether it is in the correct format. Once validation is complete, the server saves the user information in a database and sends a message to the device indicating that registration was successful. The device then displays a message to the user indicating that registration was successful.
[0503] Step 2:
[0504] The user enters an email address and password on the login screen. The device sends the entered information to the server. The server retrieves the relevant user information from the database and compares it with the entered password to perform authentication. If authentication is successful, the server sends an authentication success message to the device. The device displays a login success message and a dashboard to the user.
[0505] Step 3:
[0506] The AI service provider enters detailed information such as the service name, description, source of usage data, and price, and presses the "Register" button. The device then sends this information to the server. The server receives the service information and evaluates its content based on the specified screening criteria. Specifically, it checks the legality and quality of the usage data. If the screening is successful, the server registers the service in its database and displays it on the marketplace. The device then notifies the service provider of the screening results.
[0507] Step 4:
[0508] The user browses the marketplace and searches using categories and keywords. The device sends the user's search criteria to the server. The server extracts matching services from the database and sends them to the device as search results. The device displays the search results received from the server to the user, along with detailed information about each service (description, price, rating, etc.).
[0509] Step 5:
[0510] When a user uses an AI service, the emotion engine operates using the camera and microphone installed on the device. The user's facial expressions and voice are collected in real time during use. The device sends the collected data to a server. The server analyzes the received emotion data and stores the results in a database. This data indicates the user's emotional state while using the service.
[0511] Step 6:
[0512] The user clicks the "Purchase" button on the details page of the AI service they are interested in, enters the required information, and completes the purchase procedure. The device sends the purchase information to the server. The server verifies the purchase information and records it in a database. Once the purchase procedure is complete, the server sends usage permission to the device. The device notifies the user of usage permission.
[0513] Step 7:
[0514] After using the service, the user inputs and submits a rating and feedback. The device then sends the user's feedback information to the server. The server then stores the received feedback and rating in a database. The stored data is reflected in the marketplace and can be used as reference by other users.
[0515] Step 8:
[0516] Based on the emotional data obtained by the emotion engine, the server reflects this data in the user's evaluation. The device notifies the user of the emotional feedback results, allowing other users to refer to them, enabling reliable matching between AI service providers and users.
[0517] (Application example 2)
[0518] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0519] In modern society, users require reliable and high-quality AI services that they can use with confidence. However, existing systems are unable to take users' emotional feedback into account when evaluating services, making it difficult to provide accurate evaluations. Furthermore, the legality and quality of AI services are not adequately vetted, making it difficult for users to provide reliable services. Furthermore, detailed information related to the user's payment process is not adequately managed, leaving a need for improved user experience.
[0520] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for enabling user registration and login by users, means for enabling service registration by AI service providers, means for reviewing and confirming registered AI services, means for evaluating the legality and quality of AI services based on review criteria, means for users to search for and browse registered AI services, means for users to evaluate and provide feedback on AI services, means for analyzing the user's facial expressions and voice using an emotion engine and collecting emotional feedback data in real time, means for reflecting the collected emotional feedback data in service evaluations, and means for users to enter detailed payment information and make payments. This enables reliable evaluations that reflect the user's emotional feedback, making it possible to improve the user experience while ensuring the legality and quality of AI services.
[0521] "User registration" is the process by which a user provides the necessary information to access the system and creates an account within the system.
[0522] "Logging in" is the process by which an already registered user signs into a system by providing authentication information (e.g., email address and password) to access their account.
[0523] An "AI service provider" is a company or individual that develops services using AI technology and provides those services to users.
[0524] "Service registration" is the process by which an AI service provider enters detailed information about the AI service they have developed (such as service name, description, and price) into the system, making it available for use.
[0525] "Review" refers to a series of evaluation processes conducted to verify the legality and quality of registered AI services.
[0526] "Verification" is the process of rechecking the reliability and quality of AI services based on the results of the review.
[0527] "Search" is the process by which a user enters specific criteria (e.g., keywords, categories) to find AI services within the system.
[0528] "Viewing" is the process by which a user views detailed information (description, ratings, price, etc.) of an AI service displayed as a search result.
[0529] "Evaluation" is a general term for feedback provided by users to AI services they have used, and includes numerical evaluations and letter evaluations.
[0530] "Feedback" refers to opinions and impressions provided by users after using the service, and is used to improve the service.
[0531] The "emotion engine" is a technology that analyzes the user's facial expressions and voice and recognizes their emotions in real time.
[0532] "Facial expression analysis" is the process of using a camera to recognize a user's facial expressions and infer emotions from those expressions.
[0533] "Voice analysis" is the process of recording a user's voice using a microphone and inferring emotions from that voice.
[0534] "Emotion feedback data" is data generated based on the user's facial expressions and voice analyzed by the emotion engine, and indicates the user's emotional state.
[0535] "Payment Process" refers to the series of steps required for a User to pay for a Service, including entering payment details and selecting a payment method.
[0536] This invention is a system for ensuring the sound and appropriate use of AI services, and specific embodiments thereof will be described below.
[0537] Overall system configuration
[0538] The invention is realized mainly by utilizing a server, a user's terminal, and an emotion engine. The system includes the following main means:
[0539] 1. User Registration and Login Methods
[0540] 2. Service registration methods for AI service providers
[0541] 3. Methods for reviewing and verifying registered AI services
[0542] 4. Means of assessing the legality and quality of AI services
[0543] 5. How users search for and browse AI services
[0544] 6. Evaluation and feedback measures for AI services
[0545] 7. Emotional feedback collection method using emotion engine
[0546] 8. A means of entering user payment information and making payments
[0547] Detailed Description
[0548] 1. User Registration and Login Methods
[0549] When a user uses the system for the first time, they enter the required information (such as name, email address, and password) into a form to register an account from their terminal and send it to the server. The server receives this information, checks whether it meets the requirements, and then stores it in a database. When logging in, the user enters the email address and password they used when registering, and the server verifies and authenticates them.
[0550] 2. Service registration methods for AI service providers
[0551] When an AI service provider registers a new service, they enter detailed service information (service name, description, price, etc.) from their device and send it to the server. The server receives this information, reviews the legality and quality of the AI service based on the review criteria, and if it passes, registers it in the database and adds it to the marketplace.
[0552] 3. Methods for reviewing and verifying registered AI services
[0553] The server will conduct an examination based on the examination criteria, including checking the legality of copyright and indicating the source of the data, thereby ensuring the reliability and quality of the AI service.
[0554] 4. Means of assessing the legality and quality of AI services
[0555] The server evaluates the legality and quality of the AI service based on the review criteria and stores the evaluation results in a database.
[0556] 5. How users search for and browse AI services
[0557] When a user browses the marketplace to use an AI service, they search using categories and keywords on their device. The server extracts services that match the search criteria from the database and displays the results on the device. Detailed information about each AI service (description, price, rating, etc.) is also displayed.
[0558] 6. Evaluation and feedback measures for AI services
[0559] After using the AI service, users fill out a form to provide their evaluation and feedback, and send it to the server. Furthermore, the emotional feedback data recognized by the emotion engine is also reflected in the evaluation. The server then stores these evaluations and emotional data in a database and reflects them for other users' reference.
[0560] 7. Emotional feedback collection method using emotion engine
[0561] While using the AI service, the emotion engine is activated and analyzes the user's facial expressions and voice using a camera or microphone. The analyzed emotion data is sent to the server in real time, and the server recognizes the user's emotional state based on that data. This recognition result is reflected in the evaluation and feedback of the AI service.
[0562] 8. A means of entering user payment information and making payments
[0563] When a user attempts to use an AI service, they enter payment information (e.g., card information, amount) into their device and make the payment. The server receives the payment information, processes the payment, analyzes the emotional data, and reflects it in the evaluation data.
[0564] Hardware or software used
[0565] The main hardware and software used in this system are:
[0566] Server: Build an API server using the Flask framework.
[0567] Database: A database that stores user information, service information, and emotion data.
[0568] Emotion Engine: Real-time emotion analysis software using OpenCV, Dlib, etc.
[0569] User devices: smartphones, computers, tablets, etc.
[0570] Specific examples
[0571] 1. User Registration
[0572] Device: The user (Mr. A) registers an account by entering his / her name, email address, and password.
[0573] Server: Receives registration information and stores it in a database.
[0574] 2. Payment Process
[0575] Terminal: The user (Mr. B) enters payment details and makes the payment.
[0576] Server: Processes payments, collects sentiment data, and reflects it in ratings.
[0577] Prompt Sentence Examples
[0578] Describe a payment assistant application that analyzes users' emotions in real time during the payment process and reflects the results in feedback. Illustrate the specific process, including user registration, login, payment information entry, emotion data collection, and rating and feedback, and provide details about the technologies and software used. In particular, explain the technology used for the emotion engine.
[0579] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0580] Step 1:
[0581] A user enters their name, email address, and password into the user registration form on their device and clicks the "Register" button. The input data is sent to the server, which verifies the received information and, if the required conditions are met, stores it in the database. As an output of this step, a message confirming successful registration is displayed to the user.
[0582] Step 2:
[0583] To log in from a terminal, a user enters the email address and password used during registration and clicks the "Login" button. The input data is sent to the server. The server performs authentication in the database based on the received information, and if successful, displays a login completion message and redirects the user to the dashboard screen.
[0584] Step 3:
[0585] An AI service provider enters details (service name, description, price, etc.) to register a new service from their device and clicks the "Register" button. The input data is sent to the server. The server receives this information and reviews the legality and quality of the AI service based on the review criteria. If it passes, the service information is saved in the database and added to the marketplace.
[0586] Step 4:
[0587] A user browses the marketplace on their device and searches for AI services using categories and keywords. The search criteria are sent to the server, which extracts matching services from the database and displays them as search results on the device. Detailed information about each AI service (description, price, rating, etc.) is provided to the user.
[0588] Step 5:
[0589] When a user attempts to use a selected AI service, they click the "Purchase" button on the details page and enter their payment details (card information, amount, etc.). The input data is sent to the server, which processes the payment based on the received information. After the payment is successful, permission to use the service is granted. In parallel, the server activates the user's camera and microphone to collect emotional data.
[0590] Step 6:
[0591] While using the AI service, the emotion engine is activated and analyzes the user's facial expressions and voice using a camera and microphone. The analyzed emotion data is sent to the server in real time. The server uses this data to recognize the user's emotional state. The results of this recognition are stored in a database and reflected in service ratings and feedback.
[0592] Step 7:
[0593] After using the AI service, the user fills out a form to provide evaluation and feedback and clicks the "Submit" button. The evaluation information entered is sent to the server. The server stores the received information and emotional data in a database for other users to refer to. The evaluation data will also be used to improve the service in the future.
[0594] The above processing steps enable the system to concretely implement methods to increase the reliability of AI services and provide users with a rich user experience.
[0595] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0596] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0597] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0598] [Second embodiment]
[0599] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0600] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0601] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0602] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0603] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0604] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0605] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0606] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0607] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0608] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0609] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0610] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0611] The present invention is a system designed to enable users to use AI services in a healthy and appropriate manner. Specifically, the system includes various means for enabling users to register and log in, for AI service providers to register services, for the review and confirmation of registered AI services, for users to search for and view AI services, and for users to evaluate and provide feedback on AI services.
[0612] Program processing
[0613] 1. User Registration and Login
[0614] When a user uses this system for the first time, they enter the required information (such as name, email address, and password) into a form to register an account from their device and send it to the server. The server receives this information, checks whether it meets the requirements, and then stores it in a database. When logging in, the user enters the email address and password they used when registering, and the server verifies and authenticates them.
[0615] 2. Registering AI services
[0616] When an AI service provider registers a new service, they enter detailed service information (service name, description, source of usage data, price, etc.) from their device and send it to the server. The server receives this information and reviews the legality and quality of the AI service based on the review criteria. If the review passes, the server registers the service in its database and adds it to the marketplace.
[0617] 3. Browse and search the Marketplace
[0618] When a user browses the marketplace to use an AI service, they search using categories and keywords on their device. The server extracts services that match the search criteria from the database and displays the results on the device. Detailed information about each AI service (description, price, rating, etc.) is also displayed.
[0619] 4. Use and Evaluation of the Service
[0620] When a user wishes to use an AI service, they complete the purchase procedure on the service details page from their device. After the purchase is completed, the server grants permission to use the service. After using the service, the user fills out a form to provide feedback and a rating, and sends it to the server. The server stores this rating in a database and reflects it for other users' reference.
[0621] Specific examples
[0622] User Registration and Login
[0623] Device: To register an account, the user (Yamada) enters his name, email address, and password and clicks the "Register" button.
[0624] Server: Receives registration information, checks the conditions, saves it in the database, and sends a message that registration was successful.
[0625] Yamada: After receiving the registration success message, enter your email address and password on the login screen to log in.
[0626] Registering AI services
[0627] Terminal: The provider (Mr. Sato) enters details of the new image recognition AI service and presses the "Register" button.
[0628] Server: Receives service information and checks its legality based on the screening criteria. If it passes, it is registered in the database and added to the marketplace.
[0629] Search the Marketplace
[0630] Device: The user (Mr. Tanaka) searches for an AI service using the keyword "image recognition."
[0631] Server: Extracts matching services from the database and displays them as search results on Tanaka's device.
[0632] Service Use and Evaluation
[0633] Device: On the details page of the service that Mr. Tanaka is interested in, he clicks the "Purchase" button and completes the purchase procedure.
[0634] Server: Confirms the purchase and grants permission to use the service. Receives feedback provided by Mr. Tanaka after use and stores it in a database.
[0635] By implementing the invention through the above steps, providers and users of AI services will be matched in a healthy and appropriate manner, improving the reliability and quality of the entire market.
[0636] The processing flow will be explained below.
[0637] User Registration and Login
[0638] User Registration
[0639] Step 1:
[0640] The user opens the application and clicks the "Register an account" button on their device.
[0641] Step 2:
[0642] The terminal receives the input form for account registration from the server and displays it on the screen.
[0643] Step 3:
[0644] The user enters their name, email address, and password and clicks the "Register" button.
[0645] Step 4:
[0646] The terminal transmits the entered registration information to the server.
[0647] Step 5:
[0648] The server receives the registration information and verifies that it meets the requirements (such as validating the email address format).
[0649] Step 6:
[0650] After confirmation, the server stores the user data in a database and sends a message to the terminal indicating successful registration.
[0651] Step 7:
[0652] The terminal displays a registration success message to the user.
[0653] User Login
[0654] Step 1:
[0655] The user visits the application's login screen.
[0656] Step 2:
[0657] The user enters their email address and password and clicks the "Login" button.
[0658] Step 3:
[0659] The device sends the login information to the server.
[0660] Step 4:
[0661] The server authenticates the received login information by checking it against the account information in its database.
[0662] Step 5:
[0663] The server sends the authentication result (success or failure) to the terminal.
[0664] Step 6:
[0665] If the terminal is successfully logged in, the user dashboard screen is displayed, and if the login is unsuccessful, an error message is displayed.
[0666] Registering AI services
[0667] Step 1:
[0668] The user clicks the "Service Registration" button to display the service registration screen on the terminal.
[0669] Step 2:
[0670] The terminal receives an input form for service registration from the server and displays it on the screen.
[0671] Step 3:
[0672] The user (service provider) enters the service name, description, source of usage data, price, and other detailed information, and clicks the "Register" button.
[0673] Step 4:
[0674] The terminal transmits the input service information to the server.
[0675] Step 5:
[0676] The server inspects the information it receives to ensure it complies with regulations and guidelines.
[0677] Step 6:
[0678] After the server confirms the information, it provisionally registers the service information and starts the review process.
[0679] Step 7:
[0680] The server's internal review system evaluates the service content, verifying the source of data used, copyright legality, and other compliance with regulations.
[0681] Step 8:
[0682] The server notifies the user of the results of the review. If the service passes, it will be officially added to the marketplace. If it fails, the server will provide detailed instructions on how to fix the problem.
[0683] Browse and search the Marketplace
[0684] Step 1:
[0685] The user clicks on the Marketplace menu to view category information and a list of current popular items on their device.
[0686] Step 2:
[0687] The user enters keywords in the search bar, sets conditions, and clicks the "Search" button.
[0688] Step 3:
[0689] The terminal sends the search criteria to the server.
[0690] Step 4:
[0691] The server extracts AI services that match the search criteria from the database and generates a list of results.
[0692] Step 5:
[0693] The server sends the search results to the terminal and displays them to the user.
[0694] Service Use and Evaluation
[0695] Step 1:
[0696] Users can click on the AI service of their interest from the search results and view detailed information on their device.
[0697] Step 2:
[0698] The user checks the service details and, if it is a paid service, clicks the "Purchase" button to complete the purchase procedure.
[0699] Step 3:
[0700] The terminal transmits the purchase procedure information to the server.
[0701] Step 4:
[0702] The server verifies the checkout information and processes the payment.
[0703] Step 5:
[0704] The server sends a purchase confirmation and permission to use to the device.
[0705] Step 6:
[0706] After using the service, the user accesses the evaluation form and inputs evaluation points and comments.
[0707] Step 7:
[0708] The terminal transmits the evaluation information to the server.
[0709] Step 8:
[0710] The server stores the received evaluation information in a database and reflects it as evaluation information for the service.
[0711] Example 1
[0712] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0713] Conventional AI service platforms provide separate functions such as user registration and login, AI service registration, legality and quality review, service search and evaluation, and feedback storage, but these functions are not integrated, resulting in issues of lack of convenience and reliability. Another issue is that feedback information is not properly stored, making it impossible for other users to utilize it. In addition, there are insufficient automated tools for evaluating the legality and quality of AI services, making it difficult to ensure overall reliability.
[0714] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0715] In this invention, the server includes a means for enabling users to register and log in, a means for enabling AI service providers to register services, a means for reviewing and verifying registered AI services, a means for evaluating the legality and quality of AI services based on review criteria, a means for users to search and browse registered AI services, a means for users to rate and provide feedback on AI services, and a means for storing the ratings and feedback in a database for other users to refer to. This enables healthy and appropriate interaction between users and AI service providers on a unified platform. Furthermore, automating the storage and evaluation of feedback using a generative AI model provides a highly reliable service environment.
[0716] "User" refers to any individual or legal entity that registers and logs in to use the system and search, use, and evaluate AI services.
[0717] "Provider" refers to an individual or corporation that registers an AI service in the system and provides that service to users.
[0718] "AI services" refers to various software and platform services provided using artificial intelligence technology.
[0719] "User registration" refers to the process by which a user provides necessary information, such as name, email address, and password, to use the system and saves that information in the system.
[0720] "Login" refers to the process by which a registered user authenticates by entering an email address and password in order to access the system.
[0721] "Service registration" refers to the process by which a provider registers a new AI service on the system by providing information such as the service name, description, source of usage data, and price.
[0722] "Review Criteria" refers to the rules and guidelines used to evaluate the legality and quality of registered AI services.
[0723] "Lawfulness" refers to the criteria for determining whether an AI service complies with laws and regulations.
[0724] "Quality" refers to the criteria for evaluating whether the functions and performance provided by an AI service meet certain standards.
[0725] "Search" refers to the process of browsing the database using keywords and categories that users enter to find a specific AI service on the system.
[0726] "Viewing" refers to the act of a user checking detailed information about an AI service displayed as a search result on the system.
[0727] "Evaluation" refers to the act of expressing the satisfaction and quality of the AI service a user has used using numerical values or comments.
[0728] "Feedback" refers to the opinions and impressions provided by users after using the service, which are stored in a database for the benefit of other users.
[0729] "Database" refers to a system for efficiently storing and managing various data including user information, service information, ratings and feedback.
[0730] A "generative AI model" refers to a software algorithm that uses artificial intelligence techniques to automatically perform evaluation and data analysis.
[0731] The present invention is a system that aims to enable users to use AI services in a healthy and appropriate manner, and is a platform that integrates user registration, AI service provision, search, use, evaluation, and feedback. Specific embodiments of this system are described below.
[0732] 1. User Registration and Login
[0733] When a user uses the system for the first time, they register an account from their terminal. The user enters the required information, such as name, email address, and password, and sends it to the server. The server receives this information, checks the requirements, and stores it in a database. It then sends a registration success message to the user. When logging in, the user enters the email address and password used during registration, and the server verifies and authenticates them.
[0734] Specific behavior:
[0735] Terminal: The user fills in the form and clicks the "Register" button.
[0736] Server: Receives registration information, checks the conditions, saves it in the database, and sends a registration success message.
[0737] 2. Registering AI services
[0738] AI service providers register new services by entering details such as the service name, description, source of usage data, and price on their devices and sending them to the server. The server receives this information and reviews it for legality and quality based on its review criteria. If the review passes, the server registers the service in its database and adds it to the marketplace.
[0739] Specific behavior:
[0740] Terminal: The provider enters the service details and clicks the "Register" button.
[0741] Server: Receives service information and checks its legality and quality against the screening criteria. Passed information is stored in the database and added to the marketplace.
[0742] 3. Browse and search the Marketplace
[0743] When a user wants to use an AI service, they access the marketplace from their device and search by category or keyword. The server extracts services that match the search criteria from the database and displays the results on the device.
[0744] Specific behavior:
[0745] Device: A user searches for a keyword such as "image recognition."
[0746] Server: Extracts matching services from the database and displays the search results on the device.
[0747] 4. Use and Evaluation of the Service
[0748] When a user wants to use an AI service, they complete the purchase procedure on the service details page from their device. Once the purchase is complete, the server grants permission to use the service. After using the service, the user enters information into an evaluation and feedback form and sends it to the server. The server stores this information in a database and makes it available to other users.
[0749] Specific behavior:
[0750] Device: The user clicks the "Purchase" button on the service details page.
[0751] Server: Confirms the purchase procedure and grants permission to use. Receives feedback after use and stores it in a database.
[0752] Hardware and software used
[0753] The following technologies are used to realize this system:
[0754] Database: Use Amazon Web Services (AWS) RDS.
[0755] Generative AI models: Use Google Cloud AI to automate the storage and evaluation of feedback.
[0756] Specific examples
[0757] User Registration and Login
[0758] Device: A user registers an account by entering their name, email address, and password and clicking the "Register" button.
[0759] Server: Receives the registration information, checks the conditions, saves it in the database, and sends a registration success message to the user.
[0760] User: After receiving the registration success message, enter your email address and password on the login screen to log in.
[0761] Registering AI services
[0762] Device: The provider enters details of the new image recognition AI service and clicks the "Register" button.
[0763] Server: Receives service information and checks its legality based on the screening criteria. If it passes, it is registered in the database and added to the marketplace.
[0764] Search the Marketplace
[0765] Device: A user searches for an AI service using the keyword "image recognition."
[0766] Server: Extracts matching services from the database and displays them as search results on the terminal.
[0767] Service Use and Evaluation
[0768] Terminal: The user clicks the "Purchase" button on the details page of the service they are interested in and completes the purchase process.
[0769] Server: Confirms purchases and grants permission to use. Receives feedback provided by users after use and stores it in a database.
[0770] Example prompts to input to a generative AI model:
[0771] "Please assess the legality of image recognition services. Are the sources of the data used publicly available? What criteria should you use to assess the quality of the service?"
[0772] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0773] User Registration and Login
[0774] Step 1: Fill out the user registration form
[0775] Terminal: A user visits the system's user registration page and enters the required information, such as name, email address, password, etc. Simple client-side validation is also performed to ensure all input data is correct (e.g., checking for blank spaces, checking email address format).
[0776] Input: User information such as name, email address, and password
[0777] Output: Validated input data
[0778] Step 2: Send registration information to the server
[0779] Terminal: When the user clicks the "Register" button, information is sent to the server in JSON format using JavaScript.
[0780] Input: User information in JSON format
[0781] Output: Data sent to the server
[0782] Step 3: Check server requirements and save data
[0783] Server: Analyzes the received JSON data and checks whether all required fields have been entered, whether the email address format is correct, etc. If the conditions are met, the data is saved in a database such as MySQL.
[0784] Input: Parsed user information
[0785] Output: User information stored in the database and a successful registration status
[0786] Step 4: Send a registration success message
[0787] Server: When registration is complete, create a success message and return it to the user's device as an HTTP response.
[0788] Input: Registration success status
[0789] Output: Success message
[0790] Step 5: Fill in the login form
[0791] Device: The user accesses the login screen and enters their registered email address and password.
[0792] Input: Email address and password
[0793] Output: The entered credentials
[0794] Step 6: Authentication by the Server
[0795] Server: The server checks the entered authentication information against a database to authenticate the user. If authentication is successful, the server grants access to the user.
[0796] Input: The entered credentials
[0797] Output: Permission token or authentication error message
[0798] Registering AI services
[0799] Step 1: Fill out the service registration form
[0800] Device: The AI service provider fills in the registration form with the service name, description, source of usage data, price, etc.
[0801] Input: Service name, description, usage data source, price, etc.
[0802] Output: Validated input data
[0803] Step 2: Sending service information to the server
[0804] Terminal: The provider clicks the "Register" button, and information is sent to the server in JSON format using JavaScript.
[0805] Input: Service information in JSON format
[0806] Output: Data sent to the server
[0807] Step 3: Server checks for legitimacy and quality
[0808] Server: Validates received information based on screening criteria for legality and quality. This process may involve using generative AI models to assess the origin of the data used and the appropriateness of the service.
[0809] Input: Parsed service information
[0810] Output: Review results
[0811] Step 4: Save service information to the database
[0812] Server: Saves the service information that passed the review in a database.
[0813] Input: Service information that passed the review
[0814] Output: Service information stored in the database
[0815] Step 5: Add to Marketplace
[0816] Server: Adds the stored service information to the marketplace and makes it available to users.
[0817] Input: Service information stored in the database
[0818] Output: Service information added to the Marketplace
[0819] Browse and search the Marketplace
[0820] Step 1: Enter search keywords
[0821] Terminal: User enters keywords into the Marketplace search field.
[0822] Input: Search keyword
[0823] Output: Search query based on keywords
[0824] Step 2: Send a search query to the server
[0825] Terminal: After entering the keywords, click the "Search" button and the search query will be sent to the server.
[0826] Input: Search query
[0827] Output: The search query sent to the server
[0828] Step 3: Extracting matching services from the database
[0829] Server: Searches the database and extracts services that match the keywords.
[0830] Input: Search query
[0831] Output: Search results (list of service information)
[0832] Step 4: Display search results on your device
[0833] Server: Sends search results to the user's device and displays the results for the user to view.
[0834] Input: Search results (list of service information)
[0835] Output: Search results displayed on the device
[0836] Service Use and Evaluation
[0837] Step 1: Purchase on the service details page
[0838] Device: The user visits the details page of the service they are interested in and clicks the "Purchase" button.
[0839] Input: Service ID and user purchase information
[0840] Output: Purchase request
[0841] Step 2: The server confirms the purchase and grants permission to use it
[0842] Server: Confirms the purchase procedure and grants permission to use the service if payment is successful.
[0843] Input: Purchase request and payment information
[0844] Output: Permission granted
[0845] Step 3: Enter your feedback after use
[0846] Terminal: A user who has used the service enters their evaluation in a feedback form.
[0847] Input: Feedback and rating information
[0848] output: Input feedback information
[0849] Step 4: Send and store feedback to the server
[0850] Terminal: Sends the entered feedback to the server.
[0851] Input: Feedback and rating information
[0852] Output: Feedback information sent to the server
[0853] Server: Stores the received feedback in a database and reflects it to other users.
[0854] Input: Received feedback information
[0855] Output: Feedback information stored in a database
[0856] The above is a detailed description of the specific processing steps of the system program and the operations that accompany them.
[0857] (Application example 1)
[0858] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0859] In today's AI service market, many users want to use high-quality AI services. However, it is difficult for users to find trustworthy AI services, and providers have limited means to prove that their services are legitimate. In addition, users often have difficulty deciding which service to choose, and there is a lack of means to receive personalized recommendations.
[0860] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0861] In this invention, the server includes means for enabling user registration and login by users, means for enabling service registration by AI service providers, means for reviewing and confirming registered AI services, means for evaluating the legality and quality of AI services based on review criteria, means for users to search for and view registered AI services, means for users to evaluate and provide feedback on AI services, and means for making personalized product recommendations to users. This allows users to easily find reliable AI services and further enables personalized recommendations of optimal services to individual users.
[0862] "User registration" is the process by which a user creates an account by providing the information necessary to use the system.
[0863] "Login" is the procedure by which an already registered user enters authentication information to access the system.
[0864] "AI service provider" refers to an individual or organization that develops services based on AI technology and provides them on the system.
[0865] "Service registration" is the process by which an AI service provider registers and publicizes their service in the system.
[0866] "Review" is the process of verifying whether registered AI services meet established standards.
[0867] "Verification" is a procedure that determines, through review, that a service is legal and meets quality standards.
[0868] "Lawfulness" refers to the state in which an AI service does not violate legal requirements or regulations.
[0869] "Quality" is a comprehensive evaluation criterion that includes the performance, reliability, and user satisfaction of the AI services provided.
[0870] "Search" is the process by which a user searches for an AI service using specific keywords or categories.
[0871] "Viewing" refers to the act of a user checking search results or service detail pages.
[0872] "Evaluation" refers to the user's opinion about the satisfaction and effectiveness of the AI service they used.
[0873] "Feedback" is the act of a user providing opinions, including suggestions for improvement and impressions, to a provider.
[0874] "Personalization" is a technique for individually recommending specific services based on a user's preferences and past behavior.
[0875] 1. Overview of the entire system
[0876] This invention is a system for enabling users to use AI services in a healthy and appropriate manner. The system provides functions for user registration and login, AI service registration and review, search and browsing, use and evaluation, and personalized recommendations.
[0877] 2. Hardware and Software Used
[0878] Hardware: Smartphones, general purpose servers.
[0879] Software: Flask (Python web framework), SQLAlchemy (database management).
[0880] 3. User Registration and Login
[0881] When a user uses this system for the first time, they enter the required information (name, email address, password, etc.) into the account registration form from their terminal and send it to the server. The server receives this information, checks whether it meets the requirements, and then stores it in a database. When logging in, the user enters the email address and password they used when registering, and the server verifies and authenticates them.
[0882] 4. AI Service Registration and Review
[0883] AI service providers input detailed service information (service name, description, source of usage data, price, etc.) from their devices and send it to the server. The server receives this information and evaluates its legality and quality based on its screening criteria. If the service passes the screening, the server registers it in its database and adds it to the marketplace.
[0884] 5. Search and Browse the Marketplace
[0885] When a user browses the marketplace to use an AI service, they search using categories and keywords on their device. The server extracts services that match the search criteria from the database and displays the results on the device. Detailed information about each AI service (description, price, rating, etc.) is also displayed.
[0886] 6. Use and Evaluation of the Service
[0887] When a user wishes to use an AI service, they complete the purchase procedure on the service details page from their device. After the purchase is completed, the server grants permission to use the service. After using the service, the user fills out a form to provide feedback and a rating, and sends it to the server. The server stores this rating in a database and reflects it for other users' reference.
[0888] 7. Personalized Product Recommendations
[0889] The server provides personalized product recommendations based on the user's past behavior and ratings, which improves the user experience and helps them use reliable services.
[0890] Specific examples
[0891] 1. User Registration
[0892] Device: The user enters their name, email address, and password and clicks the "Register" button.
[0893] Server: Receives registration information, checks the conditions, saves it in the database, and sends a message indicating successful registration.
[0894] User: After receiving the registration success message, they log in by entering their email address and password on the login screen.
[0895] 2. Service Search
[0896] Device: A user searches for an AI service using the keyword "image recognition."
[0897] Server: Retrieves matching services from the database and displays the search results.
[0898] 3. Service Recommendation
[0899] System: Randomly presents recommended AI services to users.
[0900] Example prompts for generative AI models
[0901] "Please register a new account using the following user information: Username: 'Yamada Taro', Email address: 'taro@example.com', Password: 'password123'"
[0902] "Search for available AI services using the keyword 'image recognition'."
[0903] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0904] Step 1:
[0905] User Registration and Login
[0906] Input: The user enters their name, email address, and password.
[0907] Processing: The terminal sends the entered information to the server, which verifies the received information and stores it in a database if it meets the requirements.
[0908] Output: A registration success message is displayed on the terminal. The user enters their email address and password on the login screen and submits them again to the server. The server validates them again and allows the user to access the system if authentication is successful.
[0909] What it does: The server uses SQLAlchemy to save the new user information to the database and returns a success message to the user. When logging in, it receives an authentication request from the front end and uses Flask to query the user database for authentication.
[0910] Step 2:
[0911] AI service registration and screening
[0912] Input: The AI service provider enters details about the service (service name, description, source of usage data, price, etc.).
[0913] Processing: The device sends the entered information to the server, which then evaluates the received information based on its screening criteria to verify its legitimacy and quality.
[0914] Output: If the review is successful, the service is registered in the database and added to the marketplace.
[0915] Specific operation: The server receives the service data and uses its internal logic to check whether the content complies with the review criteria. If legality and quality are confirmed, the service information is added to the database using SQLAlchemy and reflected in the marketplace.
[0916] Step 3:
[0917] Search and browse the marketplace
[0918] Input: A user searches using categories and keywords.
[0919] Processing: The device sends search criteria to the server. The server extracts services that match the search criteria from the database and sends the results to the device.
[0920] Output: A list of matching services will be displayed on the terminal, along with detailed information about each service (description, price, rating, etc.).
[0921] Specific operation: Receives keywords entered by the user from the front end, executes a database query using Flask, returns the search results in JSON format to the front end, and displays them.
[0922] Step 4:
[0923] Service Use and Evaluation
[0924] Input: The user selects the service of interest and completes the purchase process.
[0925] Processing: The device sends purchase information to the server. The server confirms the purchase and grants permission. After using the service, the user provides feedback and a rating.
[0926] Output: A confirmation message and authorization will be displayed on the device. Feedback and ratings will be stored in the database.
[0927] Specific operations: The server receives the purchase information and processes the payment. It then records the service permission in the database and returns a feedback form to the user. It also stores the rating and feedback received from the device in the database.
[0928] Step 5:
[0929] Personalized product recommendations
[0930] Input: User's past behavioral data and rating data.
[0931] Processing: The server analyzes the user's behavioral data and recommends appropriate AI services.
[0932] Output: The personalized recommendation is displayed on the user's device.
[0933] Specific operation: The server runs the recommendation algorithm using a generative AI model based on past behavioral data, returns the results to the front end using Flask, and displays the recommendation results on the device.
[0934] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0935] The present invention is a system designed to enable users to use AI services in a healthy and appropriate manner, specifically including various means for user registration and login, service registration by AI service providers, review and confirmation of registered AI services, user search and browsing of AI services, and user evaluation and feedback on AI services. Furthermore, the present invention improves the reliability and quality evaluation of AI services by obtaining emotional feedback from users through the combination of an emotion engine that recognizes user emotions.
[0936] Program processing
[0937] 1. User Registration and Login
[0938] When a user uses this system for the first time, they enter the required information (such as name, email address, and password) into a form to register an account from their device and send it to the server. The server receives this information, checks whether it meets the requirements, and then stores it in a database. When logging in, the user enters the email address and password they used when registering, and the server verifies and authenticates them.
[0939] 2. Registering AI services
[0940] When an AI service provider registers a new service, they enter detailed service information (service name, description, source of usage data, price, etc.) from their device and send it to the server. The server receives this information and reviews the legality and quality of the AI service based on the review criteria. If the review passes, the server registers the service in its database and adds it to the marketplace.
[0941] 3. Browse and search the Marketplace
[0942] When a user browses the marketplace to use an AI service, they search using categories and keywords on their device. The server extracts services that match the search criteria from the database and displays the results on the device. Detailed information about each AI service (description, price, rating, etc.) is also displayed.
[0943] 4. Operation of the Emotion Engine
[0944] While using the AI service, the emotion engine is activated and analyzes the user's facial expressions and voice using a camera or microphone. The analyzed emotion data is sent to the server in real time, and the server recognizes the user's emotional state based on that data. This recognition result is reflected in the evaluation and feedback of the AI service.
[0945] 5. Use and Evaluation of the Service
[0946] When a user wishes to use an AI service, they complete the purchase procedure on the service details page from their device. After the purchase is completed, the server grants permission to use the service. After using the service, the user fills out a form to provide feedback and a rating, and sends it to the server. In addition, the emotion data recognized by the emotion engine is also reflected in the rating. The server stores this rating and emotion data in a database and reflects it for other users' reference.
[0947] Specific examples
[0948] User Registration and Login
[0949] Device: To register an account, the user (Yamada) enters his name, email address, and password and clicks the "Register" button.
[0950] Server: Receives registration information, checks the conditions, saves it in the database, and sends a message indicating successful registration.
[0951] Yamada: Enter your email address and password on the login screen to log in.
[0952] Registering AI services
[0953] Terminal: The provider (Mr. Sato) enters details of the new image recognition AI service and presses the "Register" button.
[0954] Server: Receives service information and reviews it based on the review criteria. If it passes, it is registered in the database and added to the marketplace.
[0955] Search the Marketplace
[0956] Device: The user (Mr. Tanaka) searches for an AI service using the keyword "image recognition."
[0957] Server: Extracts matching services from the database and displays them as search results.
[0958] Emotion Engine Operation
[0959] Device: When Tanaka uses the service, the camera and microphone are activated and facial expressions and voice are analyzed.
[0960] Server: Receives the analysis results in real time and recognizes Tanaka's emotional data.
[0961] Service Use and Evaluation
[0962] Device: On the details page of the service that Mr. Tanaka is interested in, he clicks the "Purchase" button and completes the purchase procedure.
[0963] Server: Confirms the purchase and grants permission to use the app. Receives feedback provided by Tanaka after use and stores the rating and sentiment data.
[0964] By implementing the above steps, the invention will ensure a healthy and appropriate match between AI service providers and users, improving the reliability and quality of the entire market. By combining it with an emotion engine, emotional feedback can also be incorporated, resulting in more detailed and reliable evaluations.
[0965] The processing flow will be explained below.
[0966] User Registration and Login
[0967] User Registration
[0968] Step 1:
[0969] The user opens the application and clicks the "Register an account" button on their device.
[0970] Step 2:
[0971] The terminal receives the input form for account registration from the server and displays it on the screen.
[0972] Step 3:
[0973] The user enters their name, email address, and password and clicks the "Register" button.
[0974] Step 4:
[0975] The terminal transmits the entered registration information to the server.
[0976] Step 5:
[0977] The server receives the registration information and verifies that it meets the requirements (such as validating the email address format).
[0978] Step 6:
[0979] After confirmation, the server stores the user data in a database and sends a message to the terminal indicating successful registration.
[0980] Step 7:
[0981] The terminal displays a registration success message to the user.
[0982] User Login
[0983] Step 1:
[0984] The user visits the application's login screen.
[0985] Step 2:
[0986] The user enters their email address and password and clicks the "Login" button.
[0987] Step 3:
[0988] The device sends the login information to the server.
[0989] Step 4:
[0990] The server authenticates the received login information by checking it against the account information in its database.
[0991] Step 5:
[0992] The server sends the authentication result (success or failure) to the terminal.
[0993] Step 6:
[0994] If the terminal is successfully logged in, the user dashboard screen is displayed, and if the login is unsuccessful, an error message is displayed.
[0995] Registering AI services
[0996] Step 1:
[0997] The user clicks the "Service Registration" button to display the service registration screen on the terminal.
[0998] Step 2:
[0999] The terminal receives an input form for service registration from the server and displays it on the screen.
[1000] Step 3:
[1001] The user (service provider) enters the service name, description, source of usage data, price, and other detailed information, and clicks the "Register" button.
[1002] Step 4:
[1003] The terminal transmits the input service information to the server.
[1004] Step 5:
[1005] The server inspects the information it receives to ensure it complies with regulations and guidelines.
[1006] Step 6:
[1007] After the server confirms the information, it provisionally registers the service information and starts the review process.
[1008] Step 7:
[1009] The server's internal review system evaluates the service content, verifying the source of data used, copyright legality, and other compliance with regulations.
[1010] Step 8:
[1011] The server notifies the user of the results of the review. If the service passes, it will be officially added to the marketplace. If it fails, the server will provide detailed instructions on how to fix the problem.
[1012] Browse and search the Marketplace
[1013] Step 1:
[1014] The user clicks on the Marketplace menu to view category information and a list of current popular items on their device.
[1015] Step 2:
[1016] The user enters keywords in the search bar, sets conditions, and clicks the "Search" button.
[1017] Step 3:
[1018] The terminal sends the search criteria to the server.
[1019] Step 4:
[1020] The server extracts AI services that match the search criteria from the database and generates a list of results.
[1021] Step 5:
[1022] The server sends the search results to the terminal and displays them to the user.
[1023] Emotion Engine Operation
[1024] Step 1:
[1025] While a user is using an AI service, emotional data is collected using the device's camera or microphone.
[1026] Step 2:
[1027] The device analyzes facial expression data or voice data collected in real time to identify emotional states.
[1028] Step 3:
[1029] The terminal transmits the identified user's emotion data to the server.
[1030] Step 4:
[1031] Based on the emotion data received by the server, the user's emotional state at that time is recorded.
[1032] Step 5:
[1033] The server stores the recorded emotional data as a usage evaluation of the AI service and makes it available to other users as a reference.
[1034] Service Use and Evaluation
[1035] Step 1:
[1036] Users can select the AI service of interest from the search results and detailed information will be displayed on their device.
[1037] Step 2:
[1038] The user checks the service details and, if it is a paid service, clicks the "Purchase" button to complete the purchase procedure.
[1039] Step 3:
[1040] The terminal transmits the purchase procedure information to the server.
[1041] Step 4:
[1042] The server confirms the purchase procedure, completes the payment process, and then transmits usage permission to the terminal.
[1043] Step 5:
[1044] Once the user has finished using the service, they will access a screen where they can enter their feedback and rating.
[1045] Step 6:
[1046] The user inputs evaluation points and comments, and the terminal transmits the information to the server.
[1047] Step 7:
[1048] The server stores the received feedback and rating data in a database, and the emotion data collected by the emotion engine is also reflected in the rating.
[1049] Example 2
[1050] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1051] Currently, when using AI services, concerns about reliability and quality often arise between providers and users. Furthermore, due to a lack of verification of the legality of services and transparency in evaluations, it is difficult for users to use the services with peace of mind. Furthermore, conventional feedback systems do not easily reflect users' emotional feedback in their evaluations, making it difficult to grasp true user satisfaction.
[1052] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for enabling user registration and login, a means for enabling service registration by AI service providers, a means for reviewing and confirming registered AI services, a means for evaluating the legality and quality of AI services based on review criteria, a means for users to search for and browse registered AI services, a means for users to evaluate and provide feedback on AI services, and a means for obtaining feedback using an emotion engine that recognizes user emotions and reflecting it in the evaluation. This enables reliable matching between AI service providers and users, improving the reliability and quality of the entire market, and reflecting users' emotional feedback in the evaluation, making it possible to more accurately grasp satisfaction levels.
[1053] "User registration" is the process by which a new user enters their information (such as name, email address, and password) into the system to create an account.
[1054] "Login" is the process by which an already registered user enters authentication information (email address and password) and is authenticated in order to access the system.
[1055] "AI services" is a general term for various functions and applications provided based on artificial intelligence technology.
[1056] "Service registration" is the process by which an AI service provider enters details of a new service into the system, which then stores and manages that information in its database.
[1057] "Review and verification" is the process by which the system checks the content of registered AI services and verifies whether they comply with legality and quality standards.
[1058] "Search" is the process by which a user enters specific criteria (categories or keywords) and finds matching AI services within the system.
[1059] "Viewing" refers to a user displaying and checking search results and detailed information about registered AI services on a screen.
[1060] "Evaluation and feedback" is the process by which, after a user uses an AI service, they enter their opinions, impressions, and evaluation scores about the service into the system, which then stores them in a database.
[1061] "Emotion engine" refers to technology that analyzes and recognizes a user's emotional state from their facial expressions and voice.
[1062] "Means of obtaining feedback and reflecting it in the evaluation" refers to the process of using user emotional data analyzed by the emotion engine to reflect it in the evaluation of the AI service.
[1063] The present invention is a system that aims to enable users to use artificial intelligence (AI) services in a healthy and appropriate manner. The system operates as follows.
[1064] First, in order to use the system, a user must register from their terminal. The user enters their name, email address, and password and clicks the "Register" button. This information is sent from the terminal to the server, which verifies the received data and stores it in a database. The user then enters their email address and password on the login screen, and the server performs authentication.
[1065] Next, the AI service provider registers their service. The provider enters information such as the service name, description, source of usage data, and price on their device, and then presses the "Register" button. This information is also sent to the server, which reviews the service for legality and quality. The review is conducted based on the review criteria, and if it passes, it is registered in the database and displayed on the marketplace.
[1066] Users browse the marketplace and search for AI services by category or keyword. The server retrieves matching services from the database and displays them on the device. Detailed information about each service (description, price, ratings, etc.) is also displayed.
[1067] When a user uses the service, the emotion engine operates using the camera and microphone installed on the device. The user's facial expressions and voice are analyzed in real time during use, and the data is sent to the server. The server recognizes the user's emotional state based on the received data and reflects that emotional data in evaluations and feedback.
[1068] When a user purchases a service, they complete the purchase procedure on the service's details page from their device. The server verifies the purchase information and records it in a database. Once the purchase is complete, the user is authorized to use the service and provides feedback and a rating after subsequent use. This rating and feedback is sent from the device to the server, which stores it in a database. The stored data is reflected in the marketplace so that other users can refer to it.
[1069] Specifically, for example, if a user inputs the prompt, "Please tell me how to use the emotion engine to analyze user feedback in detail and use it to evaluate AI services," the system will analyze the emotion data acquired by the emotion engine and reflect the results in the user's feedback. In this way, trust and quality are improved between AI service providers and users, and users' emotional feedback is also reflected in evaluations, enabling a more accurate understanding of satisfaction levels.
[1070] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1071] Step 1:
[1072] The user enters their name, email address, and password and clicks the "Register" button. The device sends this information to the server. The server validates the information and checks whether it is in the correct format. Once validation is complete, the server saves the user information in a database and sends a message to the device indicating that registration was successful. The device then displays a message to the user indicating that registration was successful.
[1073] Step 2:
[1074] The user enters an email address and password on the login screen. The device sends the entered information to the server. The server retrieves the relevant user information from the database and compares it with the entered password to perform authentication. If authentication is successful, the server sends an authentication success message to the device. The device displays a login success message and a dashboard to the user.
[1075] Step 3:
[1076] The AI service provider enters detailed information such as the service name, description, source of usage data, and price, and presses the "Register" button. The device then sends this information to the server. The server receives the service information and evaluates its content based on the specified screening criteria. Specifically, it checks the legality and quality of the usage data. If the screening is successful, the server registers the service in its database and displays it on the marketplace. The device then notifies the service provider of the screening results.
[1077] Step 4:
[1078] The user browses the marketplace and searches using categories and keywords. The device sends the user's search criteria to the server. The server extracts matching services from the database and sends them to the device as search results. The device displays the search results received from the server to the user, along with detailed information about each service (description, price, rating, etc.).
[1079] Step 5:
[1080] When a user uses an AI service, the emotion engine operates using the camera and microphone installed on the device. The user's facial expressions and voice are collected in real time during use. The device sends the collected data to a server. The server analyzes the received emotion data and stores the results in a database. This data indicates the user's emotional state while using the service.
[1081] Step 6:
[1082] The user clicks the "Purchase" button on the details page of the AI service they are interested in, enters the required information, and completes the purchase procedure. The device sends the purchase information to the server. The server verifies the purchase information and records it in a database. Once the purchase procedure is complete, the server sends usage permission to the device. The device notifies the user of usage permission.
[1083] Step 7:
[1084] After using the service, the user inputs and submits a rating and feedback. The device then sends the user's feedback information to the server. The server then stores the received feedback and rating in a database. The stored data is reflected in the marketplace and can be used as reference by other users.
[1085] Step 8:
[1086] Based on the emotional data obtained by the emotion engine, the server reflects this data in the user's evaluation. The device notifies the user of the emotional feedback results, allowing other users to refer to them, enabling reliable matching between AI service providers and users.
[1087] (Application example 2)
[1088] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1089] In modern society, users require reliable and high-quality AI services that they can use with confidence. However, existing systems are unable to take users' emotional feedback into account when evaluating services, making it difficult to provide accurate evaluations. Furthermore, the legality and quality of AI services are not adequately vetted, making it difficult for users to provide reliable services. Furthermore, detailed information related to the user's payment process is not adequately managed, leaving a need for improved user experience.
[1090] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for enabling user registration and login by users, means for enabling service registration by AI service providers, means for reviewing and confirming registered AI services, means for evaluating the legality and quality of AI services based on review criteria, means for users to search for and browse registered AI services, means for users to evaluate and provide feedback on AI services, means for analyzing the user's facial expressions and voice using an emotion engine and collecting emotional feedback data in real time, means for reflecting the collected emotional feedback data in service evaluations, and means for users to enter detailed payment information and make payments. This enables reliable evaluations that reflect the user's emotional feedback, making it possible to improve the user experience while ensuring the legality and quality of AI services.
[1091] "User registration" is the process by which a user provides the necessary information to access the system and creates an account within the system.
[1092] "Logging in" is the process by which an already registered user signs into a system by providing authentication information (e.g., email address and password) to access their account.
[1093] An "AI service provider" is a company or individual that develops services using AI technology and provides those services to users.
[1094] "Service registration" is the process by which an AI service provider enters detailed information about the AI service they have developed (such as service name, description, and price) into the system, making it available for use.
[1095] "Review" refers to a series of evaluation processes conducted to verify the legality and quality of registered AI services.
[1096] "Verification" is the process of rechecking the reliability and quality of AI services based on the results of the review.
[1097] "Search" is the process by which a user enters specific criteria (e.g., keywords, categories) to find AI services within the system.
[1098] "Viewing" is the process by which a user views detailed information (description, ratings, price, etc.) of an AI service displayed as a search result.
[1099] "Evaluation" is a general term for feedback provided by users to AI services they have used, and includes numerical evaluations and letter evaluations.
[1100] "Feedback" refers to opinions and impressions provided by users after using the service, and is used to improve the service.
[1101] The "emotion engine" is a technology that analyzes the user's facial expressions and voice and recognizes their emotions in real time.
[1102] "Facial expression analysis" is the process of using a camera to recognize a user's facial expressions and infer emotions from those expressions.
[1103] "Voice analysis" is the process of recording a user's voice using a microphone and inferring emotions from that voice.
[1104] "Emotion feedback data" is data generated based on the user's facial expressions and voice analyzed by the emotion engine, and indicates the user's emotional state.
[1105] "Payment Process" refers to the series of steps required for a User to pay for a Service, including entering payment details and selecting a payment method.
[1106] This invention is a system for ensuring the sound and appropriate use of AI services, and specific embodiments thereof will be described below.
[1107] Overall system configuration
[1108] The invention is realized mainly by utilizing a server, a user's terminal, and an emotion engine. The system includes the following main means:
[1109] 1. User Registration and Login Methods
[1110] 2. Service registration methods for AI service providers
[1111] 3. Methods for reviewing and verifying registered AI services
[1112] 4. Means of assessing the legality and quality of AI services
[1113] 5. How users search for and browse AI services
[1114] 6. Evaluation and feedback measures for AI services
[1115] 7. Emotional feedback collection method using emotion engine
[1116] 8. A means of entering user payment information and making payments
[1117] Detailed Description
[1118] 1. User Registration and Login Methods
[1119] When a user uses the system for the first time, they enter the required information (such as name, email address, and password) into a form to register an account from their terminal and send it to the server. The server receives this information, checks whether it meets the requirements, and then stores it in a database. When logging in, the user enters the email address and password they used when registering, and the server verifies and authenticates them.
[1120] 2. Service registration methods for AI service providers
[1121] When an AI service provider registers a new service, they enter detailed service information (service name, description, price, etc.) from their device and send it to the server. The server receives this information, reviews the legality and quality of the AI service based on the review criteria, and if it passes, registers it in the database and adds it to the marketplace.
[1122] 3. Methods for reviewing and verifying registered AI services
[1123] The server will conduct an examination based on the examination criteria, including checking the legality of copyright and indicating the source of the data, thereby ensuring the reliability and quality of the AI service.
[1124] 4. Means of assessing the legality and quality of AI services
[1125] The server evaluates the legality and quality of the AI service based on the review criteria and stores the evaluation results in a database.
[1126] 5. How users search for and browse AI services
[1127] When a user browses the marketplace to use an AI service, they search using categories and keywords on their device. The server extracts services that match the search criteria from the database and displays the results on the device. Detailed information about each AI service (description, price, rating, etc.) is also displayed.
[1128] 6. Evaluation and feedback measures for AI services
[1129] After using the AI service, users fill out a form to provide their evaluation and feedback, and send it to the server. Furthermore, the emotional feedback data recognized by the emotion engine is also reflected in the evaluation. The server then stores these evaluations and emotional data in a database and reflects them for other users' reference.
[1130] 7. Emotional feedback collection method using emotion engine
[1131] While using the AI service, the emotion engine is activated and analyzes the user's facial expressions and voice using a camera or microphone. The analyzed emotion data is sent to the server in real time, and the server recognizes the user's emotional state based on that data. This recognition result is reflected in the evaluation and feedback of the AI service.
[1132] 8. A means of entering user payment information and making payments
[1133] When a user attempts to use an AI service, they enter payment information (e.g., card information, amount) into their device and make the payment. The server receives the payment information, processes the payment, analyzes the emotional data, and reflects it in the evaluation data.
[1134] Hardware or software used
[1135] The main hardware and software used in this system are:
[1136] Server: Build an API server using the Flask framework.
[1137] Database: A database that stores user information, service information, and emotion data.
[1138] Emotion Engine: Real-time emotion analysis software using OpenCV, Dlib, etc.
[1139] User devices: smartphones, computers, tablets, etc.
[1140] Specific examples
[1141] 1. User Registration
[1142] Device: The user (Mr. A) registers an account by entering his / her name, email address, and password.
[1143] Server: Receives registration information and stores it in a database.
[1144] 2. Payment Process
[1145] Terminal: The user (Mr. B) enters payment details and makes the payment.
[1146] Server: Processes payments, collects sentiment data, and reflects it in ratings.
[1147] Prompt Sentence Examples
[1148] Describe a payment assistant application that analyzes users' emotions in real time during the payment process and reflects the results in feedback. Illustrate the specific process, including user registration, login, payment information entry, emotion data collection, and rating and feedback, and provide details about the technologies and software used. In particular, explain the technology used for the emotion engine.
[1149] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1150] Step 1:
[1151] A user enters their name, email address, and password into the user registration form on their device and clicks the "Register" button. The input data is sent to the server, which verifies the received information and, if the required conditions are met, stores it in the database. As an output of this step, a message confirming successful registration is displayed to the user.
[1152] Step 2:
[1153] To log in from a terminal, a user enters the email address and password used during registration and clicks the "Login" button. The input data is sent to the server. The server performs authentication in the database based on the received information, and if successful, displays a login completion message and redirects the user to the dashboard screen.
[1154] Step 3:
[1155] An AI service provider enters details (service name, description, price, etc.) to register a new service from their device and clicks the "Register" button. The input data is sent to the server. The server receives this information and reviews the legality and quality of the AI service based on the review criteria. If it passes, the service information is saved in the database and added to the marketplace.
[1156] Step 4:
[1157] A user browses the marketplace on their device and searches for AI services using categories and keywords. The search criteria are sent to the server, which extracts matching services from the database and displays them as search results on the device. Detailed information about each AI service (description, price, rating, etc.) is provided to the user.
[1158] Step 5:
[1159] When a user attempts to use a selected AI service, they click the "Purchase" button on the details page and enter their payment details (card information, amount, etc.). The input data is sent to the server, which processes the payment based on the received information. After the payment is successful, permission to use the service is granted. In parallel, the server activates the user's camera and microphone to collect emotional data.
[1160] Step 6:
[1161] While using the AI service, the emotion engine is activated and analyzes the user's facial expressions and voice using a camera and microphone. The analyzed emotion data is sent to the server in real time. The server uses this data to recognize the user's emotional state. The results of this recognition are stored in a database and reflected in service ratings and feedback.
[1162] Step 7:
[1163] After using the AI service, the user fills out a form to provide evaluation and feedback and clicks the "Submit" button. The evaluation information entered is sent to the server. The server stores the received information and emotional data in a database for other users to refer to. The evaluation data will also be used to improve the service in the future.
[1164] The above processing steps enable the system to concretely implement methods to increase the reliability of AI services and provide users with a rich user experience.
[1165] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1166] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1167] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[1168] [Third embodiment]
[1169] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[1170] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.
[1171] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1172] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[1173] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1174] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1175] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1176] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1177] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1178] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1179] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1180] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[1181] The present invention is a system designed to enable users to use AI services in a healthy and appropriate manner. Specifically, the system includes various means for enabling users to register and log in, for AI service providers to register services, for the review and confirmation of registered AI services, for users to search for and view AI services, and for users to evaluate and provide feedback on AI services.
[1182] Program processing
[1183] 1. User Registration and Login
[1184] When a user uses this system for the first time, they enter the required information (such as name, email address, and password) into a form to register an account from their device and send it to the server. The server receives this information, checks whether it meets the requirements, and then stores it in a database. When logging in, the user enters the email address and password they used when registering, and the server verifies and authenticates them.
[1185] 2. Registering AI services
[1186] When an AI service provider registers a new service, they enter detailed service information (service name, description, source of usage data, price, etc.) from their device and send it to the server. The server receives this information and reviews the legality and quality of the AI service based on the review criteria. If the review passes, the server registers the service in its database and adds it to the marketplace.
[1187] 3. Browse and search the Marketplace
[1188] When a user browses the marketplace to use an AI service, they search using categories and keywords on their device. The server extracts services that match the search criteria from the database and displays the results on the device. Detailed information about each AI service (description, price, rating, etc.) is also displayed.
[1189] 4. Use and Evaluation of the Service
[1190] When a user wishes to use an AI service, they complete the purchase procedure on the service details page from their device. After the purchase is completed, the server grants permission to use the service. After using the service, the user fills out a form to provide feedback and a rating, and sends it to the server. The server stores this rating in a database and reflects it for other users' reference.
[1191] Specific examples
[1192] User Registration and Login
[1193] Device: To register an account, the user (Yamada) enters his name, email address, and password and clicks the "Register" button.
[1194] Server: Receives registration information, checks the conditions, saves it in the database, and sends a message that registration was successful.
[1195] Yamada: After receiving the registration success message, enter your email address and password on the login screen to log in.
[1196] Registering AI services
[1197] Terminal: The provider (Mr. Sato) enters details of the new image recognition AI service and presses the "Register" button.
[1198] Server: Receives service information and checks its legality based on the screening criteria. If it passes, it is registered in the database and added to the marketplace.
[1199] Search the Marketplace
[1200] Device: The user (Mr. Tanaka) searches for an AI service using the keyword "image recognition."
[1201] Server: Extracts matching services from the database and displays them as search results on Tanaka's device.
[1202] Service Use and Evaluation
[1203] Device: On the details page of the service that Mr. Tanaka is interested in, he clicks the "Purchase" button and completes the purchase procedure.
[1204] Server: Confirms the purchase and grants permission to use the service. Receives feedback provided by Mr. Tanaka after use and stores it in a database.
[1205] By implementing the invention through the above steps, providers and users of AI services will be matched in a healthy and appropriate manner, improving the reliability and quality of the entire market.
[1206] The processing flow will be explained below.
[1207] User Registration and Login
[1208] User Registration
[1209] Step 1:
[1210] The user opens the application and clicks the "Register an account" button on their device.
[1211] Step 2:
[1212] The terminal receives the input form for account registration from the server and displays it on the screen.
[1213] Step 3:
[1214] The user enters their name, email address, and password and clicks the "Register" button.
[1215] Step 4:
[1216] The terminal transmits the entered registration information to the server.
[1217] Step 5:
[1218] The server receives the registration information and verifies that it meets the requirements (such as validating the email address format).
[1219] Step 6:
[1220] After confirmation, the server stores the user data in a database and sends a message to the terminal indicating successful registration.
[1221] Step 7:
[1222] The terminal displays a registration success message to the user.
[1223] User Login
[1224] Step 1:
[1225] The user visits the application's login screen.
[1226] Step 2:
[1227] The user enters their email address and password and clicks the "Login" button.
[1228] Step 3:
[1229] The device sends the login information to the server.
[1230] Step 4:
[1231] The server authenticates the received login information by checking it against the account information in its database.
[1232] Step 5:
[1233] The server sends the authentication result (success or failure) to the terminal.
[1234] Step 6:
[1235] If the terminal is successfully logged in, the user dashboard screen is displayed, and if the login is unsuccessful, an error message is displayed.
[1236] Registering AI services
[1237] Step 1:
[1238] The user clicks the "Service Registration" button to display the service registration screen on the terminal.
[1239] Step 2:
[1240] The terminal receives an input form for service registration from the server and displays it on the screen.
[1241] Step 3:
[1242] The user (service provider) enters the service name, description, source of usage data, price, and other detailed information, and clicks the "Register" button.
[1243] Step 4:
[1244] The terminal transmits the input service information to the server.
[1245] Step 5:
[1246] The server inspects the information it receives to ensure it complies with regulations and guidelines.
[1247] Step 6:
[1248] After the server confirms the information, it provisionally registers the service information and starts the review process.
[1249] Step 7:
[1250] The server's internal review system evaluates the service content, verifying the source of data used, copyright legality, and other compliance with regulations.
[1251] Step 8:
[1252] The server notifies the user of the results of the review. If the service passes, it will be officially added to the marketplace. If it fails, the server will provide detailed instructions on how to fix the problem.
[1253] Browse and search the Marketplace
[1254] Step 1:
[1255] The user clicks on the Marketplace menu to view category information and a list of current popular items on their device.
[1256] Step 2:
[1257] The user enters keywords in the search bar, sets conditions, and clicks the "Search" button.
[1258] Step 3:
[1259] The terminal sends the search criteria to the server.
[1260] Step 4:
[1261] The server extracts AI services that match the search criteria from the database and generates a list of results.
[1262] Step 5:
[1263] The server sends the search results to the terminal and displays them to the user.
[1264] Service Use and Evaluation
[1265] Step 1:
[1266] Users can click on the AI service of their interest from the search results and view detailed information on their device.
[1267] Step 2:
[1268] The user checks the service details and, if it is a paid service, clicks the "Purchase" button to complete the purchase procedure.
[1269] Step 3:
[1270] The terminal transmits the purchase procedure information to the server.
[1271] Step 4:
[1272] The server verifies the checkout information and processes the payment.
[1273] Step 5:
[1274] The server sends a purchase confirmation and permission to use to the device.
[1275] Step 6:
[1276] After using the service, the user accesses the evaluation form and inputs evaluation points and comments.
[1277] Step 7:
[1278] The terminal transmits the evaluation information to the server.
[1279] Step 8:
[1280] The server stores the received evaluation information in a database and reflects it as evaluation information for the service.
[1281] Example 1
[1282] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1283] Conventional AI service platforms provide separate functions such as user registration and login, AI service registration, legality and quality review, service search and evaluation, and feedback storage, but these functions are not integrated, resulting in issues of lack of convenience and reliability. Another issue is that feedback information is not properly stored, making it impossible for other users to utilize it. In addition, there are insufficient automated tools for evaluating the legality and quality of AI services, making it difficult to ensure overall reliability.
[1284] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1285] In this invention, the server includes a means for enabling users to register and log in, a means for enabling AI service providers to register services, a means for reviewing and verifying registered AI services, a means for evaluating the legality and quality of AI services based on review criteria, a means for users to search and browse registered AI services, a means for users to rate and provide feedback on AI services, and a means for storing the ratings and feedback in a database for other users to refer to. This enables healthy and appropriate interaction between users and AI service providers on a unified platform. Furthermore, automating the storage and evaluation of feedback using a generative AI model provides a highly reliable service environment.
[1286] "User" refers to any individual or legal entity that registers and logs in to use the system and search, use, and evaluate AI services.
[1287] "Provider" refers to an individual or corporation that registers an AI service in the system and provides that service to users.
[1288] "AI services" refers to various software and platform services provided using artificial intelligence technology.
[1289] "User registration" refers to the process by which a user provides necessary information, such as name, email address, and password, to use the system and saves that information in the system.
[1290] "Login" refers to the process by which a registered user authenticates by entering an email address and password in order to access the system.
[1291] "Service registration" refers to the process by which a provider registers a new AI service on the system by providing information such as the service name, description, source of usage data, and price.
[1292] "Review Criteria" refers to the rules and guidelines used to evaluate the legality and quality of registered AI services.
[1293] "Lawfulness" refers to the criteria for determining whether an AI service complies with laws and regulations.
[1294] "Quality" refers to the criteria for evaluating whether the functions and performance provided by an AI service meet certain standards.
[1295] "Search" refers to the process of browsing the database using keywords and categories that users enter to find a specific AI service on the system.
[1296] "Viewing" refers to the act of a user checking detailed information about an AI service displayed as a search result on the system.
[1297] "Evaluation" refers to the act of expressing the satisfaction and quality of the AI service a user has used using numerical values or comments.
[1298] "Feedback" refers to the opinions and impressions provided by users after using the service, which are stored in a database for the benefit of other users.
[1299] "Database" refers to a system for efficiently storing and managing various data including user information, service information, ratings and feedback.
[1300] A "generative AI model" refers to a software algorithm that uses artificial intelligence techniques to automatically perform evaluation and data analysis.
[1301] The present invention is a system that aims to enable users to use AI services in a healthy and appropriate manner, and is a platform that integrates user registration, AI service provision, search, use, evaluation, and feedback. Specific embodiments of this system are described below.
[1302] 1. User Registration and Login
[1303] When a user uses the system for the first time, they register an account from their terminal. The user enters the required information, such as name, email address, and password, and sends it to the server. The server receives this information, checks the requirements, and stores it in a database. It then sends a registration success message to the user. When logging in, the user enters the email address and password used during registration, and the server verifies and authenticates them.
[1304] Specific behavior:
[1305] Terminal: The user fills in the form and clicks the "Register" button.
[1306] Server: Receives registration information, checks the conditions, saves it in the database, and sends a registration success message.
[1307] 2. Registering AI services
[1308] AI service providers register new services by entering details such as the service name, description, source of usage data, and price on their devices and sending them to the server. The server receives this information and reviews it for legality and quality based on its review criteria. If the review passes, the server registers the service in its database and adds it to the marketplace.
[1309] Specific behavior:
[1310] Terminal: The provider enters the service details and clicks the "Register" button.
[1311] Server: Receives service information and checks its legality and quality against the screening criteria. Passed information is stored in the database and added to the marketplace.
[1312] 3. Browse and search the Marketplace
[1313] When a user wants to use an AI service, they access the marketplace from their device and search by category or keyword. The server extracts services that match the search criteria from the database and displays the results on the device.
[1314] Specific behavior:
[1315] Device: A user searches for a keyword such as "image recognition."
[1316] Server: Extracts matching services from the database and displays the search results on the device.
[1317] 4. Use and Evaluation of the Service
[1318] When a user wants to use an AI service, they complete the purchase procedure on the service details page from their device. Once the purchase is complete, the server grants permission to use the service. After using the service, the user enters information into an evaluation and feedback form and sends it to the server. The server stores this information in a database and makes it available to other users.
[1319] Specific behavior:
[1320] Device: The user clicks the "Purchase" button on the service details page.
[1321] Server: Confirms the purchase procedure and grants permission to use. Receives feedback after use and stores it in a database.
[1322] Hardware and software used
[1323] The following technologies are used to realize this system:
[1324] Database: Use Amazon Web Services (AWS) RDS.
[1325] Generative AI models: Use Google Cloud AI to automate the storage and evaluation of feedback.
[1326] Specific examples
[1327] User Registration and Login
[1328] Device: A user registers an account by entering their name, email address, and password and clicking the "Register" button.
[1329] Server: Receives the registration information, checks the conditions, saves it in the database, and sends a registration success message to the user.
[1330] User: After receiving the registration success message, enter your email address and password on the login screen to log in.
[1331] Registering AI services
[1332] Device: The provider enters details of the new image recognition AI service and clicks the "Register" button.
[1333] Server: Receives service information and checks its legality based on the screening criteria. If it passes, it is registered in the database and added to the marketplace.
[1334] Search the Marketplace
[1335] Device: A user searches for an AI service using the keyword "image recognition."
[1336] Server: Extracts matching services from the database and displays them as search results on the terminal.
[1337] Service Use and Evaluation
[1338] Terminal: The user clicks the "Purchase" button on the details page of the service they are interested in and completes the purchase process.
[1339] Server: Confirms purchases and grants permission to use. Receives feedback provided by users after use and stores it in a database.
[1340] Example prompts to input to a generative AI model:
[1341] "Please assess the legality of image recognition services. Are the sources of the data used publicly available? What criteria should you use to assess the quality of the service?"
[1342] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1343] User Registration and Login
[1344] Step 1: Fill out the user registration form
[1345] Terminal: A user visits the system's user registration page and enters the required information, such as name, email address, password, etc. Simple client-side validation is also performed to ensure all input data is correct (e.g., checking for blank spaces, checking email address format).
[1346] Input: User information such as name, email address, and password
[1347] Output: Validated input data
[1348] Step 2: Send registration information to the server
[1349] Terminal: When the user clicks the "Register" button, information is sent to the server in JSON format using JavaScript.
[1350] Input: User information in JSON format
[1351] Output: Data sent to the server
[1352] Step 3: Check server requirements and save data
[1353] Server: Analyzes the received JSON data and checks whether all required fields have been entered, whether the email address format is correct, etc. If the conditions are met, the data is saved in a database such as MySQL.
[1354] Input: Parsed user information
[1355] Output: User information stored in the database and a successful registration status
[1356] Step 4: Send a registration success message
[1357] Server: When registration is complete, create a success message and return it to the user's device as an HTTP response.
[1358] Input: Registration success status
[1359] Output: Success message
[1360] Step 5: Fill in the login form
[1361] Device: The user accesses the login screen and enters their registered email address and password.
[1362] Input: Email address and password
[1363] Output: The entered credentials
[1364] Step 6: Authentication by the Server
[1365] Server: The server checks the entered authentication information against a database to authenticate the user. If authentication is successful, the server grants access to the user.
[1366] Input: The entered credentials
[1367] Output: Permission token or authentication error message
[1368] Registering AI services
[1369] Step 1: Fill out the service registration form
[1370] Device: The AI service provider fills in the registration form with the service name, description, source of usage data, price, etc.
[1371] Input: Service name, description, usage data source, price, etc.
[1372] Output: Validated input data
[1373] Step 2: Sending service information to the server
[1374] Terminal: The provider clicks the "Register" button, and information is sent to the server in JSON format using JavaScript.
[1375] Input: Service information in JSON format
[1376] Output: Data sent to the server
[1377] Step 3: Server checks for legitimacy and quality
[1378] Server: Validates received information based on screening criteria for legality and quality. This process may involve using generative AI models to assess the origin of the data used and the appropriateness of the service.
[1379] Input: Parsed service information
[1380] Output: Review results
[1381] Step 4: Save service information to the database
[1382] Server: Saves the service information that passed the review in a database.
[1383] Input: Service information that passed the review
[1384] Output: Service information stored in the database
[1385] Step 5: Add to Marketplace
[1386] Server: Adds the stored service information to the marketplace and makes it available to users.
[1387] Input: Service information stored in the database
[1388] Output: Service information added to the Marketplace
[1389] Browse and search the Marketplace
[1390] Step 1: Enter search keywords
[1391] Terminal: User enters keywords into the Marketplace search field.
[1392] Input: Search keyword
[1393] Output: Search query based on keywords
[1394] Step 2: Send a search query to the server
[1395] Terminal: After entering the keywords, click the "Search" button and the search query will be sent to the server.
[1396] Input: Search query
[1397] Output: The search query sent to the server
[1398] Step 3: Extracting matching services from the database
[1399] Server: Searches the database and extracts services that match the keywords.
[1400] Input: Search query
[1401] Output: Search results (list of service information)
[1402] Step 4: Display search results on your device
[1403] Server: Sends search results to the user's device and displays the results for the user to view.
[1404] Input: Search results (list of service information)
[1405] Output: Search results displayed on the device
[1406] Service Use and Evaluation
[1407] Step 1: Purchase on the service details page
[1408] Device: The user visits the details page of the service they are interested in and clicks the "Purchase" button.
[1409] Input: Service ID and user purchase information
[1410] Output: Purchase request
[1411] Step 2: The server confirms the purchase and grants permission to use it
[1412] Server: Confirms the purchase procedure and grants permission to use the service if payment is successful.
[1413] Input: Purchase request and payment information
[1414] Output: Permission granted
[1415] Step 3: Enter your feedback after use
[1416] Terminal: A user who has used the service enters their evaluation in a feedback form.
[1417] Input: Feedback and rating information
[1418] output: Input feedback information
[1419] Step 4: Send and store feedback to the server
[1420] Terminal: Sends the entered feedback to the server.
[1421] Input: Feedback and rating information
[1422] Output: Feedback information sent to the server
[1423] Server: Stores the received feedback in a database and reflects it to other users.
[1424] Input: Received feedback information
[1425] Output: Feedback information stored in a database
[1426] The above is a detailed description of the specific processing steps of the system program and the operations that accompany them.
[1427] (Application example 1)
[1428] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1429] In today's AI service market, many users want to use high-quality AI services. However, it is difficult for users to find trustworthy AI services, and providers have limited means to prove that their services are legitimate. In addition, users often have difficulty deciding which service to choose, and there is a lack of means to receive personalized recommendations.
[1430] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1431] In this invention, the server includes means for enabling user registration and login by users, means for enabling service registration by AI service providers, means for reviewing and confirming registered AI services, means for evaluating the legality and quality of AI services based on review criteria, means for users to search for and view registered AI services, means for users to evaluate and provide feedback on AI services, and means for making personalized product recommendations to users. This allows users to easily find reliable AI services and further enables personalized recommendations of optimal services to individual users.
[1432] "User registration" is the process by which a user creates an account by providing the information necessary to use the system.
[1433] "Login" is the procedure by which an already registered user enters authentication information to access the system.
[1434] "AI service provider" refers to an individual or organization that develops services based on AI technology and provides them on the system.
[1435] "Service registration" is the process by which an AI service provider registers and publicizes their service in the system.
[1436] "Review" is the process of verifying whether registered AI services meet established standards.
[1437] "Verification" is a procedure that determines, through review, that a service is legal and meets quality standards.
[1438] "Lawfulness" refers to the state in which an AI service does not violate legal requirements or regulations.
[1439] "Quality" is a comprehensive evaluation criterion that includes the performance, reliability, and user satisfaction of the AI services provided.
[1440] "Search" is the process by which a user searches for an AI service using specific keywords or categories.
[1441] "Viewing" refers to the act of a user checking search results or service detail pages.
[1442] "Evaluation" refers to the user's opinion about the satisfaction and effectiveness of the AI service they used.
[1443] "Feedback" is the act of a user providing opinions, including suggestions for improvement and impressions, to a provider.
[1444] "Personalization" is a technique for individually recommending specific services based on a user's preferences and past behavior.
[1445] 1. Overview of the entire system
[1446] This invention is a system for enabling users to use AI services in a healthy and appropriate manner. The system provides functions for user registration and login, AI service registration and review, search and browsing, use and evaluation, and personalized recommendations.
[1447] 2. Hardware and Software Used
[1448] Hardware: Smartphones, general purpose servers.
[1449] Software: Flask (Python web framework), SQLAlchemy (database management).
[1450] 3. User Registration and Login
[1451] When a user uses this system for the first time, they enter the required information (name, email address, password, etc.) into the account registration form from their terminal and send it to the server. The server receives this information, checks whether it meets the requirements, and then stores it in a database. When logging in, the user enters the email address and password they used when registering, and the server verifies and authenticates them.
[1452] 4. AI Service Registration and Review
[1453] AI service providers input detailed service information (service name, description, source of usage data, price, etc.) from their devices and send it to the server. The server receives this information and evaluates its legality and quality based on its screening criteria. If the service passes the screening, the server registers it in its database and adds it to the marketplace.
[1454] 5. Search and Browse the Marketplace
[1455] When a user browses the marketplace to use an AI service, they search using categories and keywords on their device. The server extracts services that match the search criteria from the database and displays the results on the device. Detailed information about each AI service (description, price, rating, etc.) is also displayed.
[1456] 6. Use and Evaluation of the Service
[1457] When a user wishes to use an AI service, they complete the purchase procedure on the service details page from their device. After the purchase is completed, the server grants permission to use the service. After using the service, the user fills out a form to provide feedback and a rating, and sends it to the server. The server stores this rating in a database and reflects it for other users' reference.
[1458] 7. Personalized Product Recommendations
[1459] The server provides personalized product recommendations based on the user's past behavior and ratings, which improves the user experience and helps them use reliable services.
[1460] Specific examples
[1461] 1. User Registration
[1462] Device: The user enters their name, email address, and password and clicks the "Register" button.
[1463] Server: Receives registration information, checks the conditions, saves it in the database, and sends a message indicating successful registration.
[1464] User: After receiving the registration success message, they log in by entering their email address and password on the login screen.
[1465] 2. Service Search
[1466] Device: A user searches for an AI service using the keyword "image recognition."
[1467] Server: Retrieves matching services from the database and displays the search results.
[1468] 3. Service Recommendation
[1469] System: Randomly presents recommended AI services to users.
[1470] Example prompts for generative AI models
[1471] "Please register a new account using the following user information: Username: 'Yamada Taro', Email address: 'taro@example.com', Password: 'password123'"
[1472] "Search for available AI services using the keyword 'image recognition'."
[1473] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1474] Step 1:
[1475] User Registration and Login
[1476] Input: The user enters their name, email address, and password.
[1477] Processing: The terminal sends the entered information to the server, which verifies the received information and stores it in a database if it meets the requirements.
[1478] Output: A registration success message is displayed on the terminal. The user enters their email address and password on the login screen and submits them again to the server. The server validates them again and allows the user to access the system if authentication is successful.
[1479] What it does: The server uses SQLAlchemy to save the new user information to the database and returns a success message to the user. When logging in, it receives an authentication request from the front end and uses Flask to query the user database for authentication.
[1480] Step 2:
[1481] AI service registration and screening
[1482] Input: The AI service provider enters details about the service (service name, description, source of usage data, price, etc.).
[1483] Processing: The device sends the entered information to the server, which then evaluates the received information based on its screening criteria to verify its legitimacy and quality.
[1484] Output: If the review is successful, the service is registered in the database and added to the marketplace.
[1485] Specific operation: The server receives the service data and uses its internal logic to check whether the content complies with the review criteria. If legality and quality are confirmed, the service information is added to the database using SQLAlchemy and reflected in the marketplace.
[1486] Step 3:
[1487] Search and browse the marketplace
[1488] Input: A user searches using categories and keywords.
[1489] Processing: The device sends search criteria to the server. The server extracts services that match the search criteria from the database and sends the results to the device.
[1490] Output: A list of matching services will be displayed on the terminal, along with detailed information about each service (description, price, rating, etc.).
[1491] Specific operation: Receives keywords entered by the user from the front end, executes a database query using Flask, returns the search results in JSON format to the front end, and displays them.
[1492] Step 4:
[1493] Service Use and Evaluation
[1494] Input: The user selects the service of interest and completes the purchase process.
[1495] Processing: The device sends purchase information to the server. The server confirms the purchase and grants permission. After using the service, the user provides feedback and a rating.
[1496] Output: A confirmation message and authorization will be displayed on the device. Feedback and ratings will be stored in the database.
[1497] Specific operations: The server receives the purchase information and processes the payment. It then records the service permission in the database and returns a feedback form to the user. It also stores the rating and feedback received from the device in the database.
[1498] Step 5:
[1499] Personalized product recommendations
[1500] Input: User's past behavioral data and rating data.
[1501] Processing: The server analyzes the user's behavioral data and recommends appropriate AI services.
[1502] Output: The personalized recommendation is displayed on the user's device.
[1503] Specific operation: The server runs the recommendation algorithm using a generative AI model based on past behavioral data, returns the results to the front end using Flask, and displays the recommendation results on the device.
[1504] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1505] The present invention is a system designed to enable users to use AI services in a healthy and appropriate manner, specifically including various means for user registration and login, service registration by AI service providers, review and confirmation of registered AI services, user search and browsing of AI services, and user evaluation and feedback on AI services. Furthermore, the present invention improves the reliability and quality evaluation of AI services by obtaining emotional feedback from users through the combination of an emotion engine that recognizes user emotions.
[1506] Program processing
[1507] 1. User Registration and Login
[1508] When a user uses this system for the first time, they enter the required information (such as name, email address, and password) into a form to register an account from their device and send it to the server. The server receives this information, checks whether it meets the requirements, and then stores it in a database. When logging in, the user enters the email address and password they used when registering, and the server verifies and authenticates them.
[1509] 2. Registering AI services
[1510] When an AI service provider registers a new service, they enter detailed service information (service name, description, source of usage data, price, etc.) from their device and send it to the server. The server receives this information and reviews the legality and quality of the AI service based on the review criteria. If the review passes, the server registers the service in its database and adds it to the marketplace.
[1511] 3. Browse and search the Marketplace
[1512] When a user browses the marketplace to use an AI service, they search using categories and keywords on their device. The server extracts services that match the search criteria from the database and displays the results on the device. Detailed information about each AI service (description, price, rating, etc.) is also displayed.
[1513] 4. Operation of the Emotion Engine
[1514] While using the AI service, the emotion engine is activated and analyzes the user's facial expressions and voice using a camera or microphone. The analyzed emotion data is sent to the server in real time, and the server recognizes the user's emotional state based on that data. This recognition result is reflected in the evaluation and feedback of the AI service.
[1515] 5. Use and Evaluation of the Service
[1516] When a user wishes to use an AI service, they complete the purchase procedure on the service details page from their device. After the purchase is completed, the server grants permission to use the service. After using the service, the user fills out a form to provide feedback and a rating, and sends it to the server. In addition, the emotion data recognized by the emotion engine is also reflected in the rating. The server stores this rating and emotion data in a database and reflects it for other users' reference.
[1517] Specific examples
[1518] User Registration and Login
[1519] Device: To register an account, the user (Yamada) enters his name, email address, and password and clicks the "Register" button.
[1520] Server: Receives registration information, checks the conditions, saves it in the database, and sends a message indicating successful registration.
[1521] Yamada: Enter your email address and password on the login screen to log in.
[1522] Registering AI services
[1523] Terminal: The provider (Mr. Sato) enters details of the new image recognition AI service and presses the "Register" button.
[1524] Server: Receives service information and reviews it based on the review criteria. If it passes, it is registered in the database and added to the marketplace.
[1525] Search the Marketplace
[1526] Device: The user (Mr. Tanaka) searches for an AI service using the keyword "image recognition."
[1527] Server: Extracts matching services from the database and displays them as search results.
[1528] Emotion Engine Operation
[1529] Device: When Tanaka uses the service, the camera and microphone are activated and facial expressions and voice are analyzed.
[1530] Server: Receives the analysis results in real time and recognizes Tanaka's emotional data.
[1531] Service Use and Evaluation
[1532] Device: On the details page of the service that Mr. Tanaka is interested in, he clicks the "Purchase" button and completes the purchase procedure.
[1533] Server: Confirms the purchase and grants permission to use the app. Receives feedback provided by Tanaka after use and stores the rating and sentiment data.
[1534] By implementing the above steps, the invention will ensure a healthy and appropriate match between AI service providers and users, improving the reliability and quality of the entire market. By combining it with an emotion engine, emotional feedback can also be incorporated, resulting in more detailed and reliable evaluations.
[1535] The processing flow will be explained below.
[1536] User Registration and Login
[1537] User Registration
[1538] Step 1:
[1539] The user opens the application and clicks the "Register an account" button on their device.
[1540] Step 2:
[1541] The terminal receives the input form for account registration from the server and displays it on the screen.
[1542] Step 3:
[1543] The user enters their name, email address, and password and clicks the "Register" button.
[1544] Step 4:
[1545] The terminal transmits the entered registration information to the server.
[1546] Step 5:
[1547] The server receives the registration information and verifies that it meets the requirements (such as validating the email address format).
[1548] Step 6:
[1549] After confirmation, the server stores the user data in a database and sends a message to the terminal indicating successful registration.
[1550] Step 7:
[1551] The terminal displays a registration success message to the user.
[1552] User Login
[1553] Step 1:
[1554] The user visits the application's login screen.
[1555] Step 2:
[1556] The user enters their email address and password and clicks the "Login" button.
[1557] Step 3:
[1558] The device sends the login information to the server.
[1559] Step 4:
[1560] The server authenticates the received login information by checking it against the account information in its database.
[1561] Step 5:
[1562] The server sends the authentication result (success or failure) to the terminal.
[1563] Step 6:
[1564] If the terminal is successfully logged in, the user dashboard screen is displayed, and if the login is unsuccessful, an error message is displayed.
[1565] Registering AI services
[1566] Step 1:
[1567] The user clicks the "Service Registration" button to display the service registration screen on the terminal.
[1568] Step 2:
[1569] The terminal receives an input form for service registration from the server and displays it on the screen.
[1570] Step 3:
[1571] The user (service provider) enters the service name, description, source of usage data, price, and other detailed information, and clicks the "Register" button.
[1572] Step 4:
[1573] The terminal transmits the input service information to the server.
[1574] Step 5:
[1575] The server inspects the information it receives to ensure it complies with regulations and guidelines.
[1576] Step 6:
[1577] After the server confirms the information, it provisionally registers the service information and starts the review process.
[1578] Step 7:
[1579] The server's internal review system evaluates the service content, verifying the source of data used, copyright legality, and other compliance with regulations.
[1580] Step 8:
[1581] The server notifies the user of the results of the review. If the service passes, it will be officially added to the marketplace. If it fails, the server will provide detailed instructions on how to fix the problem.
[1582] Browse and search the Marketplace
[1583] Step 1:
[1584] The user clicks on the Marketplace menu to view category information and a list of current popular items on their device.
[1585] Step 2:
[1586] The user enters keywords in the search bar, sets conditions, and clicks the "Search" button.
[1587] Step 3:
[1588] The terminal sends the search criteria to the server.
[1589] Step 4:
[1590] The server extracts AI services that match the search criteria from the database and generates a list of results.
[1591] Step 5:
[1592] The server sends the search results to the terminal and displays them to the user.
[1593] Emotion Engine Operation
[1594] Step 1:
[1595] While a user is using an AI service, emotional data is collected using the device's camera or microphone.
[1596] Step 2:
[1597] The device analyzes facial expression data or voice data collected in real time to identify emotional states.
[1598] Step 3:
[1599] The terminal transmits the identified user's emotion data to the server.
[1600] Step 4:
[1601] Based on the emotion data received by the server, the user's emotional state at that time is recorded.
[1602] Step 5:
[1603] The server stores the recorded emotional data as a usage evaluation of the AI service and makes it available to other users as a reference.
[1604] Service Use and Evaluation
[1605] Step 1:
[1606] Users can select the AI service of interest from the search results and detailed information will be displayed on their device.
[1607] Step 2:
[1608] The user checks the service details and, if it is a paid service, clicks the "Purchase" button to complete the purchase procedure.
[1609] Step 3:
[1610] The terminal transmits the purchase procedure information to the server.
[1611] Step 4:
[1612] The server confirms the purchase procedure, completes the payment process, and then transmits usage permission to the terminal.
[1613] Step 5:
[1614] Once the user has finished using the service, they will access a screen where they can enter their feedback and rating.
[1615] Step 6:
[1616] The user inputs evaluation points and comments, and the terminal transmits the information to the server.
[1617] Step 7:
[1618] The server stores the received feedback and rating data in a database, and the emotion data collected by the emotion engine is also reflected in the rating.
[1619] Example 2
[1620] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1621] Currently, when using AI services, concerns about reliability and quality often arise between providers and users. Furthermore, due to a lack of verification of the legality of services and transparency in evaluations, it is difficult for users to use the services with peace of mind. Furthermore, conventional feedback systems do not easily reflect users' emotional feedback in their evaluations, making it difficult to grasp true user satisfaction.
[1622] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for enabling user registration and login, a means for enabling service registration by AI service providers, a means for reviewing and confirming registered AI services, a means for evaluating the legality and quality of AI services based on review criteria, a means for users to search for and browse registered AI services, a means for users to evaluate and provide feedback on AI services, and a means for obtaining feedback using an emotion engine that recognizes user emotions and reflecting it in the evaluation. This enables reliable matching between AI service providers and users, improving the reliability and quality of the entire market, and reflecting users' emotional feedback in the evaluation, making it possible to more accurately grasp satisfaction levels.
[1623] "User registration" is the process by which a new user enters their information (such as name, email address, and password) into the system to create an account.
[1624] "Login" is the process by which an already registered user enters authentication information (email address and password) and is authenticated in order to access the system.
[1625] "AI services" is a general term for various functions and applications provided based on artificial intelligence technology.
[1626] "Service registration" is the process by which an AI service provider enters details of a new service into the system, which then stores and manages that information in its database.
[1627] "Review and verification" is the process by which the system checks the content of registered AI services and verifies whether they comply with legality and quality standards.
[1628] "Search" is the process by which a user enters specific criteria (categories or keywords) and finds matching AI services within the system.
[1629] "Viewing" refers to a user displaying and checking search results and detailed information about registered AI services on a screen.
[1630] "Evaluation and feedback" is the process by which, after a user uses an AI service, they enter their opinions, impressions, and evaluation scores about the service into the system, which then stores them in a database.
[1631] "Emotion engine" refers to technology that analyzes and recognizes a user's emotional state from their facial expressions and voice.
[1632] "Means of obtaining feedback and reflecting it in the evaluation" refers to the process of using user emotional data analyzed by the emotion engine to reflect it in the evaluation of the AI service.
[1633] The present invention is a system that aims to enable users to use artificial intelligence (AI) services in a healthy and appropriate manner. The system operates as follows.
[1634] First, in order to use the system, a user must register from their terminal. The user enters their name, email address, and password and clicks the "Register" button. This information is sent from the terminal to the server, which verifies the received data and stores it in a database. The user then enters their email address and password on the login screen, and the server performs authentication.
[1635] Next, the AI service provider registers their service. The provider enters information such as the service name, description, source of usage data, and price on their device, and then presses the "Register" button. This information is also sent to the server, which reviews the service for legality and quality. The review is conducted based on the review criteria, and if it passes, it is registered in the database and displayed on the marketplace.
[1636] Users browse the marketplace and search for AI services by category or keyword. The server retrieves matching services from the database and displays them on the device. Detailed information about each service (description, price, ratings, etc.) is also displayed.
[1637] When a user uses the service, the emotion engine operates using the camera and microphone installed on the device. The user's facial expressions and voice are analyzed in real time during use, and the data is sent to the server. The server recognizes the user's emotional state based on the received data and reflects that emotional data in evaluations and feedback.
[1638] When a user purchases a service, they complete the purchase procedure on the service's details page from their device. The server verifies the purchase information and records it in a database. Once the purchase is complete, the user is authorized to use the service and provides feedback and a rating after subsequent use. This rating and feedback is sent from the device to the server, which stores it in a database. The stored data is reflected in the marketplace so that other users can refer to it.
[1639] Specifically, for example, if a user inputs the prompt, "Please tell me how to use the emotion engine to analyze user feedback in detail and use it to evaluate AI services," the system will analyze the emotion data acquired by the emotion engine and reflect the results in the user's feedback. In this way, trust and quality are improved between AI service providers and users, and users' emotional feedback is also reflected in evaluations, enabling a more accurate understanding of satisfaction levels.
[1640] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1641] Step 1:
[1642] The user enters their name, email address, and password and clicks the "Register" button. The device sends this information to the server. The server validates the information and checks whether it is in the correct format. Once validation is complete, the server saves the user information in a database and sends a message to the device indicating that registration was successful. The device then displays a message to the user indicating that registration was successful.
[1643] Step 2:
[1644] The user enters an email address and password on the login screen. The device sends the entered information to the server. The server retrieves the relevant user information from the database and compares it with the entered password to perform authentication. If authentication is successful, the server sends an authentication success message to the device. The device displays a login success message and a dashboard to the user.
[1645] Step 3:
[1646] The AI service provider enters detailed information such as the service name, description, source of usage data, and price, and presses the "Register" button. The device then sends this information to the server. The server receives the service information and evaluates its content based on the specified screening criteria. Specifically, it checks the legality and quality of the usage data. If the screening is successful, the server registers the service in its database and displays it on the marketplace. The device then notifies the service provider of the screening results.
[1647] Step 4:
[1648] The user browses the marketplace and searches using categories and keywords. The device sends the user's search criteria to the server. The server extracts matching services from the database and sends them to the device as search results. The device displays the search results received from the server to the user, along with detailed information about each service (description, price, rating, etc.).
[1649] Step 5:
[1650] When a user uses an AI service, the emotion engine operates using the camera and microphone installed on the device. The user's facial expressions and voice are collected in real time during use. The device sends the collected data to a server. The server analyzes the received emotion data and stores the results in a database. This data indicates the user's emotional state while using the service.
[1651] Step 6:
[1652] The user clicks the "Purchase" button on the details page of the AI service they are interested in, enters the required information, and completes the purchase procedure. The device sends the purchase information to the server. The server verifies the purchase information and records it in a database. Once the purchase procedure is complete, the server sends usage permission to the device. The device notifies the user of usage permission.
[1653] Step 7:
[1654] After using the service, the user inputs and submits a rating and feedback. The device then sends the user's feedback information to the server. The server then stores the received feedback and rating in a database. The stored data is reflected in the marketplace and can be used as reference by other users.
[1655] Step 8:
[1656] Based on the emotional data obtained by the emotion engine, the server reflects this data in the user's evaluation. The device notifies the user of the emotional feedback results, allowing other users to refer to them, enabling reliable matching between AI service providers and users.
[1657] (Application example 2)
[1658] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1659] In modern society, users require reliable and high-quality AI services that they can use with confidence. However, existing systems are unable to take users' emotional feedback into account when evaluating services, making it difficult to provide accurate evaluations. Furthermore, the legality and quality of AI services are not adequately vetted, making it difficult for users to provide reliable services. Furthermore, detailed information related to the user's payment process is not adequately managed, leaving a need for improved user experience.
[1660] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for enabling user registration and login by users, means for enabling service registration by AI service providers, means for reviewing and confirming registered AI services, means for evaluating the legality and quality of AI services based on review criteria, means for users to search for and browse registered AI services, means for users to evaluate and provide feedback on AI services, means for analyzing the user's facial expressions and voice using an emotion engine and collecting emotional feedback data in real time, means for reflecting the collected emotional feedback data in service evaluations, and means for users to enter detailed payment information and make payments. This enables reliable evaluations that reflect the user's emotional feedback, making it possible to improve the user experience while ensuring the legality and quality of AI services.
[1661] "User registration" is the process by which a user provides the necessary information to access the system and creates an account within the system.
[1662] "Logging in" is the process by which an already registered user signs into a system by providing authentication information (e.g., email address and password) to access their account.
[1663] An "AI service provider" is a company or individual that develops services using AI technology and provides those services to users.
[1664] "Service registration" is the process by which an AI service provider enters detailed information about the AI service they have developed (such as service name, description, and price) into the system, making it available for use.
[1665] "Review" refers to a series of evaluation processes conducted to verify the legality and quality of registered AI services.
[1666] "Verification" is the process of rechecking the reliability and quality of AI services based on the results of the review.
[1667] "Search" is the process by which a user enters specific criteria (e.g., keywords, categories) to find AI services within the system.
[1668] "Viewing" is the process by which a user views detailed information (description, ratings, price, etc.) of an AI service displayed as a search result.
[1669] "Evaluation" is a general term for feedback provided by users to AI services they have used, and includes numerical evaluations and letter evaluations.
[1670] "Feedback" refers to opinions and impressions provided by users after using the service, and is used to improve the service.
[1671] The "emotion engine" is a technology that analyzes the user's facial expressions and voice and recognizes their emotions in real time.
[1672] "Facial expression analysis" is the process of using a camera to recognize a user's facial expressions and infer emotions from those expressions.
[1673] "Voice analysis" is the process of recording a user's voice using a microphone and inferring emotions from that voice.
[1674] "Emotion feedback data" is data generated based on the user's facial expressions and voice analyzed by the emotion engine, and indicates the user's emotional state.
[1675] "Payment Process" refers to the series of steps required for a User to pay for a Service, including entering payment details and selecting a payment method.
[1676] This invention is a system for ensuring the sound and appropriate use of AI services, and specific embodiments thereof will be described below.
[1677] Overall system configuration
[1678] The invention is realized mainly by utilizing a server, a user's terminal, and an emotion engine. The system includes the following main means:
[1679] 1. User Registration and Login Methods
[1680] 2. Service registration methods for AI service providers
[1681] 3. Methods for reviewing and verifying registered AI services
[1682] 4. Means of assessing the legality and quality of AI services
[1683] 5. How users search for and browse AI services
[1684] 6. Evaluation and feedback measures for AI services
[1685] 7. Emotional feedback collection method using emotion engine
[1686] 8. A means of entering user payment information and making payments
[1687] Detailed Description
[1688] 1. User Registration and Login Methods
[1689] When a user uses the system for the first time, they enter the required information (such as name, email address, and password) into a form to register an account from their terminal and send it to the server. The server receives this information, checks whether it meets the requirements, and then stores it in a database. When logging in, the user enters the email address and password they used when registering, and the server verifies and authenticates them.
[1690] 2. Service registration methods for AI service providers
[1691] When an AI service provider registers a new service, they enter detailed service information (service name, description, price, etc.) from their device and send it to the server. The server receives this information, reviews the legality and quality of the AI service based on the review criteria, and if it passes, registers it in the database and adds it to the marketplace.
[1692] 3. Methods for reviewing and verifying registered AI services
[1693] The server will conduct an examination based on the examination criteria, including checking the legality of copyright and indicating the source of the data, thereby ensuring the reliability and quality of the AI service.
[1694] 4. Means of assessing the legality and quality of AI services
[1695] The server evaluates the legality and quality of the AI service based on the review criteria and stores the evaluation results in a database.
[1696] 5. How users search for and browse AI services
[1697] When a user browses the marketplace to use an AI service, they search using categories and keywords on their device. The server extracts services that match the search criteria from the database and displays the results on the device. Detailed information about each AI service (description, price, rating, etc.) is also displayed.
[1698] 6. Evaluation and feedback measures for AI services
[1699] After using the AI service, users fill out a form to provide their evaluation and feedback, and send it to the server. Furthermore, the emotional feedback data recognized by the emotion engine is also reflected in the evaluation. The server then stores these evaluations and emotional data in a database and reflects them for other users' reference.
[1700] 7. Emotional feedback collection method using emotion engine
[1701] While using the AI service, the emotion engine is activated and analyzes the user's facial expressions and voice using a camera or microphone. The analyzed emotion data is sent to the server in real time, and the server recognizes the user's emotional state based on that data. This recognition result is reflected in the evaluation and feedback of the AI service.
[1702] 8. A means of entering user payment information and making payments
[1703] When a user attempts to use an AI service, they enter payment information (e.g., card information, amount) into their device and make the payment. The server receives the payment information, processes the payment, analyzes the emotional data, and reflects it in the evaluation data.
[1704] Hardware or software used
[1705] The main hardware and software used in this system are:
[1706] Server: Build an API server using the Flask framework.
[1707] Database: A database that stores user information, service information, and emotion data.
[1708] Emotion Engine: Real-time emotion analysis software using OpenCV, Dlib, etc.
[1709] User devices: smartphones, computers, tablets, etc.
[1710] Specific examples
[1711] 1. User Registration
[1712] Device: The user (Mr. A) registers an account by entering his / her name, email address, and password.
[1713] Server: Receives registration information and stores it in a database.
[1714] 2. Payment Process
[1715] Terminal: The user (Mr. B) enters payment details and makes the payment.
[1716] Server: Processes payments, collects sentiment data, and reflects it in ratings.
[1717] Prompt Sentence Examples
[1718] Describe a payment assistant application that analyzes users' emotions in real time during the payment process and reflects the results in feedback. Illustrate the specific process, including user registration, login, payment information entry, emotion data collection, and rating and feedback, and provide details about the technologies and software used. In particular, explain the technology used for the emotion engine.
[1719] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1720] Step 1:
[1721] A user enters their name, email address, and password into the user registration form on their device and clicks the "Register" button. The input data is sent to the server, which verifies the received information and, if the required conditions are met, stores it in the database. As an output of this step, a message confirming successful registration is displayed to the user.
[1722] Step 2:
[1723] To log in from a terminal, a user enters the email address and password used during registration and clicks the "Login" button. The input data is sent to the server. The server performs authentication in the database based on the received information, and if successful, displays a login completion message and redirects the user to the dashboard screen.
[1724] Step 3:
[1725] An AI service provider enters details (service name, description, price, etc.) to register a new service from their device and clicks the "Register" button. The input data is sent to the server. The server receives this information and reviews the legality and quality of the AI service based on the review criteria. If it passes, the service information is saved in the database and added to the marketplace.
[1726] Step 4:
[1727] A user browses the marketplace on their device and searches for AI services using categories and keywords. The search criteria are sent to the server, which extracts matching services from the database and displays them as search results on the device. Detailed information about each AI service (description, price, rating, etc.) is provided to the user.
[1728] Step 5:
[1729] When a user attempts to use a selected AI service, they click the "Purchase" button on the details page and enter their payment details (card information, amount, etc.). The input data is sent to the server, which processes the payment based on the received information. After the payment is successful, permission to use the service is granted. In parallel, the server activates the user's camera and microphone to collect emotional data.
[1730] Step 6:
[1731] While using the AI service, the emotion engine is activated and analyzes the user's facial expressions and voice using a camera and microphone. The analyzed emotion data is sent to the server in real time. The server uses this data to recognize the user's emotional state. The results of this recognition are stored in a database and reflected in service ratings and feedback.
[1732] Step 7:
[1733] After using the AI service, the user fills out a form to provide evaluation and feedback and clicks the "Submit" button. The evaluation information entered is sent to the server. The server stores the received information and emotional data in a database for other users to refer to. The evaluation data will also be used to improve the service in the future.
[1734] The above processing steps enable the system to concretely implement methods to increase the reliability of AI services and provide users with a rich user experience.
[1735] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1736] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1737] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[1738] [Fourth embodiment]
[1739] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[1740] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1741] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1742] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[1743] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1744] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1745] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1746] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[1747] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1748] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1749] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1750] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1751] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1752] The present invention is a system designed to enable users to use AI services in a healthy and appropriate manner. Specifically, the system includes various means for enabling users to register and log in, for AI service providers to register services, for the review and confirmation of registered AI services, for users to search for and view AI services, and for users to evaluate and provide feedback on AI services.
[1753] Program processing
[1754] 1. User Registration and Login
[1755] When a user uses this system for the first time, they enter the required information (such as name, email address, and password) into a form to register an account from their device and send it to the server. The server receives this information, checks whether it meets the requirements, and then stores it in a database. When logging in, the user enters the email address and password they used when registering, and the server verifies and authenticates them.
[1756] 2. Registering AI services
[1757] When an AI service provider registers a new service, they enter detailed service information (service name, description, source of usage data, price, etc.) from their device and send it to the server. The server receives this information and reviews the legality and quality of the AI service based on the review criteria. If the review passes, the server registers the service in its database and adds it to the marketplace.
[1758] 3. Browse and search the Marketplace
[1759] When a user browses the marketplace to use an AI service, they search using categories and keywords on their device. The server extracts services that match the search criteria from the database and displays the results on the device. Detailed information about each AI service (description, price, rating, etc.) is also displayed.
[1760] 4. Use and Evaluation of the Service
[1761] When a user wishes to use an AI service, they complete the purchase procedure on the service details page from their device. After the purchase is completed, the server grants permission to use the service. After using the service, the user fills out a form to provide feedback and a rating, and sends it to the server. The server stores this rating in a database and reflects it for other users' reference.
[1762] Specific examples
[1763] User Registration and Login
[1764] Device: To register an account, the user (Yamada) enters his name, email address, and password and clicks the "Register" button.
[1765] Server: Receives registration information, checks the conditions, saves it in the database, and sends a message that registration was successful.
[1766] Yamada: After receiving the registration success message, enter your email address and password on the login screen to log in.
[1767] Registering AI services
[1768] Terminal: The provider (Mr. Sato) enters details of the new image recognition AI service and presses the "Register" button.
[1769] Server: Receives service information and checks its legality based on the screening criteria. If it passes, it is registered in the database and added to the marketplace.
[1770] Search the Marketplace
[1771] Device: The user (Mr. Tanaka) searches for an AI service using the keyword "image recognition."
[1772] Server: Extracts matching services from the database and displays them as search results on Tanaka's device.
[1773] Service Use and Evaluation
[1774] Device: On the details page of the service that Mr. Tanaka is interested in, he clicks the "Purchase" button and completes the purchase procedure.
[1775] Server: Confirms the purchase and grants permission to use the service. Receives feedback provided by Mr. Tanaka after use and stores it in a database.
[1776] By implementing the invention through the above steps, providers and users of AI services will be matched in a healthy and appropriate manner, improving the reliability and quality of the entire market.
[1777] The processing flow will be explained below.
[1778] User Registration and Login
[1779] User Registration
[1780] Step 1:
[1781] The user opens the application and clicks the "Register an account" button on their device.
[1782] Step 2:
[1783] The terminal receives the input form for account registration from the server and displays it on the screen.
[1784] Step 3:
[1785] The user enters their name, email address, and password and clicks the "Register" button.
[1786] Step 4:
[1787] The terminal transmits the entered registration information to the server.
[1788] Step 5:
[1789] The server receives the registration information and verifies that it meets the requirements (such as validating the email address format).
[1790] Step 6:
[1791] After confirmation, the server stores the user data in a database and sends a message to the terminal indicating successful registration.
[1792] Step 7:
[1793] The terminal displays a registration success message to the user.
[1794] User Login
[1795] Step 1:
[1796] The user visits the application's login screen.
[1797] Step 2:
[1798] The user enters their email address and password and clicks the "Login" button.
[1799] Step 3:
[1800] The device sends the login information to the server.
[1801] Step 4:
[1802] The server authenticates the received login information by checking it against the account information in its database.
[1803] Step 5:
[1804] The server sends the authentication result (success or failure) to the terminal.
[1805] Step 6:
[1806] If the terminal is successfully logged in, the user dashboard screen is displayed, and if the login is unsuccessful, an error message is displayed.
[1807] Registering AI services
[1808] Step 1:
[1809] The user clicks the "Service Registration" button to display the service registration screen on the terminal.
[1810] Step 2:
[1811] The terminal receives an input form for service registration from the server and displays it on the screen.
[1812] Step 3:
[1813] The user (service provider) enters the service name, description, source of usage data, price, and other detailed information, and clicks the "Register" button.
[1814] Step 4:
[1815] The terminal transmits the input service information to the server.
[1816] Step 5:
[1817] The server inspects the information it receives to ensure it complies with regulations and guidelines.
[1818] Step 6:
[1819] After the server confirms the information, it provisionally registers the service information and starts the review process.
[1820] Step 7:
[1821] The server's internal review system evaluates the service content, verifying the source of data used, copyright legality, and other compliance with regulations.
[1822] Step 8:
[1823] The server notifies the user of the results of the review. If the service passes, it will be officially added to the marketplace. If it fails, the server will provide detailed instructions on how to fix the problem.
[1824] Browse and search the Marketplace
[1825] Step 1:
[1826] The user clicks on the Marketplace menu to view category information and a list of current popular items on their device.
[1827] Step 2:
[1828] The user enters keywords in the search bar, sets conditions, and clicks the "Search" button.
[1829] Step 3:
[1830] The terminal sends the search criteria to the server.
[1831] Step 4:
[1832] The server extracts AI services that match the search criteria from the database and generates a list of results.
[1833] Step 5:
[1834] The server sends the search results to the terminal and displays them to the user.
[1835] Service Use and Evaluation
[1836] Step 1:
[1837] Users can click on the AI service of their interest from the search results and view detailed information on their device.
[1838] Step 2:
[1839] The user checks the service details and, if it is a paid service, clicks the "Purchase" button to complete the purchase procedure.
[1840] Step 3:
[1841] The terminal transmits the purchase procedure information to the server.
[1842] Step 4:
[1843] The server verifies the checkout information and processes the payment.
[1844] Step 5:
[1845] The server sends a purchase confirmation and permission to use to the device.
[1846] Step 6:
[1847] After using the service, the user accesses the evaluation form and inputs evaluation points and comments.
[1848] Step 7:
[1849] The terminal transmits the evaluation information to the server.
[1850] Step 8:
[1851] The server stores the received evaluation information in a database and reflects it as evaluation information for the service.
[1852] Example 1
[1853] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1854] Conventional AI service platforms provide separate functions such as user registration and login, AI service registration, legality and quality review, service search and evaluation, and feedback storage, but these functions are not integrated, resulting in issues of lack of convenience and reliability. Another issue is that feedback information is not properly stored, making it impossible for other users to utilize it. In addition, there are insufficient automated tools for evaluating the legality and quality of AI services, making it difficult to ensure overall reliability.
[1855] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1856] In this invention, the server includes a means for enabling users to register and log in, a means for enabling AI service providers to register services, a means for reviewing and verifying registered AI services, a means for evaluating the legality and quality of AI services based on review criteria, a means for users to search and browse registered AI services, a means for users to rate and provide feedback on AI services, and a means for storing the ratings and feedback in a database for other users to refer to. This enables healthy and appropriate interaction between users and AI service providers on a unified platform. Furthermore, automating the storage and evaluation of feedback using a generative AI model provides a highly reliable service environment.
[1857] "User" refers to any individual or legal entity that registers and logs in to use the system and search, use, and evaluate AI services.
[1858] "Provider" refers to an individual or corporation that registers an AI service in the system and provides that service to users.
[1859] "AI services" refers to various software and platform services provided using artificial intelligence technology.
[1860] "User registration" refers to the process by which a user provides necessary information, such as name, email address, and password, to use the system and saves that information in the system.
[1861] "Login" refers to the process by which a registered user authenticates by entering an email address and password in order to access the system.
[1862] "Service registration" refers to the process by which a provider registers a new AI service on the system by providing information such as the service name, description, source of usage data, and price.
[1863] "Review Criteria" refers to the rules and guidelines used to evaluate the legality and quality of registered AI services.
[1864] "Lawfulness" refers to the criteria for determining whether an AI service complies with laws and regulations.
[1865] "Quality" refers to the criteria for evaluating whether the functions and performance provided by an AI service meet certain standards.
[1866] "Search" refers to the process of browsing the database using keywords and categories that users enter to find a specific AI service on the system.
[1867] "Viewing" refers to the act of a user checking detailed information about an AI service displayed as a search result on the system.
[1868] "Evaluation" refers to the act of expressing the satisfaction and quality of the AI service a user has used using numerical values or comments.
[1869] "Feedback" refers to the opinions and impressions provided by users after using the service, which are stored in a database for the benefit of other users.
[1870] "Database" refers to a system for efficiently storing and managing various data including user information, service information, ratings and feedback.
[1871] A "generative AI model" refers to a software algorithm that uses artificial intelligence techniques to automatically perform evaluation and data analysis.
[1872] The present invention is a system that aims to enable users to use AI services in a healthy and appropriate manner, and is a platform that integrates user registration, AI service provision, search, use, evaluation, and feedback. Specific embodiments of this system are described below.
[1873] 1. User Registration and Login
[1874] When a user uses the system for the first time, they register an account from their terminal. The user enters the required information, such as name, email address, and password, and sends it to the server. The server receives this information, checks the requirements, and stores it in a database. It then sends a registration success message to the user. When logging in, the user enters the email address and password used during registration, and the server verifies and authenticates them.
[1875] Specific behavior:
[1876] Terminal: The user fills in the form and clicks the "Register" button.
[1877] Server: Receives registration information, checks the conditions, saves it in the database, and sends a registration success message.
[1878] 2. Registering AI services
[1879] AI service providers register new services by entering details such as the service name, description, source of usage data, and price on their devices and sending them to the server. The server receives this information and reviews it for legality and quality based on its review criteria. If the review passes, the server registers the service in its database and adds it to the marketplace.
[1880] Specific behavior:
[1881] Terminal: The provider enters the service details and clicks the "Register" button.
[1882] Server: Receives service information and checks its legality and quality against the screening criteria. Passed information is stored in the database and added to the marketplace.
[1883] 3. Browse and search the Marketplace
[1884] When a user wants to use an AI service, they access the marketplace from their device and search by category or keyword. The server extracts services that match the search criteria from the database and displays the results on the device.
[1885] Specific behavior:
[1886] Device: A user searches for a keyword such as "image recognition."
[1887] Server: Extracts matching services from the database and displays the search results on the device.
[1888] 4. Use and Evaluation of the Service
[1889] When a user wants to use an AI service, they complete the purchase procedure on the service details page from their device. Once the purchase is complete, the server grants permission to use the service. After using the service, the user enters information into an evaluation and feedback form and sends it to the server. The server stores this information in a database and makes it available to other users.
[1890] Specific behavior:
[1891] Device: The user clicks the "Purchase" button on the service details page.
[1892] Server: Confirms the purchase procedure and grants permission to use. Receives feedback after use and stores it in a database.
[1893] Hardware and software used
[1894] The following technologies are used to realize this system:
[1895] Database: Use Amazon Web Services (AWS) RDS.
[1896] Generative AI models: Use Google Cloud AI to automate the storage and evaluation of feedback.
[1897] Specific examples
[1898] User Registration and Login
[1899] Device: A user registers an account by entering their name, email address, and password and clicking the "Register" button.
[1900] Server: Receives the registration information, checks the conditions, saves it in the database, and sends a registration success message to the user.
[1901] User: After receiving the registration success message, enter your email address and password on the login screen to log in.
[1902] Registering AI services
[1903] Device: The provider enters details of the new image recognition AI service and clicks the "Register" button.
[1904] Server: Receives service information and checks its legality based on the screening criteria. If it passes, it is registered in the database and added to the marketplace.
[1905] Search the Marketplace
[1906] Device: A user searches for an AI service using the keyword "image recognition."
[1907] Server: Extracts matching services from the database and displays them as search results on the terminal.
[1908] Service Use and Evaluation
[1909] Terminal: The user clicks the "Purchase" button on the details page of the service they are interested in and completes the purchase process.
[1910] Server: Confirms purchases and grants permission to use. Receives feedback provided by users after use and stores it in a database.
[1911] Example prompts to input to a generative AI model:
[1912] "Please assess the legality of image recognition services. Are the sources of the data used publicly available? What criteria should you use to assess the quality of the service?"
[1913] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1914] User Registration and Login
[1915] Step 1: Fill out the user registration form
[1916] Terminal: A user visits the system's user registration page and enters the required information, such as name, email address, password, etc. Simple client-side validation is also performed to ensure all input data is correct (e.g., checking for blank spaces, checking email address format).
[1917] Input: User information such as name, email address, and password
[1918] Output: Validated input data
[1919] Step 2: Send registration information to the server
[1920] Terminal: When the user clicks the "Register" button, information is sent to the server in JSON format using JavaScript.
[1921] Input: User information in JSON format
[1922] Output: Data sent to the server
[1923] Step 3: Check server requirements and save data
[1924] Server: Analyzes the received JSON data and checks whether all required fields have been entered, whether the email address format is correct, etc. If the conditions are met, the data is saved in a database such as MySQL.
[1925] Input: Parsed user information
[1926] Output: User information stored in the database and a successful registration status
[1927] Step 4: Send a registration success message
[1928] Server: When registration is complete, create a success message and return it to the user's device as an HTTP response.
[1929] Input: Registration success status
[1930] Output: Success message
[1931] Step 5: Fill in the login form
[1932] Device: The user accesses the login screen and enters their registered email address and password.
[1933] Input: Email address and password
[1934] Output: The entered credentials
[1935] Step 6: Authentication by the Server
[1936] Server: The server checks the entered authentication information against a database to authenticate the user. If authentication is successful, the server grants access to the user.
[1937] Input: The entered credentials
[1938] Output: Permission token or authentication error message
[1939] Registering AI services
[1940] Step 1: Fill out the service registration form
[1941] Device: The AI service provider fills in the registration form with the service name, description, source of usage data, price, etc.
[1942] Input: Service name, description, usage data source, price, etc.
[1943] Output: Validated input data
[1944] Step 2: Sending service information to the server
[1945] Terminal: The provider clicks the "Register" button, and information is sent to the server in JSON format using JavaScript.
[1946] Input: Service information in JSON format
[1947] Output: Data sent to the server
[1948] Step 3: Server checks for legitimacy and quality
[1949] Server: Validates received information based on screening criteria for legality and quality. This process may involve using generative AI models to assess the origin of the data used and the appropriateness of the service.
[1950] Input: Parsed service information
[1951] Output: Review results
[1952] Step 4: Save service information to the database
[1953] Server: Saves the service information that passed the review in a database.
[1954] Input: Service information that passed the review
[1955] Output: Service information stored in the database
[1956] Step 5: Add to Marketplace
[1957] Server: Adds the stored service information to the marketplace and makes it available to users.
[1958] Input: Service information stored in the database
[1959] Output: Service information added to the Marketplace
[1960] Browse and search the Marketplace
[1961] Step 1: Enter search keywords
[1962] Terminal: User enters keywords into the Marketplace search field.
[1963] Input: Search keyword
[1964] Output: Search query based on keywords
[1965] Step 2: Send a search query to the server
[1966] Terminal: After entering the keywords, click the "Search" button and the search query will be sent to the server.
[1967] Input: Search query
[1968] Output: The search query sent to the server
[1969] Step 3: Extracting matching services from the database
[1970] Server: Searches the database and extracts services that match the keywords.
[1971] Input: Search query
[1972] Output: Search results (list of service information)
[1973] Step 4: Display search results on your device
[1974] Server: Sends search results to the user's device and displays the results for the user to view.
[1975] Input: Search results (list of service information)
[1976] Output: Search results displayed on the device
[1977] Service Use and Evaluation
[1978] Step 1: Purchase on the service details page
[1979] Device: The user visits the details page of the service they are interested in and clicks the "Purchase" button.
[1980] Input: Service ID and user purchase information
[1981] Output: Purchase request
[1982] Step 2: The server confirms the purchase and grants permission to use it
[1983] Server: Confirms the purchase procedure and grants permission to use the service if payment is successful.
[1984] Input: Purchase request and payment information
[1985] Output: Permission granted
[1986] Step 3: Enter your feedback after use
[1987] Terminal: A user who has used the service enters their evaluation in a feedback form.
[1988] Input: Feedback and rating information
[1989] output: Input feedback information
[1990] Step 4: Send and store feedback to the server
[1991] Terminal: Sends the entered feedback to the server.
[1992] Input: Feedback and rating information
[1993] Output: Feedback information sent to the server
[1994] Server: Stores the received feedback in a database and reflects it to other users.
[1995] Input: Received feedback information
[1996] Output: Feedback information stored in a database
[1997] The above is a detailed description of the specific processing steps of the system program and the operations that accompany them.
[1998] (Application example 1)
[1999] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2000] In today's AI service market, many users want to use high-quality AI services. However, it is difficult for users to find trustworthy AI services, and providers have limited means to prove that their services are legitimate. In addition, users often have difficulty deciding which service to choose, and there is a lack of means to receive personalized recommendations.
[2001] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[2002] In this invention, the server includes means for enabling user registration and login by users, means for enabling service registration by AI service providers, means for reviewing and confirming registered AI services, means for evaluating the legality and quality of AI services based on review criteria, means for users to search for and view registered AI services, means for users to evaluate and provide feedback on AI services, and means for making personalized product recommendations to users. This allows users to easily find reliable AI services and further enables personalized recommendations of optimal services to individual users.
[2003] "User registration" is the process by which a user creates an account by providing the information necessary to use the system.
[2004] "Login" is the procedure by which an already registered user enters authentication information to access the system.
[2005] "AI service provider" refers to an individual or organization that develops services based on AI technology and provides them on the system.
[2006] "Service registration" is the process by which an AI service provider registers and publicizes their service in the system.
[2007] "Review" is the process of verifying whether registered AI services meet established standards.
[2008] "Verification" is a procedure that determines, through review, that a service is legal and meets quality standards.
[2009] "Lawfulness" refers to the state in which an AI service does not violate legal requirements or regulations.
[2010] "Quality" is a comprehensive evaluation criterion that includes the performance, reliability, and user satisfaction of the AI services provided.
[2011] "Search" is the process by which a user searches for an AI service using specific keywords or categories.
[2012] "Viewing" refers to the act of a user checking search results or service detail pages.
[2013] "Evaluation" refers to the user's opinion about the satisfaction and effectiveness of the AI service they used.
[2014] "Feedback" is the act of a user providing opinions, including suggestions for improvement and impressions, to a provider.
[2015] "Personalization" is a technique for individually recommending specific services based on a user's preferences and past behavior.
[2016] 1. Overview of the entire system
[2017] This invention is a system for enabling users to use AI services in a healthy and appropriate manner. The system provides functions for user registration and login, AI service registration and review, search and browsing, use and evaluation, and personalized recommendations.
[2018] 2. Hardware and Software Used
[2019] Hardware: Smartphones, general purpose servers.
[2020] Software: Flask (Python web framework), SQLAlchemy (database management).
[2021] 3. User Registration and Login
[2022] When a user uses this system for the first time, they enter the required information (name, email address, password, etc.) into the account registration form from their terminal and send it to the server. The server receives this information, checks whether it meets the requirements, and then stores it in a database. When logging in, the user enters the email address and password they used when registering, and the server verifies and authenticates them.
[2023] 4. AI Service Registration and Review
[2024] AI service providers input detailed service information (service name, description, source of usage data, price, etc.) from their devices and send it to the server. The server receives this information and evaluates its legality and quality based on its screening criteria. If the service passes the screening, the server registers it in its database and adds it to the marketplace.
[2025] 5. Search and Browse the Marketplace
[2026] When a user browses the marketplace to use an AI service, they search using categories and keywords on their device. The server extracts services that match the search criteria from the database and displays the results on the device. Detailed information about each AI service (description, price, rating, etc.) is also displayed.
[2027] 6. Use and Evaluation of the Service
[2028] When a user wishes to use an AI service, they complete the purchase procedure on the service details page from their device. After the purchase is completed, the server grants permission to use the service. After using the service, the user fills out a form to provide feedback and a rating, and sends it to the server. The server stores this rating in a database and reflects it for other users' reference.
[2029] 7. Personalized Product Recommendations
[2030] The server provides personalized product recommendations based on the user's past behavior and ratings, which improves the user experience and helps them use reliable services.
[2031] Specific examples
[2032] 1. User Registration
[2033] Device: The user enters their name, email address, and password and clicks the "Register" button.
[2034] Server: Receives registration information, checks the conditions, saves it in the database, and sends a message indicating successful registration.
[2035] User: After receiving the registration success message, they log in by entering their email address and password on the login screen.
[2036] 2. Service Search
[2037] Device: A user searches for an AI service using the keyword "image recognition."
[2038] Server: Retrieves matching services from the database and displays the search results.
[2039] 3. Service Recommendation
[2040] System: Randomly presents recommended AI services to users.
[2041] Example prompts for generative AI models
[2042] "Please register a new account using the following user information: Username: 'Yamada Taro', Email address: 'taro@example.com', Password: 'password123'"
[2043] "Search for available AI services using the keyword 'image recognition'."
[2044] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[2045] Step 1:
[2046] User Registration and Login
[2047] Input: The user enters their name, email address, and password.
[2048] Processing: The terminal sends the entered information to the server, which verifies the received information and stores it in a database if it meets the requirements.
[2049] Output: A registration success message is displayed on the terminal. The user enters their email address and password on the login screen and submits them again to the server. The server validates them again and allows the user to access the system if authentication is successful.
[2050] What it does: The server uses SQLAlchemy to save the new user information to the database and returns a success message to the user. When logging in, it receives an authentication request from the front end and uses Flask to query the user database for authentication.
[2051] Step 2:
[2052] AI service registration and screening
[2053] Input: The AI service provider enters details about the service (service name, description, source of usage data, price, etc.).
[2054] Processing: The device sends the entered information to the server, which then evaluates the received information based on its screening criteria to verify its legitimacy and quality.
[2055] Output: If the review is successful, the service is registered in the database and added to the marketplace.
[2056] Specific operation: The server receives the service data and uses its internal logic to check whether the content complies with the review criteria. If legality and quality are confirmed, the service information is added to the database using SQLAlchemy and reflected in the marketplace.
[2057] Step 3:
[2058] Search and browse the marketplace
[2059] Input: A user searches using categories and keywords.
[2060] Processing: The device sends search criteria to the server. The server extracts services that match the search criteria from the database and sends the results to the device.
[2061] Output: A list of matching services will be displayed on the terminal, along with detailed information about each service (description, price, rating, etc.).
[2062] Specific operation: Receives keywords entered by the user from the front end, executes a database query using Flask, returns the search results in JSON format to the front end, and displays them.
[2063] Step 4:
[2064] Service Use and Evaluation
[2065] Input: The user selects the service of interest and completes the purchase process.
[2066] Processing: The device sends purchase information to the server. The server confirms the purchase and grants permission. After using the service, the user provides feedback and a rating.
[2067] Output: A confirmation message and authorization will be displayed on the device. Feedback and ratings will be stored in the database.
[2068] Specific operations: The server receives the purchase information and processes the payment. It then records the service permission in the database and returns a feedback form to the user. It also stores the rating and feedback received from the device in the database.
[2069] Step 5:
[2070] Personalized product recommendations
[2071] Input: User's past behavioral data and rating data.
[2072] Processing: The server analyzes the user's behavioral data and recommends appropriate AI services.
[2073] Output: The personalized recommendation is displayed on the user's device.
[2074] Specific operation: The server runs the recommendation algorithm using a generative AI model based on past behavioral data, returns the results to the front end using Flask, and displays the recommendation results on the device.
[2075] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[2076] The present invention is a system designed to enable users to use AI services in a healthy and appropriate manner, specifically including various means for user registration and login, service registration by AI service providers, review and confirmation of registered AI services, user search and browsing of AI services, and user evaluation and feedback on AI services. Furthermore, the present invention improves the reliability and quality evaluation of AI services by obtaining emotional feedback from users through the combination of an emotion engine that recognizes user emotions.
[2077] Program processing
[2078] 1. User Registration and Login
[2079] When a user uses this system for the first time, they enter the required information (such as name, email address, and password) into a form to register an account from their device and send it to the server. The server receives this information, checks whether it meets the requirements, and then stores it in a database. When logging in, the user enters the email address and password they used when registering, and the server verifies and authenticates them.
[2080] 2. Registering AI services
[2081] When an AI service provider registers a new service, they enter detailed service information (service name, description, source of usage data, price, etc.) from their device and send it to the server. The server receives this information and reviews the legality and quality of the AI service based on the review criteria. If the review passes, the server registers the service in its database and adds it to the marketplace.
[2082] 3. Browse and search the Marketplace
[2083] When a user browses the marketplace to use an AI service, they search using categories and keywords on their device. The server extracts services that match the search criteria from the database and displays the results on the device. Detailed information about each AI service (description, price, rating, etc.) is also displayed.
[2084] 4. Operation of the Emotion Engine
[2085] While using the AI service, the emotion engine is activated and analyzes the user's facial expressions and voice using a camera or microphone. The analyzed emotion data is sent to the server in real time, and the server recognizes the user's emotional state based on that data. This recognition result is reflected in the evaluation and feedback of the AI service.
[2086] 5. Use and Evaluation of the Service
[2087] When a user wishes to use an AI service, they complete the purchase procedure on the service details page from their device. After the purchase is completed, the server grants permission to use the service. After using the service, the user fills out a form to provide feedback and a rating, and sends it to the server. In addition, the emotion data recognized by the emotion engine is also reflected in the rating. The server stores this rating and emotion data in a database and reflects it for other users' reference.
[2088] Specific examples
[2089] User Registration and Login
[2090] Device: To register an account, the user (Yamada) enters his name, email address, and password and clicks the "Register" button.
[2091] Server: Receives registration information, checks the conditions, saves it in the database, and sends a message indicating successful registration.
[2092] Yamada: Enter your email address and password on the login screen to log in.
[2093] Registering AI services
[2094] Terminal: The provider (Mr. Sato) enters details of the new image recognition AI service and presses the "Register" button.
[2095] Server: Receives service information and reviews it based on the review criteria. If it passes, it is registered in the database and added to the marketplace.
[2096] Search the Marketplace
[2097] Device: The user (Mr. Tanaka) searches for an AI service using the keyword "image recognition."
[2098] Server: Extracts matching services from the database and displays them as search results.
[2099] Emotion Engine Operation
[2100] Device: When Tanaka uses the service, the camera and microphone are activated and facial expressions and voice are analyzed.
[2101] Server: Receives the analysis results in real time and recognizes Tanaka's emotional data.
[2102] Service Use and Evaluation
[2103] Device: On the details page of the service that Mr. Tanaka is interested in, he clicks the "Purchase" button and completes the purchase procedure.
[2104] Server: Confirms the purchase and grants permission to use the app. Receives feedback provided by Tanaka after use and stores the rating and sentiment data.
[2105] By implementing the above steps, the invention will ensure a healthy and appropriate match between AI service providers and users, improving the reliability and quality of the entire market. By combining it with an emotion engine, emotional feedback can also be incorporated, resulting in more detailed and reliable evaluations.
[2106] The processing flow will be explained below.
[2107] User Registration and Login
[2108] User Registration
[2109] Step 1:
[2110] The user opens the application and clicks the "Register an account" button on their device.
[2111] Step 2:
[2112] The terminal receives the input form for account registration from the server and displays it on the screen.
[2113] Step 3:
[2114] The user enters their name, email address, and password and clicks the "Register" button.
[2115] Step 4:
[2116] The terminal transmits the entered registration information to the server.
[2117] Step 5:
[2118] The server receives the registration information and verifies that it meets the requirements (such as validating the email address format).
[2119] Step 6:
[2120] After confirmation, the server stores the user data in a database and sends a message to the terminal indicating successful registration.
[2121] Step 7:
[2122] The terminal displays a registration success message to the user.
[2123] User Login
[2124] Step 1:
[2125] The user visits the application's login screen.
[2126] Step 2:
[2127] The user enters their email address and password and clicks the "Login" button.
[2128] Step 3:
[2129] The device sends the login information to the server.
[2130] Step 4:
[2131] The server authenticates the received login information by checking it against the account information in its database.
[2132] Step 5:
[2133] The server sends the authentication result (success or failure) to the terminal.
[2134] Step 6:
[2135] If the terminal is successfully logged in, the user dashboard screen is displayed, and if the login is unsuccessful, an error message is displayed.
[2136] Registering AI services
[2137] Step 1:
[2138] The user clicks the "Service Registration" button to display the service registration screen on the terminal.
[2139] Step 2:
[2140] The terminal receives an input form for service registration from the server and displays it on the screen.
[2141] Step 3:
[2142] The user (service provider) enters the service name, description, source of usage data, price, and other detailed information, and clicks the "Register" button.
[2143] Step 4:
[2144] The terminal transmits the input service information to the server.
[2145] Step 5:
[2146] The server inspects the information it receives to ensure it complies with regulations and guidelines.
[2147] Step 6:
[2148] After the server confirms the information, it provisionally registers the service information and starts the review process.
[2149] Step 7:
[2150] The server's internal review system evaluates the service content, verifying the source of data used, copyright legality, and other compliance with regulations.
[2151] Step 8:
[2152] The server notifies the user of the results of the review. If the service passes, it will be officially added to the marketplace. If it fails, the server will provide detailed instructions on how to fix the problem.
[2153] Browse and search the Marketplace
[2154] Step 1:
[2155] The user clicks on the Marketplace menu to view category information and a list of current popular items on their device.
[2156] Step 2:
[2157] The user enters keywords in the search bar, sets conditions, and clicks the "Search" button.
[2158] Step 3:
[2159] The terminal sends the search criteria to the server.
[2160] Step 4:
[2161] The server extracts AI services that match the search criteria from the database and generates a list of results.
[2162] Step 5:
[2163] The server sends the search results to the terminal and displays them to the user.
[2164] Emotion Engine Operation
[2165] Step 1:
[2166] While a user is using an AI service, emotional data is collected using the device's camera or microphone.
[2167] Step 2:
[2168] The device analyzes facial expression data or voice data collected in real time to identify emotional states.
[2169] Step 3:
[2170] The terminal transmits the identified user's emotion data to the server.
[2171] Step 4:
[2172] Based on the emotion data received by the server, the user's emotional state at that time is recorded.
[2173] Step 5:
[2174] The server stores the recorded emotional data as a usage evaluation of the AI service and makes it available to other users as a reference.
[2175] Service Use and Evaluation
[2176] Step 1:
[2177] Users can select the AI service of interest from the search results and detailed information will be displayed on their device.
[2178] Step 2:
[2179] The user checks the service details and, if it is a paid service, clicks the "Purchase" button to complete the purchase procedure.
[2180] Step 3:
[2181] The terminal transmits the purchase procedure information to the server.
[2182] Step 4:
[2183] The server confirms the purchase procedure, completes the payment process, and then transmits usage permission to the terminal.
[2184] Step 5:
[2185] Once the user has finished using the service, they will access a screen where they can enter their feedback and rating.
[2186] Step 6:
[2187] The user inputs evaluation points and comments, and the terminal transmits the information to the server.
[2188] Step 7:
[2189] The server stores the received feedback and rating data in a database, and the emotion data collected by the emotion engine is also reflected in the rating.
[2190] Example 2
[2191] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2192] Currently, when using AI services, concerns about reliability and quality often arise between providers and users. Furthermore, due to a lack of verification of the legality of services and transparency in evaluations, it is difficult for users to use the services with peace of mind. Furthermore, conventional feedback systems do not easily reflect users' emotional feedback in their evaluations, making it difficult to grasp true user satisfaction.
[2193] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for enabling user registration and login, a means for enabling service registration by AI service providers, a means for reviewing and confirming registered AI services, a means for evaluating the legality and quality of AI services based on review criteria, a means for users to search for and browse registered AI services, a means for users to evaluate and provide feedback on AI services, and a means for obtaining feedback using an emotion engine that recognizes user emotions and reflecting it in the evaluation. This enables reliable matching between AI service providers and users, improving the reliability and quality of the entire market, and reflecting users' emotional feedback in the evaluation, making it possible to more accurately grasp satisfaction levels.
[2194] "User registration" is the process by which a new user enters their information (such as name, email address, and password) into the system to create an account.
[2195] "Login" is the process by which an already registered user enters authentication information (email address and password) and is authenticated in order to access the system.
[2196] "AI services" is a general term for various functions and applications provided based on artificial intelligence technology.
[2197] "Service registration" is the process by which an AI service provider enters details of a new service into the system, which then stores and manages that information in its database.
[2198] "Review and verification" is the process by which the system checks the content of registered AI services and verifies whether they comply with legality and quality standards.
[2199] "Search" is the process by which a user enters specific criteria (categories or keywords) and finds matching AI services within the system.
[2200] "Viewing" refers to a user displaying and checking search results and detailed information about registered AI services on a screen.
[2201] "Evaluation and feedback" is the process by which, after a user uses an AI service, they enter their opinions, impressions, and evaluation scores about the service into the system, which then stores them in a database.
[2202] "Emotion engine" refers to technology that analyzes and recognizes a user's emotional state from their facial expressions and voice.
[2203] "Means of obtaining feedback and reflecting it in the evaluation" refers to the process of using user emotional data analyzed by the emotion engine to reflect it in the evaluation of the AI service.
[2204] The present invention is a system that aims to enable users to use artificial intelligence (AI) services in a healthy and appropriate manner. The system operates as follows.
[2205] First, in order to use the system, a user must register from their terminal. The user enters their name, email address, and password and clicks the "Register" button. This information is sent from the terminal to the server, which verifies the received data and stores it in a database. The user then enters their email address and password on the login screen, and the server performs authentication.
[2206] Next, the AI service provider registers their service. The provider enters information such as the service name, description, source of usage data, and price on their device, and then presses the "Register" button. This information is also sent to the server, which reviews the service for legality and quality. The review is conducted based on the review criteria, and if it passes, it is registered in the database and displayed on the marketplace.
[2207] Users browse the marketplace and search for AI services by category or keyword. The server retrieves matching services from the database and displays them on the device. Detailed information about each service (description, price, ratings, etc.) is also displayed.
[2208] When a user uses the service, the emotion engine operates using the camera and microphone installed on the device. The user's facial expressions and voice are analyzed in real time during use, and the data is sent to the server. The server recognizes the user's emotional state based on the received data and reflects that emotional data in evaluations and feedback.
[2209] When a user purchases a service, they complete the purchase procedure on the service's details page from their device. The server verifies the purchase information and records it in a database. Once the purchase is complete, the user is authorized to use the service and provides feedback and a rating after subsequent use. This rating and feedback is sent from the device to the server, which stores it in a database. The stored data is reflected in the marketplace so that other users can refer to it.
[2210] Specifically, for example, if a user inputs the prompt, "Please tell me how to use the emotion engine to analyze user feedback in detail and use it to evaluate AI services," the system will analyze the emotion data acquired by the emotion engine and reflect the results in the user's feedback. In this way, trust and quality are improved between AI service providers and users, and users' emotional feedback is also reflected in evaluations, enabling a more accurate understanding of satisfaction levels.
[2211] The flow of the identification process in the second embodiment will be described with reference to FIG.
[2212] Step 1:
[2213] The user enters their name, email address, and password and clicks the "Register" button. The device sends this information to the server. The server validates the information and checks whether it is in the correct format. Once validation is complete, the server saves the user information in a database and sends a message to the device indicating that registration was successful. The device then displays a message to the user indicating that registration was successful.
[2214] Step 2:
[2215] The user enters an email address and password on the login screen. The device sends the entered information to the server. The server retrieves the relevant user information from the database and compares it with the entered password to perform authentication. If authentication is successful, the server sends an authentication success message to the device. The device displays a login success message and a dashboard to the user.
[2216] Step 3:
[2217] The AI service provider enters detailed information such as the service name, description, source of usage data, and price, and presses the "Register" button. The device then sends this information to the server. The server receives the service information and evaluates its content based on the specified screening criteria. Specifically, it checks the legality and quality of the usage data. If the screening is successful, the server registers the service in its database and displays it on the marketplace. The device then notifies the service provider of the screening results.
[2218] Step 4:
[2219] The user browses the marketplace and searches using categories and keywords. The device sends the user's search criteria to the server. The server extracts matching services from the database and sends them to the device as search results. The device displays the search results received from the server to the user, along with detailed information about each service (description, price, rating, etc.).
[2220] Step 5:
[2221] When a user uses an AI service, the emotion engine operates using the camera and microphone installed on the device. The user's facial expressions and voice are collected in real time during use. The device sends the collected data to a server. The server analyzes the received emotion data and stores the results in a database. This data indicates the user's emotional state while using the service.
[2222] Step 6:
[2223] The user clicks the "Purchase" button on the details page of the AI service they are interested in, enters the required information, and completes the purchase procedure. The device sends the purchase information to the server. The server verifies the purchase information and records it in a database. Once the purchase procedure is complete, the server sends usage permission to the device. The device notifies the user of usage permission.
[2224] Step 7:
[2225] After using the service, the user inputs and submits a rating and feedback. The device then sends the user's feedback information to the server. The server then stores the received feedback and rating in a database. The stored data is reflected in the marketplace and can be used as reference by other users.
[2226] Step 8:
[2227] Based on the emotional data obtained by the emotion engine, the server reflects this data in the user's evaluation. The device notifies the user of the emotional feedback results, allowing other users to refer to them, enabling reliable matching between AI service providers and users.
[2228] (Application example...
Claims
1. Allow users to register and log in Means and Enables AI service providers to register their services Means and Review and verify registered AI services Means and Evaluating the legality and quality of AI services based on screening criteria Means and Users can search and browse registered AI services Means and Users rate and provide feedback on AI services means Including system.
2. 2. The system according to claim 1, wherein the review criteria include confirmation of copyright legality and indication of data source.
3. The system of claim 1, wherein after a user uses an AI service, the user's evaluation and feedback are stored in a database and reflected in the service's reliability rating.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A