system

Abstract

We provide the system. [Solution] A means for inputting problem details from a terminal, performing analysis based on the inputted problem details, and proposing appropriate products or services. A means for displaying detailed information selected by the user from among the proposed products and services, A means of entering the necessary information for the application process, confirming the entered information, and completing the application process. A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance as a response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In modern diverse product and service selections, it is difficult for users to quickly and easily find the optimal products or services to appropriately solve their problems. Also, the application procedures are complicated, and many users often find them troublesome. In particular, the lack of a system that satisfies the different needs of individual users and corporate users makes it difficult to provide effective support. Therefore, there is a need for a system that allows users to smoothly solve problems and quickly complete the application for appropriate products or services.

Means for Solving the Problems

[0005] The present invention is a system that includes means for inputting problem details from a terminal, performing analysis based on the input problem details, and proposing appropriate products and services; means for displaying detailed information selected by the user from the proposed products and services; and means for inputting necessary information for the application procedure, confirming the input details, and completing the application procedure. Furthermore, by including means for analyzing the input problem details using natural language processing technology, proposing products and services based on the analysis results, and sending a confirmation email to the user when the application procedure is completed, the system enables the rapid and accurate resolution of the user's problems and the efficient provision of optimal products and services and application procedures.

[0006] A "terminal" is an electronic device, such as a computer or mobile device, that a user uses to access and operate a system.

[0007] "Problem description" refers to text information about the challenges or problems that the user is facing, which is entered via their device.

[0008] "Analysis" refers to the process of analyzing the input problem content using natural language processing technology and other methods to select suitable products or services.

[0009] "Products and services" is a broad term referring to products and support activities provided to solve users' problems.

[0010] "Means" refers to the programs or hardware configurations used to perform specific functions or processes within a system.

[0011] A "suggestion" is a list of suitable products or services presented to the user based on the analysis results.

[0012] "Detailed information" refers to the specific descriptions of the product or service selected by the user, including information such as features, price, and terms of use.

[0013] "Application procedure" refers to a series of steps, including the input and verification of necessary information, required for a user to formally purchase or use a proposed product or service.

[0014] A "confirmation email" is an email sent from the system to the user after the application process is completed, notifying them of the confirmation and receipt of their application details. [Brief explanation of the drawing]

[0015] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13]It is a sequence diagram showing the processing flow of the data processing system in Embodiment 2 when combined with an emotion engine. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when combined with an emotion engine.

Mode for Carrying Out the Invention

[0016] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0017] First, the language used in the following description will be explained.

[0018] In the following embodiments, a numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0019] In the following embodiments, a numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0020] In the following embodiments, a numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0021] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0023] [First Embodiment]

[0024] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0025] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0028] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0031] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0035] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0036] This invention is a system that allows users to input their own needs, receive suggestions for appropriate products and services based on those needs, and support them until they complete the application process. Specific embodiments for implementing this invention are described below.

[0037] Overall system configuration

[0038] This system consists of a server, terminals, and users. Terminals are devices that users use to access and operate the system, while the server is the central unit that handles data processing and analysis, product and service recommendations, and application procedures.

[0039] Program Processing Overview

[0040] 1. Access to the user interface

[0041] Device: The user launches a web browser or a dedicated app to access this system.

[0042] Server: Receives user access requests, dynamically generates and displays personal or corporate interfaces.

[0043] 2. User input of problems / issues

[0044] Terminal: The user enters their problem into the text area of ​​the displayed interface and clicks the send button.

[0045] Server: Receives the input data and starts the analysis.

[0046] 3. Analysis of problems and proposal of solutions

[0047] Server: Analyzes input problems using natural language processing techniques. For example, it extracts keywords using text mining techniques and understands their meaning.

[0048] Server: Based on the analysis results, it searches the database for suitable product and service candidates and generates a list.

[0049] Server: Present this list to the user and prompt them to make a selection.

[0050] 4. Select and view details of products and services.

[0051] Terminal: The user clicks on a product or service from the presented list to view more details.

[0052] Server: Retrieves detailed information about the selected product from the database and displays it to the user.

[0053] 5. Completion of application procedure

[0054] Terminal: The user enters the required information into a form to view details and submit an application.

[0055] Server: Receives the input data and performs validation.

[0056] Server: If validation is successful, complete the application process.

[0057] 6. Sending a confirmation email

[0058] Server: Confirms that the application process is complete and sends a confirmation email to the user.

[0059] Specific example

[0060] This explains what happens when an individual user enters a problem, such as "the internet is slow."

[0061] Access to the interface

[0062] Terminal: User A opens a web browser and accesses this system.

[0063] Server: Receives user access requests and displays a personalized interface.

[0064] Enter your problem

[0065] Terminal: User A types "The internet is slow" and clicks the send button.

[0066] Server: Receives input data and begins analysis.

[0067] Problem analysis and solution proposal

[0068] Server: The phrase "the internet is slow" is analyzed using a natural language processing engine, and related keywords (e.g., speed improvement, plan change) are extracted.

[0069] Server: Based on the analysis results, it generates a list of suitable product candidates, such as internet plan speed improvement services, and presents them to User A.

[0070] Select and view details of products and services.

[0071] Terminal: User A clicks on "Internet Speed ​​Improvement Plan".

[0072] Server: Retrieves detailed information about the selected product and displays it to the user.

[0073] Completion of application procedure

[0074] Terminal: User A enters required information such as name and address into the application form and clicks the submit button.

[0075] Server: Receives input data, performs validation, and completes the application process.

[0076] Sending a confirmation email

[0077] Server: Confirms that the application has been completed and sends a confirmation email to User A.

[0078] In this way, the system allows users to quickly and efficiently resolve their problems and easily apply for the most suitable products and services.

[0079] The following describes the processing flow.

[0080] Step 1:

[0081] Device: The user launches a web browser or a dedicated app to access this system.

[0082] Step 2:

[0083] Server: Receives user access requests, dynamically generates and displays personal or corporate interfaces.

[0084] Step 3:

[0085] Terminal: The interface is displayed, and a text area is provided for the user to enter their problem.

[0086] Step 4:

[0087] Terminal: The user enters their problem into the text area and clicks the send button.

[0088] Step 5:

[0089] Server: Receives user input data and starts text analysis using a natural language processing (NLP) engine.

[0090] Step 6:

[0091] Server: The NLP engine extracts keywords related to the input problem and analyzes the sentiment and context.

[0092] Step 7:

[0093] Server: Based on the analysis results, it searches the database for suitable product and service candidates and generates a list.

[0094] Step 8:

[0095] Server: Generates a list of products and services in HTML format and sends it to the client terminal.

[0096] Step 9:

[0097] Terminal: The terminal receives a list of suggested products and services from the user and displays it on the screen.

[0098] Step 10:

[0099] Terminal: The user clicks on the product or service they want to view details about.

[0100] Step 11:

[0101] Terminal: Sends a request to display details to the server.

[0102] Step 12:

[0103] Server: Retrieves detailed information about the selected product from the database, formats it in HTML format, and sends it to the client terminal.

[0104] Step 13:

[0105] Terminal: The screen displays detailed information about the product selected by the user.

[0106] Step 14:

[0107] Terminal: The user reviews the details and fills out the required information in the application form.

[0108] Step 15:

[0109] Terminal: The user clicks the complete button and sends the application request to the server.

[0110] Step 16:

[0111] Server: Receives the required information entered and performs validation.

[0112] Step 17:

[0113] Server: If validation is successful, complete the application process within the system.

[0114] Step 18:

[0115] Server: Generates confirmation information for the completion of the application process and sends it to the client terminal.

[0116] Step 19:

[0117] Terminal: The user receives a confirmation message that the application process is complete.

[0118] Step 20:

[0119] Server: After the application process is complete, a confirmation email will be sent to the user's registered email address.

[0120] The above outlines the specific processing steps from when a user enters their problem to when they select the appropriate product or service and complete the application.

[0121] (Example 1)

[0122] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0123] Traditionally, there have been few systems that appropriately analyze users' problems and propose effective products and services based on that analysis. Furthermore, there has been a lack of systems that display detailed information about the proposed products and services and smoothly guide users through the application process. As a result, it has been difficult for users to quickly and efficiently resolve their problems. This invention aims to provide a system that analyzes the problem content entered by the user using natural language processing technology, proposes appropriate products and services based on the analysis results, and allows users to easily complete the application process.

[0124] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0125] In this invention, the server includes means for receiving problem details from a terminal, performing analysis based on the entered problem details, and suggesting appropriate products and services; means for displaying detailed information selected by the user from the suggested products and services; means for receiving necessary information for the application procedure, confirming the entered information, and completing the application procedure; means for sending a confirmation email to the user when the application procedure is completed; and means for analyzing the entered problem details using natural language processing technology, generating a list of suggestions from a service database based on the analysis results, and presenting it to the user. This enables users to solve their problems quickly and efficiently and easily apply for appropriate products and services.

[0126] A "terminal" refers to a device such as a computer, smartphone, or tablet that a user uses for input and operation.

[0127] "Problem description" refers to the text information about the challenges or problems that the user enters into the input field.

[0128] "Analysis" is the process by which a server understands the received problem content using natural language processing technology and extracts relevant keywords and meanings.

[0129] "Product and service suggestions" refers to selecting and displaying a list of products and services that provide appropriate solutions to the user based on the analyzed problem.

[0130] "Detailed information" refers to additional information, features, and specifications that help users gain a deeper understanding of the proposed product or service.

[0131] The "application process" is the process by which a user enters the information necessary to actually use the selected product or service and formally completes the application.

[0132] A "confirmation email" is a notification email sent to a user upon completion of the application process.

[0133] "Natural language processing technology" refers to techniques that enable computers to understand, analyze, and generate human language, and includes methods such as text mining and keyword extraction.

[0134] A "service database" is a database containing information about products and services that the server accesses in order to generate a list of suggestions.

[0135] A "suggestion list" is a list of appropriate products and services that the server generates and presents to the user based on the analysis results.

[0136] This invention is a system that allows users to input their own needs, receive suggestions for appropriate products and services based on those needs, and support them until they complete the application process. Specific embodiments for implementing this invention are described below.

[0137] Overall system configuration

[0138] This system consists of a server, terminals, and users. Terminals are devices that users use to access and operate the system, while the server is the central unit that handles data processing and analysis, product and service proposals, and application procedures.

[0139] Program Processing Overview

[0140] Access to the user interface

[0141] Device: The user launches a web browser or a dedicated app to access this system.

[0142] Server: Receives user access requests, dynamically generates and displays personal or corporate interfaces.

[0143] User's problem entry

[0144] Terminal: The user enters their problem into the text area of ​​the displayed interface and clicks the send button.

[0145] Server: Receives the input data and starts the analysis.

[0146] Problem analysis and solution proposal

[0147] Server: Analyzes input problems using natural language processing techniques. For example, it extracts keywords using text mining techniques and understands their meaning.

[0148] Server: Based on the analysis results, it searches the database for suitable product and service candidates and generates a list.

[0149] Server: Present this list to the user and prompt them to make a selection.

[0150] Select and view details of products and services.

[0151] Terminal: The user clicks on a product or service from the presented list to view more details.

[0152] Server: Retrieves detailed information about the selected product from the database and displays it to the user.

[0153] Completion of application procedure

[0154] Terminal: The user enters the required information into a form to view details and submit an application.

[0155] Server: Receives the input data and performs validation.

[0156] Server: If validation is successful, complete the application process.

[0157] Sending a confirmation email

[0158] Server: Confirms that the application process is complete and sends a confirmation email to the user.

[0159] Hardware or software to use

[0160] This system uses the following specific hardware and software:

[0161] Server: Web server (e.g., Apache (registered trademark) HTTP Server)

[0162] Devices: Computers, smartphones, tablets

[0163] Software: Natural language processing engines (e.g., Apache OpenNLP), database management systems (e.g., MySQL®)

[0164] Specific example

[0165] This explains what happens when an individual user enters a problem, such as "the internet is slow."

[0166] Access to the interface

[0167] Terminal: User A opens a web browser and accesses this system.

[0168] Server: Receives user access requests and displays a personalized interface.

[0169] Enter your problem

[0170] Terminal: User A types "The internet is slow" and clicks the send button.

[0171] Server: Receives input data and begins analysis.

[0172] Problem analysis and solution proposal

[0173] Server: The phrase "the internet is slow" is analyzed using a natural language processing engine, and related keywords (e.g., speed improvement, plan change) are extracted.

[0174] Server: Based on the analysis results, it generates a list of suitable product candidates, such as internet plan speed improvement services, and presents them to User A.

[0175] Select and view details of products and services.

[0176] Terminal: User A clicks on "Internet Speed ​​Improvement Plan".

[0177] Server: Retrieves detailed information about the selected product and displays it to the user.

[0178] Completion of application procedure

[0179] Terminal: User A enters required information such as name and address into the application form and clicks the submit button.

[0180] Server: Receives input data, performs validation, and completes the application process.

[0181] Sending a confirmation email

[0182] Server: Confirms that the application has been completed and sends a confirmation email to User A.

[0183] This system is designed to provide users with quick and accurate solutions by combining natural language processing technology with database search. For example, by entering a prompt such as "Suggest services to improve internet speed when it's slow" into the generative AI model, an appropriate solution can be obtained.

[0184] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0185] Step 1: Accessing the user interface

[0186] User: Open a web browser and enter the URL of this system to access it.

[0187] Input: System URL

[0188] Output: Access Request

[0189] Server: Receives access requests and identifies whether the user is an individual or a legal entity.

[0190] Input: Access Request

[0191] Output: User type (individual or corporate)

[0192] Server: Dynamically generates the appropriate interface based on the user type, sends it to the terminal, and displays it.

[0193] Input: User Type

[0194] Output: Generated interface

[0195] Step 2: User input of problem details

[0196] Terminal: The user enters their problem in the text area of ​​the displayed interface and clicks the send button.

[0197] Input: Text of the problem

[0198] Output: Send Request

[0199] Server: Receives a transmission request and prepares the input data for analysis.

[0200] Input: Sending Request

[0201] Output: Data ready for analysis

[0202] Step 3: Problem analysis and solution proposal

[0203] Server: Starts the natural language processing engine and analyzes the problem text. For example, it extracts relevant keywords from the phrase "the internet is slow."

[0204] Input: Text of the problem

[0205] Data processing: Keyword extraction and semantic analysis using a natural language processing engine.

[0206] Output: Analysis results (keywords, etc.)

[0207] Server: Based on the analysis results, it searches the service database for appropriate products and services and generates a list of suggestions.

[0208] Input: Analysis results

[0209] Data processing: Database search

[0210] Output: Proposal List

[0211] Server: Presents a list of suggestions to the user.

[0212] Input: Proposal list

[0213] Output: Display of the suggestion list

[0214] Step 4: Select and view details of products and services.

[0215] User: Select and click on products or services of interest from the suggested list.

[0216] Input: Selected product or service

[0217] Output: Click Event

[0218] Server: Receives click events and retrieves detailed information about the corresponding product from the database.

[0219] Input: Click Event

[0220] Data processing: Information retrieval from databases

[0221] Output: Detailed information

[0222] Server: Displays detailed information to the user.

[0223] Input: Detailed information

[0224] Output: Detailed information display

[0225] Step 5: Completion of the application process

[0226] User: Review the details, fill in the required information (such as name and address) on the application form, and click the apply button.

[0227] Input: Application information (name, address, etc.)

[0228] Output: Application Request

[0229] Server: Receives application requests and validates the input data.

[0230] Input: Application Request

[0231] Data processing: validation

[0232] Output: Validation results

[0233] Server: If validation is successful, complete the application process.

[0234] Input: Validation result

[0235] Output: Application completion notification

[0236] Step 6: Sending a confirmation email

[0237] Server: Confirms that the application process is complete and sends a confirmation email to the user.

[0238] Input: Application completion notification

[0239] Output: Confirmation email sent

[0240] (Application Example 1)

[0241] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0242] Modern consumers want to quickly find products and services that meet their needs and concerns, and complete the purchase process easily and efficiently. However, currently, finding the right products and services often takes a lot of time and involves complicated procedures. This is especially true for online shopping, where selecting the right product from countless options is difficult and contributes to a poor user experience.

[0243] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0244] In this invention, the server includes means for receiving problem details from a terminal, performing analysis based on the entered problem details, and suggesting appropriate products and services; means for analyzing the input content using a natural language processing engine, generating a list of suggested products and presenting it to the user; and means for receiving necessary information for the application procedure, confirming the input content, and completing the application procedure. As a result, the user can receive prompt and appropriate suggestions for products and services that address their needs and problems, and complete the purchase procedure easily.

[0245] A "terminal" is a device used by a user to access and operate a system.

[0246] "Problem description" refers to text data in which the user enters their own worries or issues they want to solve.

[0247] "Performing analysis" refers to the process of understanding the input problem content using natural language processing technology and extracting relevant keywords.

[0248] "Means of proposing products and services" refers to a system function that searches a database for and presents suitable product and service candidates based on analyzed keywords.

[0249] A "suggestion list" is a list of products and services selected based on the user's input.

[0250] The "application process" is the process of entering and confirming the information necessary to complete the purchase of the selected product or service.

[0251] A "natural language processing engine" is a system component that analyzes user input and extracts meaning and keywords.

[0252] A "database" is an information aggregation system that stores information about the products and services being proposed.

[0253] A "confirmation email" is an email sent to a user to notify them that they have completed the application process.

[0254] An "application interface" is software that provides an interface for users to access and operate a system.

[0255] This invention is implemented as a "shopping assistant app" that users can use on their smartphones. By using this app, users can resolve their problems and concerns about products they want to buy, receive appropriate suggestions, and efficiently complete the purchase process.

[0256] Hardware and software to be used

[0257] Hardware: Smartphone (iOS or Android® device)

[0258] software:

[0259] Smartphone app

[0260] Frontend: React Native, Flutter (registered trademark)

[0261] Backend: Node.js, Django

[0262] Natural Language Processing Engine: Google Cloud Natural Language API (Registered Trademark)

[0263] Database: MySQL

[0264] Email sending service: SendGrid API

[0265] Process Overview

[0266] 1. Access to the interface

[0267] When a user launches the smartphone app from their device, the server receives an access request and dynamically generates and displays an interface. This interface provides a text area where the user can enter their needs and concerns.

[0268] 2. Input and reception of problem details

[0269] When a user enters specific information about their problem or the product they want to buy into the interface's text area and presses the submit button, the device sends that data to the server. The server receives this data and begins preparing to pass it on to the natural language processing engine.

[0270] 3. Analysis using natural language processing

[0271] The server sends input data to a natural language processing engine, such as the Google Cloud Natural Language API, for analysis. The engine extracts keywords from the text and performs a process to understand their meaning.

[0272] 4. Generate a list of suggested products

[0273] The server searches the MySQL database for relevant products and services based on the analysis results obtained through natural language processing and generates a list of suggestions. By presenting this list to the user, the system enables the user to quickly find products and services that meet their needs.

[0274] 5. Displaying and selecting product details

[0275] When a user selects a specific product or service from the suggested list, the server retrieves its details from a MySQL database and displays them on the terminal. This allows the user to review the product details and consider purchasing it.

[0276] 6. Completion of the purchase procedure

[0277] When the user enters the necessary information in the purchase form and presses the purchase button, the server receives the data and performs validation. If the validation is successful, the server completes the purchase procedure.

[0278] 7. Sending a confirmation email

[0279] When the application procedure is completed, the server uses a mail sending service such as the SendGrid API to send a confirmation email to the user. This enables the user to confirm the purchase details.

[0280] Specific example

[0281] For example, if the user enters "I want to buy a refrigerator but I'm confused about which one is good", the Google Cloud Natural Language API extracts keywords such as "refrigerator", "purchase", and "confused". Based on these keywords, the server generates a list of appropriate refrigerator proposals and presents them to the user. The user can check the detailed information from the list and easily complete the purchase procedure from a smartphone.

[0282] Examples of prompt sentences

[0283] Examples of text - format prompt sentences are shown below:

[0284] "Enter text that describes the situation where the user is considering buying a refrigerator but is confused (e.g., 'I want to buy a refrigerator but I'm confused about which one is good'). Provide the analysis procedure necessary for designing an algorithm for an application that extracts keywords using natural language processing and proposes appropriate products."

[0285] The flow of specific processing in Application Example 1 will be described using FIG. 12.

[0286] Step 1:

[0287] A user launches a smartphone app. An access request is sent from the device to the server. The server receives the access request, dynamically generates a user interface, and displays it on the device. The input is the user's access request, and the output is the displayed user interface.

[0288] Step 2:

[0289] The user enters specific information about their problem or the product they want to purchase into the interface's text area and presses the submit button. The terminal then sends this input data to the server. The input is the user's text data, and the output is the transmission of text data to the server.

[0290] Step 3:

[0291] The server sends the received text data to the Google Cloud Natural Language API for analysis. The analysis involves extracting keywords from the text and understanding their meaning. The input is the user's text data, and the output is the analyzed keyword data.

[0292] Step 4:

[0293] The server searches a MySQL database based on the extracted keywords and generates a list of suggested products and services. This list is structured to include products and services that meet the user's needs. The input is keyword data, and the output is a list of suggested products.

[0294] Step 5:

[0295] The server sends the generated suggestion list to the terminal and presents it to the user. The user selects a specific product or service from the presented list. The input is the suggestion list, and the output is the product selection data.

[0296] Step 6:

[0297] To display detailed information about a product selected by the user from a suggestion list, the server retrieves the selected product details from a MySQL database and sends them to the terminal. The terminal then displays the detailed information. The input is the product selection data, and the output is the display of the detailed information.

[0298] Step 7:

[0299] The user reviews the details and fills in the required information on a form to proceed with the purchase. The device sends this data to the server. The input is the data entered on the purchase form, and the output is the transmission of the input data to the server.

[0300] Step 8:

[0301] The server validates the received purchase procedure data and completes the purchase if there are no problems. Validation includes a process to check whether the format and content of the input data are correct. The input is the purchase form data, and the output is the completion status of the purchase procedure.

[0302] Step 9:

[0303] The server generates a confirmation email after the purchase process is complete and sends it to the user using the SendGrid API. The input is data indicating the completion of the purchase process, and the output is the sending of the confirmation email.

[0304] Step 10:

[0305] The user receives a confirmation email on their device and confirms that the purchase is complete. The input is the confirmation email, and the output is the user's confirmation.

[0306] Furthermore, an emotion engine for estimating the user's emotions may be combined. That is, the specific processing unit 290 may estimate the user's emotions using the emotion recognition model 59 and perform specific processing using the user's emotions.

[0307] The present invention is a system that supports a user in inputting their own issues, proposing appropriate products and services based on them, and completing the application procedure. Furthermore, the present invention is equipped with a function of combining an emotion engine to recognize the user's emotions and making proposals based on those emotions. Specific embodiments for implementing the present invention will be described below.

[0308] Overall Configuration of the System

[0309] This system is composed of a server, a terminal, and an emotion engine. The terminal is a device for the user to access the system and perform operations, and the server is a central unit that performs data processing and analysis, proposes products and services, and completes the application procedure. The emotion engine is a technology for recognizing the user's emotions and making appropriate product and service proposals based on that information.

[0310] Outline of Program Processing

[0311] 1. Access to the User Interface

[0312] Terminal: The user launches a web browser or a dedicated application and accesses this system.

[0313] Server: Receives the user's access request, dynamically generates and displays an interface for individuals or corporations.

[0314] 2. Input of the User's Troubles

[0315] Terminal: The user inputs their troubles into the text area of the displayed interface and clicks the send button.

[0316] Server: Receives the entered data.

[0317] 3. Emotion recognition by an emotion engine

[0318] Server: Sends the input text or audio data to the emotion engine.

[0319] Emotion Engine: Recognizes user emotions through text and voice analysis.

[0320] Server: Receives emotion analysis results from the emotion engine and performs further analysis based on that data.

[0321] 4. Analysis of problems and proposal of solutions

[0322] Server: Uses natural language processing technology to analyze problems, combines them with emotional data obtained from the emotion engine, and searches for the most suitable product or service candidates.

[0323] Server: Generates a list of products and services and presents it to the user.

[0324] 5. Selecting and displaying details of products and services

[0325] Terminal: The user clicks on a product or service from the presented list to view more details.

[0326] Server: Retrieves detailed information about the selected product from the database and displays it to the user.

[0327] 6. Completion of application procedure

[0328] Terminal: The user enters the required information into a form to view details and submit an application.

[0329] Server: Receives the input data and performs validation.

[0330] Server: If validation is successful, complete the application process.

[0331] 7. Sending a confirmation email

[0332] Server: Confirms that the application process is complete and sends a confirmation email to the user.

[0333] Specific example

[0334] This section explains a scenario where an individual user posts a complaint about slow internet speeds and expresses feelings of frustration and dissatisfaction.

[0335] Access to the interface

[0336] Terminal: User A opens a web browser and accesses this system.

[0337] Server: Receives user access requests and displays a personalized interface.

[0338] Input of problems and emotion recognition

[0339] Terminal: User A types "The internet is slow" and clicks the send button.

[0340] Server: Receives input data and sends it to the emotion engine.

[0341] Emotion Engine: Analyzes the input text and recognizes emotions such as "frustration" and "dissatisfaction."

[0342] Problem analysis and solution proposal

[0343] Server: Analyzes the user's problem and prioritizes suggesting quick solutions based on emotional data.

[0344] Server: Generates and presents suitable product options to user A, such as internet speed improvement services.

[0345] Select and view details of products and services.

[0346] Terminal: User A clicks on "Internet Speed ​​Improvement Plan".

[0347] Server: Retrieves detailed information about the selected product and displays it to the user.

[0348] Completion of application procedure

[0349] Terminal: User A enters required information such as name and address into the application form and clicks the submit button.

[0350] Server: Receives input data, performs validation, and completes the application process.

[0351] Sending a confirmation email

[0352] Server: Confirms that the application has been completed and sends a confirmation email to User A.

[0353] In this way, the system allows users to quickly and efficiently resolve their problems and easily apply for the most suitable products and services based on their emotions by utilizing an emotion engine.

[0354] The following describes the processing flow.

[0355] Step 1:

[0356] Device: The user launches a web browser or a dedicated app to access this system.

[0357] Step 2:

[0358] Server: Receives user access requests, dynamically generates and displays personal or corporate interfaces.

[0359] Step 3:

[0360] Terminal: The interface is displayed, and a text area is provided for the user to enter their problem.

[0361] Step 4:

[0362] Terminal: The user enters their problem into the text area and clicks the send button.

[0363] Step 5:

[0364] Server: Receives user input data and starts text analysis using a natural language processing (NLP) engine.

[0365] Step 6:

[0366] Server: Sends the input text data to the emotion engine.

[0367] Step 7:

[0368] Emotion Engine: Recognizes the user's emotions through text and voice analysis. For example, it can recognize the emotion of "frustration."

[0369] Step 8:

[0370] Server: Receives sentiment analysis results (e.g., "irritation") from the emotion engine.

[0371] Step 9:

[0372] Server: The NLP engine extracts keywords from the input problem and analyzes the sentiment and context. For example, it identifies keywords such as "internet" and "speed improvement."

[0373] Step 10:

[0374] Server: Based on text and sentiment analysis results, it searches the database for suitable product and service candidates and generates a list. If the sentiment is "frustrated," it prioritizes suggesting services that can provide a quick response.

[0375] Step 11:

[0376] Server: Generates a list of products and services in HTML format and sends it to the client terminal.

[0377] Step 12:

[0378] Terminal: The terminal receives a list of suggested products and services from the user and displays it on the screen.

[0379] Step 13:

[0380] Terminal: The user clicks on the product or service they want to view details about.

[0381] Step 14:

[0382] Terminal: Sends a request to display details to the server.

[0383] Step 15:

[0384] Server: Retrieves detailed information about the selected product from the database, formats it in HTML format, and sends it to the client terminal.

[0385] Step 16:

[0386] Terminal: The screen displays detailed information about the product selected by the user.

[0387] Step 17:

[0388] Terminal: The user reviews the details and fills out the required information in the application form.

[0389] Step 18:

[0390] Terminal: The user clicks the complete button and sends the application request to the server.

[0391] Step 19:

[0392] Server: Receives the required information entered and performs validation.

[0393] Step 20:

[0394] Server: If validation is successful, complete the application process within the system.

[0395] Step 21:

[0396] Server: Generates confirmation information for the completion of the application process and sends it to the client terminal.

[0397] Step 22:

[0398] Terminal: The user receives a confirmation message that the application process is complete.

[0399] Step 23:

[0400] Server: After the application process is complete, a confirmation email will be sent to the user's registered email address.

[0401] The above outlines the specific processing steps from when a user enters their problem to when they select the appropriate product or service and complete the application. By utilizing an emotion engine, it is possible to provide optimal suggestions tailored to the user's emotions and improve the user experience.

[0402] (Example 2)

[0403] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0404] Traditional systems simply required users to input their problems and receive suggestions for appropriate products or services, failing to consider the user's emotional state. As a result, user dissatisfaction and stress were not alleviated, and the suggested products and services were not sufficiently effective. Furthermore, the application process was often complex and time-consuming, resulting in low user convenience.

[0405] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0406] In this invention, the server includes means for inputting problem details from a terminal, performing analysis based on the input problem details, and proposing appropriate products and services; means for displaying detailed information selected by the user from the proposed products and services; means for inputting necessary information for the application procedure, confirming the input content, and completing the application procedure; and means for recognizing the user's emotions and proposing products and services based on those emotions. This makes it possible to propose the most suitable products considering the user's emotional state, and further improves the efficiency of the application procedure and enables quick resolution.

[0407] A "terminal" is a device used by a user to access and operate a system.

[0408] "Problem description" refers to the matter or issue that the user wants to solve, which they input into the system.

[0409] "Analysis" is the process of analyzing the input problem content and deriving appropriate products or services.

[0410] "Products and services" refer to specific products or support offered to solve users' problems.

[0411] "Suggestions" refer to the list of products or services presented to the user based on the analysis results.

[0412] "Detailed information" refers to more detailed descriptions and terms and conditions of the proposed product or service.

[0413] "Application process" refers to a series of operations and procedures that a user uses to formally apply for a product or service they have selected.

[0414] "Emotions" refer to the feelings and thoughts that the user is experiencing, and the system recognizes these.

[0415] "Emotion recognition" is the process of analyzing user input data and interpreting the user's emotions from it.

[0416] A "confirmation email" is an email sent to notify the user that the application process has been completed.

[0417] This invention is a system that allows users to input their own needs, receive suggestions for appropriate products and services based on those needs, and support them until they complete the application process. Furthermore, this invention incorporates an emotion engine that recognizes the user's emotions and provides suggestions based on those emotions.

[0418] System components

[0419] This system consists of a server, terminals, and an emotion engine. The terminals are devices that users use to access and operate the system, while the server is the central unit that handles data processing and analysis, product and service recommendations, and application completion. The emotion engine is a technology that recognizes the user's emotions and uses that information to recommend appropriate products and services.

[0420] Program Processing Overview

[0421] Access to the user interface

[0422] Device: Users access this system by launching a web browser or a dedicated app. Specifically, they access it by entering a URL or tapping the app icon.

[0423] Server: The server receives user access requests and dynamically generates and displays personal or corporate interfaces.

[0424] User's problem entry

[0425] Terminal: The user enters their problem into the text area of ​​the displayed interface and clicks the send button. Specifically, they might enter a problem such as "the internet is slow."

[0426] Server: The server receives data entered by the user and passes it to the analysis system.

[0427] Emotion recognition by an emotion engine

[0428] Server: The server sends the input text or audio data to the emotion engine. Specifically, it calls the text analysis API or the audio analysis API.

[0429] Emotion Engine: The emotion engine uses natural language processing technology to recognize the user's emotions. For example, it extracts emotions such as "frustration" or "dissatisfaction."

[0430] Server: The server receives the emotion analysis results obtained from the emotion engine and passes that data back to the analysis system.

[0431] Problem analysis and solution proposal

[0432] Server: The server uses natural language processing techniques to analyze problems and combines them with sentiment data to generate optimal product and service candidates. Specifically, it employs methods such as TF-IDF and Word2Vec.

[0433] Server: The server presents the user with a list of generated products and services. For example, it displays specific suggestions such as "Internet speed improvement plan" or "Wi-Fi router replacement."

[0434] Select and view details of products and services.

[0435] Terminal: The user clicks on the product or service they want to see more details about from the presented list. Specifically, they click on "Internet Speed ​​Improvement Plan".

[0436] Server: The server retrieves detailed information about the selected product from the database and displays it to the user. This information includes pricing, terms of service, and contract details.

[0437] Completion of application procedure

[0438] Terminal: The user reviews the details and fills in the required information on the application form. Specifically, they enter their name, address, contact information, etc., and click the "Apply" button.

[0439] Server: The server receives the input data and performs validation. For example, it checks if the format of the email address is correct.

[0440] Server: If validation is successful, save the application information to the database and send a notification to the relevant department.

[0441] Sending a confirmation email

[0442] Server: The server confirms that the application process is complete and calls the email sending API to send a confirmation email.

[0443] Specific example

[0444] The following is a specific example. It describes a case where an individual user enters a complaint about slow internet speeds and expresses feelings of frustration and dissatisfaction.

[0445] Access to the interface

[0446] Terminal: User A opens a web browser and accesses this system.

[0447] Server: The server receives user access requests and displays a personalized interface.

[0448] Input of problems and emotion recognition

[0449] Terminal: User A types "The internet is slow" and clicks the send button.

[0450] Server: The server receives input data and sends it to the emotion engine.

[0451] Emotion Engine: The emotion engine analyzes the input text and recognizes emotions such as "frustration" and "dissatisfaction."

[0452] Problem analysis and solution proposal

[0453] Server: The server analyzes the problem and prioritizes suggesting quick solutions that the user needs, based on sentiment data.

[0454] Server: Generates and presents suitable product options to user A, such as internet speed improvement services.

[0455] Select and view details of products and services.

[0456] Terminal: User A clicks on "Internet Speed ​​Improvement Plan".

[0457] Server: The server retrieves detailed information about the selected product and displays it to the user.

[0458] Completion of application procedure

[0459] Terminal: User A enters required information such as name and address into the application form and clicks the submit button.

[0460] Server: The server receives the input data, performs validation, and completes the application process.

[0461] Sending a confirmation email

[0462] Server: The server confirms that the application has been completed and sends a confirmation email to User A.

[0463] Example of a prompt

[0464] "My internet has been slow lately, and I want to increase the speed. What plans are available? It's really frustrating."

[0465] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0466] Step 1: Accessing the user interface

[0467] Device: The user launches a web browser or a dedicated app to access the system.

[0468] Input: Enter a URL or tap the app icon.

[0469] Action: The user accesses https: / / example.com in a browser or taps the app icon.

[0470] Output: An access request is sent to the server.

[0471] Server: The server dynamically generates and displays either a personal or corporate interface in response to user access requests.

[0472] Input: Access request.

[0473] Operation: The server generates a personalized interface and responds in HTML format.

[0474] Output: A personalized dashboard and consultation form are displayed on the device.

[0475] Step 2: User input of problem details

[0476] Terminal: The user enters their problem into the text area of ​​the displayed interface and clicks the send button.

[0477] Input: Enter text such as "The internet is slow."

[0478] Operation: The user enters their problem and clicks the submit button.

[0479] Output: Input data is sent to the server in JSON format.

[0480] Server: The server receives data entered by the user and passes it to the analysis system.

[0481] Input: Input data in JSON format.

[0482] Operation: Prepares the input data for transfer to the analysis system.

[0483] Output: The data is passed to the analysis system.

[0484] Step 3: Emotion recognition by the emotion engine

[0485] Server: The server sends the input text or audio data to the emotion engine.

[0486] Input: User's text input data.

[0487] Operation: Calls text analysis APIs and speech analysis APIs.

[0488] Output: Input data is sent to the emotion engine.

[0489] Emotion Engine: The emotion engine uses natural language processing technology to recognize the user's emotions.

[0490] Input: Text or audio data.

[0491] Operation: Executes an emotion recognition algorithm to detect "irritation" and "dissatisfaction."

[0492] Output: Sentiment analysis results are generated.

[0493] Server: The server receives the emotion analysis results obtained from the emotion engine and passes that data back to the analysis system.

[0494] Input: Sentiment analysis results.

[0495] Operation: Searches for relevant suggestions in an SQL database based on sentiment data.

[0496] Output: Emotional data is passed to the analysis system.

[0497] Step 4: Problem analysis and solution proposal

[0498] Server: The server uses natural language processing technology to analyze problems and combines them with sentiment data to generate optimal product and service candidates.

[0499] Input: Text input data and sentiment analysis results.

[0500] Operation: Analyzes text using methods such as TF-IDF and Word2Vec.

[0501] Output: A list of optimal product and service candidates is generated.

[0502] Server: The server presents the user with a list of generated products and services.

[0503] Input: A list of potential products or services.

[0504] Operation: Displays the list as an HTML page.

[0505] Output: A list of claimed goods and services is displayed on the terminal.

[0506] Step 5: Select and view details of products and services.

[0507] Terminal: The user clicks on a product or service from the presented list to view more details.

[0508] Input: Selection of specific products or services.

[0509] Action: The user clicks on "Internet Speed ​​Improvement Plan".

[0510] Output: The selection information is sent to the server.

[0511] Server: The server retrieves detailed information about the selected product from the database and displays it to the user.

[0512] Input: The ID of the selected product or service.

[0513] Operation: Retrieves detailed information from the database and returns it to the terminal in HTML format.

[0514] Output: Detailed information (e.g., price, terms and conditions, contract method) will be displayed on the device.

[0515] Step 6: Completion of the application process

[0516] Terminal: Users review detailed information and fill out the required fields in the application form.

[0517] Input: Application information such as name, address, and contact information.

[0518] Action: The user clicks the "Apply" button.

[0519] Output: Application information is sent to the server.

[0520] Server: The server receives the input data and performs validation.

[0521] Input: User application data.

[0522] Function: Data format check and validation.

[0523] Output: Validation success or failure result.

[0524] Server: If validation is successful, save the application information to the database and send a notification to the relevant department.

[0525] Input: Validated application data.

[0526] Operation: Saves to the database and sends a notification.

[0527] Output: Application process complete.

[0528] Step 7: Sending a confirmation email

[0529] Server: The server confirms that the application process is complete and calls the email sending API to send a confirmation email.

[0530] Input: Application completion information and user's email address.

[0531] Operation: Sends a confirmation email using an email sending API (e.g., SendGrid or Amazon SES).

[0532] Output: The user receives a confirmation email.

[0533] (Application Example 2)

[0534] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0535] Traditional food delivery systems have struggled to offer products and services that address users' emotions and specific needs. Furthermore, there is a growing demand for services that provide higher satisfaction by offering suggestions based on user emotions. Therefore, it is necessary to develop a system that analyzes user input and then makes appropriate suggestions that take user emotions into account.

[0536] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0537] In this invention, the server includes means for inputting problem details from a terminal, performing analysis based on the input problem details, and suggesting appropriate products or services; means for recognizing the user's emotions and suggesting products or services based on those emotions; means for displaying detailed information of the products or services selected by the user from the suggested products or services; means for inputting necessary information for the application procedure, confirming the input, and completing the application procedure; and means for suggesting specific meal options. This makes it possible to suggest products and services based on the user's emotions.

[0538] A "terminal" is a device used by a user for input and operation, and includes smartphones, tablets, and computers.

[0539] "Problem description" refers to the issues or problems that the user wants to solve, and is provided in the form of text or audio data.

[0540] "Analysis" is the process of analyzing the input problem content and then proposing appropriate products or services based on that analysis.

[0541] "Proposing products and services" means presenting the most suitable products or services to the user based on the analysis results.

[0542] "Emotion recognition" refers to the process of understanding and analyzing a user's emotions from the text or audio they input.

[0543] "Detailed information" refers to information about the specific content and characteristics of the proposed product or service.

[0544] The "application process" is the process by which a user enters the necessary information to formally request the provision of the selected product or service, and then verifies that information.

[0545] "Required information" refers to the user's information and data that is requested to complete the application process.

[0546] "Verification" is the process of checking whether the entered data is accurate and confirming that there are no errors.

[0547] "Dining options" refer to specific dishes and food choices offered to the user, and are selected from a variety of menus and restaurants.

[0548] "System" refers to a configuration that includes a set of processes and functions designed to work together to solve user problems.

[0549] A system for carrying out this invention consists of a terminal, a server, and an emotion engine.

[0550] Overall system configuration

[0551] 1. Terminal: A device used by a user for input and operation, including smartphones, tablets, and computers.

[0552] 2. Server: This is the central part of the system that handles data processing and analysis, product and service proposals, and application procedures.

[0553] 3. Emotion Engine: This is a technology that recognizes the user's emotions and uses that information to suggest appropriate products and services.

[0554] Program Processing Overview

[0555] 1. Access to the user interface

[0556] Users access this system by launching a web browser or dedicated app using their smartphone or other device. The server receives the user's access request and displays a dynamically generated interface.

[0557] 2. User input of problems / issues

[0558] The user enters their problem into the text area of ​​the displayed interface and clicks the submit button. The server receives this input data.

[0559] 3. Emotion recognition by an emotion engine

[0560] The server sends the received text or audio data to the emotion engine. The emotion engine recognizes the user's emotions through text or audio analysis. The server receives the emotion analysis results from the emotion engine and continues the analysis.

[0561] 4. Analysis of problems and proposal of solutions

[0562] The server uses natural language processing technology to analyze the user's problems, combines this with emotional data obtained from the emotion engine, and generates and presents optimal product and service candidates to the user.

[0563] 5. Selecting and displaying details of products and services

[0564] The user clicks on a product or service from the presented list to see more details. The server retrieves the details of the selected product from the database and displays them to the user.

[0565] 6. Completion of application procedure

[0566] The user reviews the details and fills in the required information on the application form. The server receives the input data, validates it, and completes the application process.

[0567] Example of initial setup

[0568] This document provides specific examples of how to use the emotion-responsive food delivery app of this invention.

[0569] Specific example

[0570] For example, if a user enters "I'm really tired today," the following process will occur.

[0571] 1. Emotion engine analysis result: The server receives emotion data indicating "fatigue".

[0572] 2. Examples of proposed products:

[0573] Dishes using ingredients that have fatigue-relieving effects (e.g., grilled salmon, spinach and cheese lasagna, relaxing tea, etc.)

[0574] Popular healthy delivery menu items (e.g., salads, soups)

[0575] Technology used

[0576] 1. Hardware: Smartphones, servers

[0577] 2. Software: Flask (a Python web framework), natural language processing libraries (such as NLTK and spaCy), sentiment analysis models (BERT-based sentiment analysis models)

[0578] Example of a prompt

[0579] The user is feeling very tired, so please suggest some relaxing meal options. For example, display options such as grilled salmon, spinach and cheese lasagna, and relaxing tea.

[0580] In this way, it becomes possible to create a system that understands users' emotions and provides products and services that match them.

[0581] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0582] Step 1:

[0583] The terminal receives user input. The user enters their problems or issues into the terminal in text or voice. This input becomes the system's initial data. Examples of input data include "The internet is slow" or "I'm really tired today."

[0584] Step 2:

[0585] The server receives input data from the terminal. The input data is received as text or audio data. The server converts this data into an appropriate format for transmission to the emotion engine. Here, the input is the user's text or audio data, and the output is the converted result of that data.

[0586] Step 3:

[0587] The emotion engine analyzes the input data sent from the server. The emotion engine uses natural language processing techniques to recognize the user's emotions. Specifically, it performs emotion analysis using the BERT model. The input is text or audio data, and the output is user emotion data (e.g., "tired" or "frustrated").

[0588] Step 4:

[0589] The server receives emotion data obtained from the emotion engine. Based on this emotion data, it analyzes the user's problems and suggests appropriate products and services. Specifically, it uses natural language processing techniques to analyze problems and combines them with emotion data to generate optimal service candidates. The input is emotion data and problem data, and the output is a list of suggested products and services.

[0590] Step 5:

[0591] The terminal displays a list of suggested products and services to the user. The user clicks on a product or service from this list to view more information. The input is the list of suggested products, and the output is the detailed information of the product selected by the user.

[0592] Step 6:

[0593] The server retrieves detailed information about the product selected by the user from the database and sends it to the terminal. The specific operation involves database searching and information retrieval. The input is the user's selection information, and the output is the product details.

[0594] Step 7:

[0595] The terminal displays the detailed information to the user. The user enters the required information into the application form and clicks the submit button. The input consists of detailed information and application form data, and the output is a confirmation screen of the user's input.

[0596] Step 8:

[0597] The server receives the application data and performs validation. If validation is successful, the application process is completed and a confirmation email is sent. The specific actions are checking the integrity of the input data and sending the email. The input is the application data, and the output is the sending of the confirmation email.

[0598] This enables a series of operations, from suggesting products and services based on the user's emotions to completing the application process.

[0599] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0600] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0601] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0602] [Second Embodiment]

[0603] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0604] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0605] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0606] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0607] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0608] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0609] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0610] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0611] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0612] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0613] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0614] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0615] This invention is a system that allows users to input their own needs, receive suggestions for appropriate products and services based on those needs, and support them until they complete the application process. Specific embodiments for implementing this invention are described below.

[0616] Overall system configuration

[0617] This system consists of a server, terminals, and users. Terminals are devices that users use to access and operate the system, while the server is the central unit that handles data processing and analysis, product and service recommendations, and application procedures.

[0618] Program Processing Overview

[0619] 1. Access to the user interface

[0620] Device: The user launches a web browser or a dedicated app to access this system.

[0621] Server: Receives user access requests, dynamically generates and displays personal or corporate interfaces.

[0622] 2. User input of problems / issues

[0623] Terminal: The user enters their problem into the text area of ​​the displayed interface and clicks the send button.

[0624] Server: Receives the input data and starts the analysis.

[0625] 3. Analysis of problems and proposal of solutions

[0626] Server: Analyzes input problems using natural language processing techniques. For example, it extracts keywords using text mining techniques and understands their meaning.

[0627] Server: Based on the analysis results, it searches the database for suitable product and service candidates and generates a list.

[0628] Server: Present this list to the user and prompt them to make a selection.

[0629] 4. Select and view details of products and services.

[0630] Terminal: The user clicks on a product or service from the presented list to view more details.

[0631] Server: Retrieves detailed information about the selected product from the database and displays it to the user.

[0632] 5. Completion of application procedure

[0633] Terminal: The user enters the required information into a form to view details and submit an application.

[0634] Server: Receives the input data and performs validation.

[0635] Server: If validation is successful, complete the application process.

[0636] 6. Sending a confirmation email

[0637] Server: Confirms that the application process is complete and sends a confirmation email to the user.

[0638] Specific example

[0639] This explains what happens when an individual user enters a problem, such as "the internet is slow."

[0640] Access to the interface

[0641] Terminal: User A opens a web browser and accesses this system.

[0642] Server: Receives user access requests and displays a personalized interface.

[0643] Enter your problem

[0644] Terminal: User A types "The internet is slow" and clicks the send button.

[0645] Server: Receives input data and begins analysis.

[0646] Problem analysis and solution proposal

[0647] Server: The phrase "the internet is slow" is analyzed using a natural language processing engine, and related keywords (e.g., speed improvement, plan change) are extracted.

[0648] Server: Based on the analysis results, it generates a list of suitable product candidates, such as internet plan speed improvement services, and presents them to User A.

[0649] Select and view details of products and services.

[0650] Terminal: User A clicks on "Internet Speed ​​Improvement Plan".

[0651] Server: Retrieves detailed information about the selected product and displays it to the user.

[0652] Completion of application procedure

[0653] Terminal: User A enters required information such as name and address into the application form and clicks the submit button.

[0654] Server: Receives input data, performs validation, and completes the application process.

[0655] Sending a confirmation email

[0656] Server: Confirms that the application has been completed and sends a confirmation email to User A.

[0657] In this way, the system allows users to quickly and efficiently resolve their problems and easily apply for the most suitable products and services.

[0658] The following describes the processing flow.

[0659] Step 1:

[0660] Device: The user launches a web browser or a dedicated app to access this system.

[0661] Step 2:

[0662] Server: Receives user access requests, dynamically generates and displays personal or corporate interfaces.

[0663] Step 3:

[0664] Terminal: The interface is displayed, and a text area is provided for the user to enter their problem.

[0665] Step 4:

[0666] Terminal: The user enters their problem into the text area and clicks the send button.

[0667] Step 5:

[0668] Server: Receives user input data and starts text analysis using a natural language processing (NLP) engine.

[0669] Step 6:

[0670] Server: The NLP engine extracts keywords related to the input problem and analyzes the sentiment and context.

[0671] Step 7:

[0672] Server: Based on the analysis results, it searches the database for suitable product and service candidates and generates a list.

[0673] Step 8:

[0674] Server: Generates a list of products and services in HTML format and sends it to the client terminal.

[0675] Step 9:

[0676] Terminal: The terminal receives a list of suggested products and services from the user and displays it on the screen.

[0677] Step 10:

[0678] Terminal: The user clicks on the product or service they want to view details about.

[0679] Step 11:

[0680] Terminal: Sends a request to display details to the server.

[0681] Step 12:

[0682] Server: Retrieves detailed information about the selected product from the database, formats it in HTML format, and sends it to the client terminal.

[0683] Step 13:

[0684] Terminal: The screen displays detailed information about the product selected by the user.

[0685] Step 14:

[0686] Terminal: The user reviews the details and fills out the required information in the application form.

[0687] Step 15:

[0688] Terminal: The user clicks the complete button and sends the application request to the server.

[0689] Step 16:

[0690] Server: Receives the required information entered and performs validation.

[0691] Step 17:

[0692] Server: If validation is successful, complete the application process within the system.

[0693] Step 18:

[0694] Server: Generates confirmation information for the completion of the application process and sends it to the client terminal.

[0695] Step 19:

[0696] Terminal: The user receives a confirmation message that the application process is complete.

[0697] Step 20:

[0698] Server: After the application process is complete, a confirmation email will be sent to the user's registered email address.

[0699] The above outlines the specific processing steps from when a user enters their problem to when they select the appropriate product or service and complete the application.

[0700] (Example 1)

[0701] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0702] Traditionally, there have been few systems that appropriately analyze users' problems and propose effective products and services based on that analysis. Furthermore, there has been a lack of systems that display detailed information about the proposed products and services and smoothly guide users through the application process. As a result, it has been difficult for users to quickly and efficiently resolve their problems. This invention aims to provide a system that analyzes the problem content entered by the user using natural language processing technology, proposes appropriate products and services based on the analysis results, and allows users to easily complete the application process.

[0703] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0704] In this invention, the server includes means for receiving problem details from a terminal, performing analysis based on the entered problem details, and suggesting appropriate products and services; means for displaying detailed information selected by the user from the suggested products and services; means for receiving necessary information for the application procedure, confirming the entered information, and completing the application procedure; means for sending a confirmation email to the user when the application procedure is completed; and means for analyzing the entered problem details using natural language processing technology, generating a list of suggestions from a service database based on the analysis results, and presenting it to the user. This enables users to solve their problems quickly and efficiently and easily apply for appropriate products and services.

[0705] A "terminal" refers to a device such as a computer, smartphone, or tablet that a user uses for input and operation.

[0706] "Problem description" refers to the text information about the challenges or problems that the user enters into the input field.

[0707] "Analysis" is the process by which a server understands the received problem content using natural language processing technology and extracts relevant keywords and meanings.

[0708] "Product and service suggestions" refers to selecting and displaying a list of products and services that provide appropriate solutions to the user based on the analyzed problem.

[0709] "Detailed information" refers to additional information, features, and specifications that help users gain a deeper understanding of the proposed product or service.

[0710] The "application process" is the process by which a user enters the information necessary to actually use the selected product or service and formally completes the application.

[0711] A "confirmation email" is a notification email sent to a user upon completion of the application process.

[0712] "Natural language processing technology" refers to techniques that enable computers to understand, analyze, and generate human language, and includes methods such as text mining and keyword extraction.

[0713] A "service database" is a database containing information about products and services that the server accesses in order to generate a list of suggestions.

[0714] A "suggestion list" is a list of appropriate products and services that the server generates and presents to the user based on the analysis results.

[0715] This invention is a system that allows users to input their own needs, receive suggestions for appropriate products and services based on those needs, and support them until they complete the application process. Specific embodiments for implementing this invention are described below.

[0716] Overall system configuration

[0717] This system consists of a server, terminals, and users. Terminals are devices that users use to access and operate the system, while the server is the central unit that handles data processing and analysis, product and service proposals, and application procedures.

[0718] Program Processing Overview

[0719] Access to the user interface

[0720] Device: The user launches a web browser or a dedicated app to access this system.

[0721] Server: Receives user access requests, dynamically generates and displays personal or corporate interfaces.

[0722] User's problem entry

[0723] Terminal: The user enters their problem into the text area of ​​the displayed interface and clicks the send button.

[0724] Server: Receives the input data and starts the analysis.

[0725] Problem analysis and solution proposal

[0726] Server: Analyzes input problems using natural language processing techniques. For example, it extracts keywords using text mining techniques and understands their meaning.

[0727] Server: Based on the analysis results, it searches the database for suitable product and service candidates and generates a list.

[0728] Server: Present this list to the user and prompt them to make a selection.

[0729] Select and view details of products and services.

[0730] Terminal: The user clicks on a product or service from the presented list to view more details.

[0731] Server: Retrieves detailed information about the selected product from the database and displays it to the user.

[0732] Completion of application procedure

[0733] Terminal: The user enters the required information into a form to view details and submit an application.

[0734] Server: Receives the input data and performs validation.

[0735] Server: If validation is successful, complete the application process.

[0736] Sending a confirmation email

[0737] Server: Confirms that the application process is complete and sends a confirmation email to the user.

[0738] Hardware or software to use

[0739] This system uses the following specific hardware and software:

[0740] Server: Web server (e.g., Apache HTTP Server)

[0741] Devices: Computers, smartphones, tablets

[0742] Software: Natural language processing engines (e.g., Apache OpenNLP), database management systems (e.g., MySQL)

[0743] Specific example

[0744] This explains what happens when an individual user enters a problem, such as "the internet is slow."

[0745] Access to the interface

[0746] Terminal: User A opens a web browser and accesses this system.

[0747] Server: Receives user access requests and displays a personalized interface.

[0748] Enter your problem

[0749] Terminal: User A types "The internet is slow" and clicks the send button.

[0750] Server: Receives input data and begins analysis.

[0751] Problem analysis and solution proposal

[0752] Server: The phrase "the internet is slow" is analyzed using a natural language processing engine, and related keywords (e.g., speed improvement, plan change) are extracted.

[0753] Server: Based on the analysis results, it generates a list of suitable product candidates, such as internet plan speed improvement services, and presents them to User A.

[0754] Select and view details of products and services.

[0755] Terminal: User A clicks on "Internet Speed ​​Improvement Plan".

[0756] Server: Retrieves detailed information about the selected product and displays it to the user.

[0757] Completion of application procedure

[0758] Terminal: User A enters required information such as name and address into the application form and clicks the submit button.

[0759] Server: Receives input data, performs validation, and completes the application process.

[0760] Sending a confirmation email

[0761] Server: Confirms that the application has been completed and sends a confirmation email to User A.

[0762] This system is designed to provide users with quick and accurate solutions by combining natural language processing technology with database search. For example, by entering a prompt such as "Suggest services to improve internet speed when it's slow" into the generative AI model, an appropriate solution can be obtained.

[0763] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0764] Step 1: Accessing the user interface

[0765] User: Open a web browser and enter the URL of this system to access it.

[0766] Input: System URL

[0767] Output: Access Request

[0768] Server: Receives access requests and identifies whether the user is an individual or a legal entity.

[0769] Input: Access Request

[0770] Output: User type (individual or corporate)

[0771] Server: Dynamically generates the appropriate interface based on the user type, sends it to the terminal, and displays it.

[0772] Input: User Type

[0773] Output: Generated interface

[0774] Step 2: User input of problem details

[0775] Terminal: The user enters their problem in the text area of ​​the displayed interface and clicks the send button.

[0776] Input: Text of the problem

[0777] Output: Send Request

[0778] Server: Receives a transmission request and prepares the input data for analysis.

[0779] Input: Sending Request

[0780] Output: Data ready for analysis

[0781] Step 3: Problem analysis and solution proposal

[0782] Server: Starts the natural language processing engine and analyzes the problem text. For example, it extracts relevant keywords from the phrase "the internet is slow."

[0783] Input: Text of the problem

[0784] Data processing: Keyword extraction and semantic analysis using a natural language processing engine.

[0785] Output: Analysis results (keywords, etc.)

[0786] Server: Based on the analysis results, it searches the service database for appropriate products and services and generates a list of suggestions.

[0787] Input: Analysis results

[0788] Data processing: Database search

[0789] Output: Proposal List

[0790] Server: Presents a list of suggestions to the user.

[0791] Input: Proposal list

[0792] Output: Display of the suggestion list

[0793] Step 4: Select and view details of products and services.

[0794] User: Select and click on products or services of interest from the suggested list.

[0795] Input: Selected product or service

[0796] Output: Click Event

[0797] Server: Receives click events and retrieves detailed information about the corresponding product from the database.

[0798] Input: Click Event

[0799] Data processing: Information retrieval from databases

[0800] Output: Detailed information

[0801] Server: Displays detailed information to the user.

[0802] Input: Detailed information

[0803] Output: Detailed information display

[0804] Step 5: Completion of the application process

[0805] User: Review the details, fill in the required information (such as name and address) on the application form, and click the apply button.

[0806] Input: Application information (name, address, etc.)

[0807] Output: Application Request

[0808] Server: Receives application requests and validates the input data.

[0809] Input: Application Request

[0810] Data processing: validation

[0811] Output: Validation results

[0812] Server: If validation is successful, complete the application process.

[0813] Input: Validation result

[0814] Output: Application completion notification

[0815] Step 6: Sending a confirmation email

[0816] Server: Confirms that the application process is complete and sends a confirmation email to the user.

[0817] Input: Application completion notification

[0818] Output: Confirmation email sent

[0819] (Application Example 1)

[0820] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0821] Modern consumers want to quickly find products and services that meet their needs and concerns, and complete the purchase process easily and efficiently. However, currently, finding the right products and services often takes a lot of time and involves complicated procedures. This is especially true for online shopping, where selecting the right product from countless options is difficult and contributes to a poor user experience.

[0822] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0823] In this invention, the server includes means for receiving problem details from a terminal, performing analysis based on the entered problem details, and suggesting appropriate products and services; means for analyzing the input content using a natural language processing engine, generating a list of suggested products and presenting it to the user; and means for receiving necessary information for the application procedure, confirming the input content, and completing the application procedure. As a result, the user can receive prompt and appropriate suggestions for products and services that address their needs and problems, and complete the purchase procedure easily.

[0824] A "terminal" is a device used by a user to access and operate a system.

[0825] "Problem description" refers to text data in which the user enters their own worries or issues they want to solve.

[0826] "Performing analysis" refers to the process of understanding the input problem content using natural language processing technology and extracting relevant keywords.

[0827] "Means of proposing products and services" refers to a system function that searches a database for and presents suitable product and service candidates based on analyzed keywords.

[0828] A "suggestion list" is a list of products and services selected based on the user's input.

[0829] The "application process" is the process of entering and confirming the information necessary to complete the purchase of the selected product or service.

[0830] A "natural language processing engine" is a system component that analyzes user input and extracts meaning and keywords.

[0831] A "database" is an information aggregation system that stores information about the products and services being proposed.

[0832] A "confirmation email" is an email sent to a user to notify them that they have completed the application process.

[0833] An "application interface" is software that provides an interface for users to access and operate a system.

[0834] This invention is implemented as a "shopping assistant app" that users can use on their smartphones. By using this app, users can resolve their problems and concerns about products they want to buy, receive appropriate suggestions, and efficiently complete the purchase process.

[0835] Hardware and software to be used

[0836] Hardware: Smartphone (iOS or Android device)

[0837] software:

[0838] Smartphone app

[0839] Frontend: React Native, Flutter

[0840] Backend: Node.js, Django

[0841] Natural Language Processing Engine: Google Cloud Natural Language API

[0842] Database: MySQL

[0843] Email sending service: SendGrid API

[0844] Process Overview

[0845] 1. Access to the interface

[0846] When a user launches the smartphone app from their device, the server receives an access request and dynamically generates and displays an interface. This interface provides a text area where the user can enter their needs and concerns.

[0847] 2. Input and reception of problem details

[0848] When a user enters specific information about their problem or the product they want to buy into the interface's text area and presses the submit button, the device sends that data to the server. The server receives this data and begins preparing to pass it on to the natural language processing engine.

[0849] 3. Analysis using natural language processing

[0850] The server sends input data to a natural language processing engine, such as the Google Cloud Natural Language API, for analysis. The engine extracts keywords from the text and performs a process to understand their meaning.

[0851] 4. Generate a list of suggested products

[0852] The server searches the MySQL database for relevant products and services based on the analysis results obtained through natural language processing and generates a list of suggestions. By presenting this list to the user, the system enables the user to quickly find products and services that meet their needs.

[0853] 5. Displaying and selecting product details

[0854] When a user selects a specific product or service from the suggested list, the server retrieves its details from a MySQL database and displays them on the terminal. This allows the user to review the product details and consider purchasing it.

[0855] 6. Completion of the purchase procedure

[0856] When a user enters the required information into the purchase form and clicks the purchase button, the server receives the data and performs validation. If validation is successful, the server completes the purchase process.

[0857] 7. Sending a confirmation email

[0858] Once the application process is complete, the server uses an email sending service such as the SendGrid API to send a confirmation email to the user. This allows the user to confirm their purchase details.

[0859] Specific example

[0860] For example, if a user enters "I want to buy a refrigerator, but I'm not sure which one to get," the Google Cloud Natural Language API extracts keywords such as "refrigerator," "purchase," and "undecided." Based on these keywords, the server generates a list of suitable refrigerator suggestions and presents them to the user. The user can then view detailed information from the list and easily complete the purchase process from their smartphone.

[0861] Example of a prompt

[0862] An example of a text-based prompt is shown below:

[0863] "Input text describing a user's situation—that they are considering buying a refrigerator but are unsure which one to choose (e.g., 'I want to buy a refrigerator, but I'm not sure which one to get.')—provide the necessary analytical steps to design an application algorithm that extracts keywords using natural language processing and suggests appropriate products."

[0864] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0865] Step 1:

[0866] A user launches a smartphone app. An access request is sent from the device to the server. The server receives the access request, dynamically generates a user interface, and displays it on the device. The input is the user's access request, and the output is the displayed user interface.

[0867] Step 2:

[0868] The user enters specific information about their problem or the product they want to purchase into the interface's text area and presses the submit button. The terminal then sends this input data to the server. The input is the user's text data, and the output is the transmission of text data to the server.

[0869] Step 3:

[0870] The server sends the received text data to the Google Cloud Natural Language API for analysis. The analysis involves extracting keywords from the text and understanding their meaning. The input is the user's text data, and the output is the analyzed keyword data.

[0871] Step 4:

[0872] The server searches a MySQL database based on the extracted keywords and generates a list of suggested products and services. This list is structured to include products and services that meet the user's needs. The input is keyword data, and the output is a list of suggested products.

[0873] Step 5:

[0874] The server sends the generated suggestion list to the terminal and presents it to the user. The user selects a specific product or service from the presented list. The input is the suggestion list, and the output is the product selection data.

[0875] Step 6:

[0876] To display detailed information about a product selected by the user from a suggestion list, the server retrieves the selected product details from a MySQL database and sends them to the terminal. The terminal then displays the detailed information. The input is the product selection data, and the output is the display of the detailed information.

[0877] Step 7:

[0878] The user reviews the details and fills in the required information on a form to proceed with the purchase. The device sends this data to the server. The input is the data entered on the purchase form, and the output is the transmission of the input data to the server.

[0879] Step 8:

[0880] The server validates the received purchase procedure data and completes the purchase if there are no problems. Validation includes a process to check whether the format and content of the input data are correct. The input is the purchase form data, and the output is the completion status of the purchase procedure.

[0881] Step 9:

[0882] The server generates a confirmation email after the purchase process is complete and sends it to the user using the SendGrid API. The input is data indicating the completion of the purchase process, and the output is the sending of the confirmation email.

[0883] Step 10:

[0884] The user receives a confirmation email on their device and confirms that the purchase is complete. The input is the confirmation email, and the output is the user's confirmation.

[0885] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0886] This invention is a system that allows users to input their own needs, receive suggestions for appropriate products and services based on those needs, and support them until they complete the application process. Furthermore, this invention incorporates an emotion engine that recognizes the user's emotions and provides suggestions based on those emotions. The following describes specific embodiments for carrying out this invention.

[0887] Overall system configuration

[0888] This system consists of a server, terminals, and an emotion engine. The terminals are devices that users use to access and operate the system, while the server is the central unit that handles data processing and analysis, product and service recommendations, and application completion. The emotion engine is a technology that recognizes user emotions and uses that information to recommend appropriate products and services.

[0889] Program Processing Overview

[0890] 1. Access to the user interface

[0891] Device: The user launches a web browser or a dedicated app to access this system.

[0892] Server: Receives user access requests, dynamically generates and displays personal or corporate interfaces.

[0893] 2. User input of problems / issues

[0894] Terminal: The user enters their problem into the text area of ​​the displayed interface and clicks the send button.

[0895] Server: Receives the entered data.

[0896] 3. Emotion recognition by an emotion engine

[0897] Server: Sends the input text or audio data to the emotion engine.

[0898] Emotion Engine: Recognizes user emotions through text and voice analysis.

[0899] Server: Receives emotion analysis results from the emotion engine and performs further analysis based on that data.

[0900] 4. Analysis of problems and proposal of solutions

[0901] Server: Uses natural language processing technology to analyze problems, combines them with emotional data obtained from the emotion engine, and searches for the most suitable product or service candidates.

[0902] Server: Generates a list of products and services and presents it to the user.

[0903] 5. Selecting and displaying details of products and services

[0904] Terminal: The user clicks on a product or service from the presented list to view more details.

[0905] Server: Retrieves detailed information about the selected product from the database and displays it to the user.

[0906] 6. Completion of application procedure

[0907] Terminal: The user enters the required information into a form to view details and submit an application.

[0908] Server: Receives the input data and performs validation.

[0909] Server: If validation is successful, complete the application process.

[0910] 7. Sending a confirmation email

[0911] Server: Confirms that the application process is complete and sends a confirmation email to the user.

[0912] Specific example

[0913] This section explains a scenario where an individual user posts a complaint about slow internet speeds and expresses feelings of frustration and dissatisfaction.

[0914] Access to the interface

[0915] Terminal: User A opens a web browser and accesses this system.

[0916] Server: Receives user access requests and displays a personalized interface.

[0917] Input of problems and emotion recognition

[0918] Terminal: User A types "The internet is slow" and clicks the send button.

[0919] Server: Receives input data and sends it to the emotion engine.

[0920] Emotion Engine: Analyzes the input text and recognizes emotions such as "frustration" and "dissatisfaction."

[0921] Problem analysis and solution proposal

[0922] Server: Analyzes the user's problem and prioritizes suggesting quick solutions based on emotional data.

[0923] Server: Generates and presents suitable product options to user A, such as internet speed improvement services.

[0924] Select and view details of products and services.

[0925] Terminal: User A clicks on "Internet Speed ​​Improvement Plan".

[0926] Server: Retrieves detailed information about the selected product and displays it to the user.

[0927] Completion of application procedure

[0928] Terminal: User A enters required information such as name and address into the application form and clicks the submit button.

[0929] Server: Receives input data, performs validation, and completes the application process.

[0930] Sending a confirmation email

[0931] Server: Confirms that the application has been completed and sends a confirmation email to User A.

[0932] In this way, the system allows users to quickly and efficiently resolve their problems and easily apply for the most suitable products and services based on their emotions by utilizing an emotion engine.

[0933] The following describes the processing flow.

[0934] Step 1:

[0935] Device: The user launches a web browser or a dedicated app to access this system.

[0936] Step 2:

[0937] Server: Receives user access requests, dynamically generates and displays personal or corporate interfaces.

[0938] Step 3:

[0939] Terminal: The interface is displayed, and a text area is provided for the user to enter their problem.

[0940] Step 4:

[0941] Terminal: The user enters their problem into the text area and clicks the send button.

[0942] Step 5:

[0943] Server: Receives user input data and starts text analysis using a natural language processing (NLP) engine.

[0944] Step 6:

[0945] Server: Sends the input text data to the emotion engine.

[0946] Step 7:

[0947] Emotion Engine: Recognizes the user's emotions through text and voice analysis. For example, it can recognize the emotion of "frustration."

[0948] Step 8:

[0949] Server: Receives sentiment analysis results (e.g., "irritation") from the emotion engine.

[0950] Step 9:

[0951] Server: The NLP engine extracts keywords from the input problem and analyzes the sentiment and context. For example, it identifies keywords such as "internet" and "speed improvement."

[0952] Step 10:

[0953] Server: Based on text and sentiment analysis results, it searches the database for suitable product and service candidates and generates a list. If the sentiment is "frustrated," it prioritizes suggesting services that can provide a quick response.

[0954] Step 11:

[0955] Server: Generates a list of products and services in HTML format and sends it to the client terminal.

[0956] Step 12:

[0957] Terminal: The terminal receives a list of suggested products and services from the user and displays it on the screen.

[0958] Step 13:

[0959] Terminal: The user clicks on the product or service they want to view details about.

[0960] Step 14:

[0961] Terminal: Sends a request to display details to the server.

[0962] Step 15:

[0963] Server: Retrieves detailed information about the selected product from the database, formats it in HTML format, and sends it to the client terminal.

[0964] Step 16:

[0965] Terminal: The screen displays detailed information about the product selected by the user.

[0966] Step 17:

[0967] Terminal: The user reviews the details and fills out the required information in the application form.

[0968] Step 18:

[0969] Terminal: The user clicks the complete button and sends the application request to the server.

[0970] Step 19:

[0971] Server: Receives the required information entered and performs validation.

[0972] Step 20:

[0973] Server: If validation is successful, complete the application process within the system.

[0974] Step 21:

[0975] Server: Generates confirmation information for the completion of the application process and sends it to the client terminal.

[0976] Step 22:

[0977] Terminal: The user receives a confirmation message that the application process is complete.

[0978] Step 23:

[0979] Server: After the application process is complete, a confirmation email will be sent to the user's registered email address.

[0980] The above outlines the specific processing steps from when a user enters their problem to when they select the appropriate product or service and complete the application. By utilizing an emotion engine, it is possible to provide optimal suggestions tailored to the user's emotions and improve the user experience.

[0981] (Example 2)

[0982] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0983] Traditional systems simply required users to input their problems and receive suggestions for appropriate products or services, failing to consider the user's emotional state. As a result, user dissatisfaction and stress were not alleviated, and the suggested products and services were not sufficiently effective. Furthermore, the application process was often complex and time-consuming, resulting in low user convenience.

[0984] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0985] In this invention, the server includes means for inputting problem details from a terminal, performing analysis based on the input problem details, and proposing appropriate products and services; means for displaying detailed information selected by the user from the proposed products and services; means for inputting necessary information for the application procedure, confirming the input content, and completing the application procedure; and means for recognizing the user's emotions and proposing products and services based on those emotions. This makes it possible to propose the most suitable products considering the user's emotional state, and further improves the efficiency of the application procedure and enables quick resolution.

[0986] A "terminal" is a device used by a user to access and operate a system.

[0987] "Problem description" refers to the matter or issue that the user wants to solve, which they input into the system.

[0988] "Analysis" is the process of analyzing the input problem content and deriving appropriate products or services.

[0989] "Products and services" refer to specific products or support offered to solve users' problems.

[0990] "Suggestions" refer to the list of products or services presented to the user based on the analysis results.

[0991] "Detailed information" refers to more detailed descriptions and terms and conditions of the proposed product or service.

[0992] "Application process" refers to a series of operations and procedures that a user uses to formally apply for a product or service they have selected.

[0993] "Emotions" refer to the feelings and thoughts that the user is experiencing, and the system recognizes these.

[0994] "Emotion recognition" is the process of analyzing user input data and interpreting the user's emotions from it.

[0995] A "confirmation email" is an email sent to notify the user that the application process has been completed.

[0996] This invention is a system that allows users to input their own needs, receive suggestions for appropriate products and services based on those needs, and support them until they complete the application process. Furthermore, this invention incorporates an emotion engine that recognizes the user's emotions and provides suggestions based on those emotions.

[0997] System components

[0998] This system consists of a server, terminals, and an emotion engine. The terminals are devices that users use to access and operate the system, while the server is the central unit that handles data processing and analysis, product and service recommendations, and application completion. The emotion engine is a technology that recognizes the user's emotions and uses that information to recommend appropriate products and services.

[0999] Program Processing Overview

[1000] Access to the user interface

[1001] Device: Users access this system by launching a web browser or a dedicated app. Specifically, they access it by entering a URL or tapping the app icon.

[1002] Server: The server receives user access requests and dynamically generates and displays personal or corporate interfaces.

[1003] User's problem entry

[1004] Terminal: The user enters their problem into the text area of ​​the displayed interface and clicks the send button. Specifically, they might enter a problem such as "the internet is slow."

[1005] Server: The server receives data entered by the user and passes it to the analysis system.

[1006] Emotion recognition by an emotion engine

[1007] Server: The server sends the input text or audio data to the emotion engine. Specifically, it calls the text analysis API or the audio analysis API.

[1008] Emotion Engine: The emotion engine uses natural language processing technology to recognize the user's emotions. For example, it extracts emotions such as "frustration" or "dissatisfaction."

[1009] Server: The server receives the emotion analysis results obtained from the emotion engine and passes that data back to the analysis system.

[1010] Problem analysis and solution proposal

[1011] Server: The server uses natural language processing techniques to analyze problems and combines them with sentiment data to generate optimal product and service candidates. Specifically, it employs methods such as TF-IDF and Word2Vec.

[1012] Server: The server presents the user with a list of generated products and services. For example, it displays specific suggestions such as "Internet speed improvement plan" or "Wi-Fi router replacement."

[1013] Select and view details of products and services.

[1014] Terminal: The user clicks on the product or service they want to see more details about from the presented list. Specifically, they click on "Internet Speed ​​Improvement Plan".

[1015] Server: The server retrieves detailed information about the selected product from the database and displays it to the user. This information includes pricing, terms of service, and contract details.

[1016] Completion of application procedure

[1017] Terminal: The user reviews the details and fills in the required information on the application form. Specifically, they enter their name, address, contact information, etc., and click the "Apply" button.

[1018] Server: The server receives the input data and performs validation. For example, it checks if the format of the email address is correct.

[1019] Server: If validation is successful, save the application information to the database and send a notification to the relevant department.

[1020] Sending a confirmation email

[1021] Server: The server confirms that the application process is complete and calls the email sending API to send a confirmation email.

[1022] Specific example

[1023] The following is a specific example. It describes a case where an individual user enters a complaint about slow internet speeds and expresses feelings of frustration and dissatisfaction.

[1024] Access to the interface

[1025] Terminal: User A opens a web browser and accesses this system.

[1026] Server: The server receives user access requests and displays a personalized interface.

[1027] Input of problems and emotion recognition

[1028] Terminal: User A types "The internet is slow" and clicks the send button.

[1029] Server: The server receives input data and sends it to the emotion engine.

[1030] Emotion Engine: The emotion engine analyzes the input text and recognizes emotions such as "frustration" and "dissatisfaction."

[1031] Problem analysis and solution proposal

[1032] Server: The server analyzes the problem and prioritizes suggesting quick solutions that the user needs, based on sentiment data.

[1033] Server: Generates and presents suitable product options to user A, such as internet speed improvement services.

[1034] Select and view details of products and services.

[1035] Terminal: User A clicks on "Internet Speed ​​Improvement Plan".

[1036] Server: The server retrieves detailed information about the selected product and displays it to the user.

[1037] Completion of application procedure

[1038] Terminal: User A enters required information such as name and address into the application form and clicks the submit button.

[1039] Server: The server receives the input data, performs validation, and completes the application process.

[1040] Sending a confirmation email

[1041] Server: The server confirms that the application has been completed and sends a confirmation email to User A.

[1042] Example of a prompt

[1043] "My internet has been slow lately, and I want to increase the speed. What plans are available? It's really frustrating."

[1044] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1045] Step 1: Accessing the user interface

[1046] Device: The user launches a web browser or a dedicated app to access the system.

[1047] Input: Enter a URL or tap the app icon.

[1048] Action: The user accesses https: / / example.com in a browser or taps the app icon.

[1049] Output: An access request is sent to the server.

[1050] Server: The server dynamically generates and displays either a personal or corporate interface in response to user access requests.

[1051] Input: Access request.

[1052] Operation: The server generates a personalized interface and responds in HTML format.

[1053] Output: A personalized dashboard and consultation form are displayed on the device.

[1054] Step 2: User input of problem details

[1055] Terminal: The user enters their problem into the text area of ​​the displayed interface and clicks the send button.

[1056] Input: Enter text such as "The internet is slow."

[1057] Operation: The user enters their problem and clicks the submit button.

[1058] Output: Input data is sent to the server in JSON format.

[1059] Server: The server receives data entered by the user and passes it to the analysis system.

[1060] Input: Input data in JSON format.

[1061] Operation: Prepares the input data for transfer to the analysis system.

[1062] Output: The data is passed to the analysis system.

[1063] Step 3: Emotion recognition by the emotion engine

[1064] Server: The server sends the input text or audio data to the emotion engine.

[1065] Input: User's text input data.

[1066] Operation: Calls text analysis APIs and speech analysis APIs.

[1067] Output: Input data is sent to the emotion engine.

[1068] Emotion Engine: The emotion engine uses natural language processing technology to recognize the user's emotions.

[1069] Input: Text or audio data.

[1070] Operation: Executes an emotion recognition algorithm to detect "irritation" and "dissatisfaction."

[1071] Output: Sentiment analysis results are generated.

[1072] Server: The server receives the emotion analysis results obtained from the emotion engine and passes that data back to the analysis system.

[1073] Input: Sentiment analysis results.

[1074] Operation: Searches for relevant suggestions in an SQL database based on sentiment data.

[1075] Output: Emotional data is passed to the analysis system.

[1076] Step 4: Problem analysis and solution proposal

[1077] Server: The server uses natural language processing technology to analyze problems and combines them with sentiment data to generate optimal product and service candidates.

[1078] Input: Text input data and sentiment analysis results.

[1079] Operation: Analyzes text using methods such as TF-IDF and Word2Vec.

[1080] Output: A list of optimal product and service candidates is generated.

[1081] Server: The server presents the user with a list of generated products and services.

[1082] Input: A list of potential products or services.

[1083] Operation: Displays the list as an HTML page.

[1084] Output: A list of claimed goods and services is displayed on the terminal.

[1085] Step 5: Select and view details of products and services.

[1086] Terminal: The user clicks on a product or service from the presented list to view more details.

[1087] Input: Selection of specific products or services.

[1088] Action: The user clicks on "Internet Speed ​​Improvement Plan".

[1089] Output: The selection information is sent to the server.

[1090] Server: The server retrieves detailed information about the selected product from the database and displays it to the user.

[1091] Input: The ID of the selected product or service.

[1092] Operation: Retrieves detailed information from the database and returns it to the terminal in HTML format.

[1093] Output: Detailed information (e.g., price, terms and conditions, contract method) will be displayed on the device.

[1094] Step 6: Completion of the application process

[1095] Terminal: Users review detailed information and fill out the required fields in the application form.

[1096] Input: Application information such as name, address, and contact information.

[1097] Action: The user clicks the "Apply" button.

[1098] Output: Application information is sent to the server.

[1099] Server: The server receives the input data and performs validation.

[1100] Input: User application data.

[1101] Function: Data format check and validation.

[1102] Output: Validation success or failure result.

[1103] Server: If validation is successful, save the application information to the database and send a notification to the relevant department.

[1104] Input: Validated application data.

[1105] Operation: Saves to the database and sends a notification.

[1106] Output: Application process complete.

[1107] Step 7: Sending a confirmation email

[1108] Server: The server confirms that the application process is complete and calls the email sending API to send a confirmation email.

[1109] Input: Application completion information and user's email address.

[1110] Operation: Sends a confirmation email using an email sending API (e.g., SendGrid or Amazon SES).

[1111] Output: The user receives a confirmation email.

[1112] (Application Example 2)

[1113] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[1114] Traditional food delivery systems have struggled to offer products and services that address users' emotions and specific needs. Furthermore, there is a growing demand for services that provide higher satisfaction by offering suggestions based on user emotions. Therefore, it is necessary to develop a system that analyzes user input and then makes appropriate suggestions that take user emotions into account.

[1115] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1116] In this invention, the server includes means for inputting problem details from a terminal, performing analysis based on the input problem details, and suggesting appropriate products or services; means for recognizing the user's emotions and suggesting products or services based on those emotions; means for displaying detailed information of the products or services selected by the user from the suggested products or services; means for inputting necessary information for the application procedure, confirming the input, and completing the application procedure; and means for suggesting specific meal options. This makes it possible to suggest products and services based on the user's emotions.

[1117] A "terminal" is a device used by a user for input and operation, and includes smartphones, tablets, and computers.

[1118] "Problem description" refers to the issues or problems that the user wants to solve, and is provided in the form of text or audio data.

[1119] "Analysis" is the process of analyzing the input problem content and then proposing appropriate products or services based on that analysis.

[1120] "Proposing products and services" means presenting the most suitable products or services to the user based on the analysis results.

[1121] "Emotion recognition" refers to the process of understanding and analyzing a user's emotions from the text or audio they input.

[1122] "Detailed information" refers to information about the specific content and characteristics of the proposed product or service.

[1123] The "application process" is the process by which a user enters the necessary information to formally request the provision of the selected product or service, and then verifies that information.

[1124] "Required information" refers to the user's information and data that is requested to complete the application process.

[1125] "Verification" is the process of checking whether the entered data is accurate and confirming that there are no errors.

[1126] "Dining options" refer to specific dishes and food choices offered to the user, and are selected from a variety of menus and restaurants.

[1127] "System" refers to a configuration that includes a set of processes and functions designed to work together to solve user problems.

[1128] A system for carrying out this invention consists of a terminal, a server, and an emotion engine.

[1129] Overall system configuration

[1130] 1. Terminal: A device used by a user for input and operation, including smartphones, tablets, and computers.

[1131] 2. Server: This is the central part of the system that handles data processing and analysis, product and service proposals, and application procedures.

[1132] 3. Emotion Engine: This is a technology that recognizes the user's emotions and uses that information to suggest appropriate products and services.

[1133] Program Processing Overview

[1134] 1. Access to the user interface

[1135] Users access this system by launching a web browser or dedicated app using their smartphone or other device. The server receives the user's access request and displays a dynamically generated interface.

[1136] 2. User input of problems / issues

[1137] The user enters their problem into the text area of ​​the displayed interface and clicks the submit button. The server receives this input data.

[1138] 3. Emotion recognition by an emotion engine

[1139] The server sends the received text or audio data to the emotion engine. The emotion engine recognizes the user's emotions through text or audio analysis. The server receives the emotion analysis results from the emotion engine and continues the analysis.

[1140] 4. Analysis of problems and proposal of solutions

[1141] The server uses natural language processing technology to analyze the user's problems, combines this with emotional data obtained from the emotion engine, and generates and presents optimal product and service candidates to the user.

[1142] 5. Selecting and displaying details of products and services

[1143] The user clicks on a product or service from the presented list to see more details. The server retrieves the details of the selected product from the database and displays them to the user.

[1144] 6. Completion of application procedure

[1145] The user reviews the details and fills in the required information on the application form. The server receives the input data, validates it, and completes the application process.

[1146] Example of initial setup

[1147] This document provides specific examples of how to use the emotion-responsive food delivery app of this invention.

[1148] Specific example

[1149] For example, if a user enters "I'm really tired today," the following process will occur.

[1150] 1. Emotion engine analysis result: The server receives emotion data indicating "fatigue".

[1151] 2. Examples of proposed products:

[1152] Dishes using ingredients that have fatigue-relieving effects (e.g., grilled salmon, spinach and cheese lasagna, relaxing tea, etc.)

[1153] Popular healthy delivery menu items (e.g., salads, soups)

[1154] Technology used

[1155] 1. Hardware: Smartphones, servers

[1156] 2. Software: Flask (a Python web framework), natural language processing libraries (such as NLTK and spaCy), sentiment analysis models (BERT-based sentiment analysis models)

[1157] Example of a prompt

[1158] The user is feeling very tired, so please suggest some relaxing meal options. For example, display options such as grilled salmon, spinach and cheese lasagna, and relaxing tea.

[1159] In this way, it becomes possible to create a system that understands users' emotions and provides products and services that match them.

[1160] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1161] Step 1:

[1162] The terminal receives user input. The user enters their problems or issues into the terminal in text or voice. This input becomes the system's initial data. Examples of input data include "The internet is slow" or "I'm really tired today."

[1163] Step 2:

[1164] The server receives input data from the terminal. The input data is received as text or audio data. The server converts this data into an appropriate format for transmission to the emotion engine. Here, the input is the user's text or audio data, and the output is the converted result of that data.

[1165] Step 3:

[1166] The emotion engine analyzes the input data sent from the server. The emotion engine uses natural language processing techniques to recognize the user's emotions. Specifically, it performs emotion analysis using the BERT model. The input is text or audio data, and the output is user emotion data (e.g., "tired" or "frustrated").

[1167] Step 4:

[1168] The server receives emotion data obtained from the emotion engine. Based on this emotion data, it analyzes the user's problems and suggests appropriate products and services. Specifically, it uses natural language processing techniques to analyze problems and combines them with emotion data to generate optimal service candidates. The input is emotion data and problem data, and the output is a list of suggested products and services.

[1169] Step 5:

[1170] The terminal displays a list of suggested products and services to the user. The user clicks on a product or service from this list to view more information. The input is the list of suggested products, and the output is the detailed information of the product selected by the user.

[1171] Step 6:

[1172] The server retrieves detailed information about the product selected by the user from the database and sends it to the terminal. The specific operation involves database searching and information retrieval. The input is the user's selection information, and the output is the product details.

[1173] Step 7:

[1174] The terminal displays the detailed information to the user. The user enters the required information into the application form and clicks the submit button. The input consists of detailed information and application form data, and the output is a confirmation screen of the user's input.

[1175] Step 8:

[1176] The server receives the application data and performs validation. If validation is successful, the application process is completed and a confirmation email is sent. The specific actions are checking the integrity of the input data and sending the email. The input is the application data, and the output is the sending of the confirmation email.

[1177] This enables a series of operations, from suggesting products and services based on the user's emotions to completing the application process.

[1178] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1179] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1180] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[1181] [Third Embodiment]

[1182] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[1183] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1184] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1185] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[1186] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1187] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1188] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1189] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1190] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1191] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1192] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1193] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[1194] This invention is a system that allows users to input their own needs, receive suggestions for appropriate products and services based on those needs, and support them until they complete the application process. Specific embodiments for implementing this invention are described below.

[1195] Overall system configuration

[1196] This system consists of a server, terminals, and users. Terminals are devices that users use to access and operate the system, while the server is the central unit that handles data processing and analysis, product and service recommendations, and application procedures.

[1197] Program Processing Overview

[1198] 1. Access to the user interface

[1199] Device: The user launches a web browser or a dedicated app to access this system.

[1200] Server: Receives user access requests, dynamically generates and displays personal or corporate interfaces.

[1201] 2. User input of problems / issues

[1202] Terminal: The user enters their problem into the text area of ​​the displayed interface and clicks the send button.

[1203] Server: Receives the input data and starts the analysis.

[1204] 3. Analysis of problems and proposal of solutions

[1205] Server: Analyzes input problems using natural language processing techniques. For example, it extracts keywords using text mining techniques and understands their meaning.

[1206] Server: Based on the analysis results, it searches the database for suitable product and service candidates and generates a list.

[1207] Server: Present this list to the user and prompt them to make a selection.

[1208] 4. Select and view details of products and services.

[1209] Terminal: The user clicks on a product or service from the presented list to view more details.

[1210] Server: Retrieves detailed information about the selected product from the database and displays it to the user.

[1211] 5. Completion of application procedure

[1212] Terminal: The user enters the required information into a form to view details and submit an application.

[1213] Server: Receives the input data and performs validation.

[1214] Server: If validation is successful, complete the application process.

[1215] 6. Sending a confirmation email

[1216] Server: Confirms that the application process is complete and sends a confirmation email to the user.

[1217] Specific example

[1218] This explains what happens when an individual user enters a problem, such as "the internet is slow."

[1219] Access to the interface

[1220] Terminal: User A opens a web browser and accesses this system.

[1221] Server: Receives user access requests and displays a personalized interface.

[1222] Enter your problem

[1223] Terminal: User A types "The internet is slow" and clicks the send button.

[1224] Server: Receives input data and begins analysis.

[1225] Problem analysis and solution proposal

[1226] Server: The phrase "the internet is slow" is analyzed using a natural language processing engine, and related keywords (e.g., speed improvement, plan change) are extracted.

[1227] Server: Based on the analysis results, it generates a list of suitable product candidates, such as internet plan speed improvement services, and presents them to User A.

[1228] Select and view details of products and services.

[1229] Terminal: User A clicks on "Internet Speed ​​Improvement Plan".

[1230] Server: Retrieves detailed information about the selected product and displays it to the user.

[1231] Completion of application procedure

[1232] Terminal: User A enters required information such as name and address into the application form and clicks the submit button.

[1233] Server: Receives input data, performs validation, and completes the application process.

[1234] Sending a confirmation email

[1235] Server: Confirms that the application has been completed and sends a confirmation email to User A.

[1236] In this way, the system allows users to quickly and efficiently resolve their problems and easily apply for the most suitable products and services.

[1237] The following describes the processing flow.

[1238] Step 1:

[1239] Device: The user launches a web browser or a dedicated app to access this system.

[1240] Step 2:

[1241] Server: Receives user access requests, dynamically generates and displays personal or corporate interfaces.

[1242] Step 3:

[1243] Terminal: The interface is displayed, and a text area is provided for the user to enter their problem.

[1244] Step 4:

[1245] Terminal: The user enters their problem into the text area and clicks the send button.

[1246] Step 5:

[1247] Server: Receives user input data and starts text analysis using a natural language processing (NLP) engine.

[1248] Step 6:

[1249] Server: The NLP engine extracts keywords related to the input problem and analyzes the sentiment and context.

[1250] Step 7:

[1251] Server: Based on the analysis results, it searches the database for suitable product and service candidates and generates a list.

[1252] Step 8:

[1253] Server: Generates a list of products and services in HTML format and sends it to the client terminal.

[1254] Step 9:

[1255] Terminal: The terminal receives a list of suggested products and services from the user and displays it on the screen.

[1256] Step 10:

[1257] Terminal: The user clicks on the product or service they want to view details about.

[1258] Step 11:

[1259] Terminal: Sends a request to display details to the server.

[1260] Step 12:

[1261] Server: Retrieves detailed information about the selected product from the database, formats it in HTML format, and sends it to the client terminal.

[1262] Step 13:

[1263] Terminal: The screen displays detailed information about the product selected by the user.

[1264] Step 14:

[1265] Terminal: The user reviews the details and fills out the required information in the application form.

[1266] Step 15:

[1267] Terminal: The user clicks the complete button and sends the application request to the server.

[1268] Step 16:

[1269] Server: Receives the required information entered and performs validation.

[1270] Step 17:

[1271] Server: If validation is successful, complete the application process within the system.

[1272] Step 18:

[1273] Server: Generates confirmation information for the completion of the application process and sends it to the client terminal.

[1274] Step 19:

[1275] Terminal: The user receives a confirmation message that the application process is complete.

[1276] Step 20:

[1277] Server: After the application process is complete, a confirmation email will be sent to the user's registered email address.

[1278] The above outlines the specific processing steps from when a user enters their problem to when they select the appropriate product or service and complete the application.

[1279] (Example 1)

[1280] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1281] Traditionally, there have been few systems that appropriately analyze users' problems and propose effective products and services based on that analysis. Furthermore, there has been a lack of systems that display detailed information about the proposed products and services and smoothly guide users through the application process. As a result, it has been difficult for users to quickly and efficiently resolve their problems. This invention aims to provide a system that analyzes the problem content entered by the user using natural language processing technology, proposes appropriate products and services based on the analysis results, and allows users to easily complete the application process.

[1282] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1283] In this invention, the server includes means for receiving problem details from a terminal, performing analysis based on the entered problem details, and suggesting appropriate products and services; means for displaying detailed information selected by the user from the suggested products and services; means for receiving necessary information for the application procedure, confirming the entered information, and completing the application procedure; means for sending a confirmation email to the user when the application procedure is completed; and means for analyzing the entered problem details using natural language processing technology, generating a list of suggestions from a service database based on the analysis results, and presenting it to the user. This enables users to solve their problems quickly and efficiently and easily apply for appropriate products and services.

[1284] A "terminal" refers to a device such as a computer, smartphone, or tablet that a user uses for input and operation.

[1285] "Problem description" refers to the text information about the challenges or problems that the user enters into the input field.

[1286] "Analysis" is the process by which a server understands the received problem content using natural language processing technology and extracts relevant keywords and meanings.

[1287] "Product and service suggestions" refers to selecting and displaying a list of products and services that provide appropriate solutions to the user based on the analyzed problem.

[1288] "Detailed information" refers to additional information, features, and specifications that help users gain a deeper understanding of the proposed product or service.

[1289] The "application process" is the process by which a user enters the information necessary to actually use the selected product or service and formally completes the application.

[1290] A "confirmation email" is a notification email sent to a user upon completion of the application process.

[1291] "Natural language processing technology" refers to techniques that enable computers to understand, analyze, and generate human language, and includes methods such as text mining and keyword extraction.

[1292] A "service database" is a database containing information about products and services that the server accesses in order to generate a list of suggestions.

[1293] A "suggestion list" is a list of appropriate products and services that the server generates and presents to the user based on the analysis results.

[1294] This invention is a system that allows users to input their own needs, receive suggestions for appropriate products and services based on those needs, and support them until they complete the application process. Specific embodiments for implementing this invention are described below.

[1295] Overall system configuration

[1296] This system consists of a server, terminals, and users. Terminals are devices that users use to access and operate the system, while the server is the central unit that handles data processing and analysis, product and service proposals, and application procedures.

[1297] Program Processing Overview

[1298] Access to the user interface

[1299] Device: The user launches a web browser or a dedicated app to access this system.

[1300] Server: Receives user access requests, dynamically generates and displays personal or corporate interfaces.

[1301] User's problem entry

[1302] Terminal: The user enters their problem into the text area of ​​the displayed interface and clicks the send button.

[1303] Server: Receives the input data and starts the analysis.

[1304] Problem analysis and solution proposal

[1305] Server: Analyzes input problems using natural language processing techniques. For example, it extracts keywords using text mining techniques and understands their meaning.

[1306] Server: Based on the analysis results, it searches the database for suitable product and service candidates and generates a list.

[1307] Server: Present this list to the user and prompt them to make a selection.

[1308] Select and view details of products and services.

[1309] Terminal: The user clicks on a product or service from the presented list to view more details.

[1310] Server: Retrieves detailed information about the selected product from the database and displays it to the user.

[1311] Completion of application procedure

[1312] Terminal: The user enters the required information into a form to view details and submit an application.

[1313] Server: Receives the input data and performs validation.

[1314] Server: If validation is successful, complete the application process.

[1315] Sending a confirmation email

[1316] Server: Confirms that the application process is complete and sends a confirmation email to the user.

[1317] Hardware or software to use

[1318] This system uses the following specific hardware and software:

[1319] Server: Web server (e.g., Apache HTTP Server)

[1320] Devices: Computers, smartphones, tablets

[1321] Software: Natural language processing engines (e.g., Apache OpenNLP), database management systems (e.g., MySQL)

[1322] Specific example

[1323] This explains what happens when an individual user enters a problem, such as "the internet is slow."

[1324] Access to the interface

[1325] Terminal: User A opens a web browser and accesses this system.

[1326] Server: Receives user access requests and displays a personalized interface.

[1327] Enter your problem

[1328] Terminal: User A types "The internet is slow" and clicks the send button.

[1329] Server: Receives input data and begins analysis.

[1330] Problem analysis and solution proposal

[1331] Server: The phrase "the internet is slow" is analyzed using a natural language processing engine, and related keywords (e.g., speed improvement, plan change) are extracted.

[1332] Server: Based on the analysis results, it generates a list of suitable product candidates, such as internet plan speed improvement services, and presents them to User A.

[1333] Select and view details of products and services.

[1334] Terminal: User A clicks on "Internet Speed ​​Improvement Plan".

[1335] Server: Retrieves detailed information about the selected product and displays it to the user.

[1336] Completion of application procedure

[1337] Terminal: User A enters required information such as name and address into the application form and clicks the submit button.

[1338] Server: Receives input data, performs validation, and completes the application process.

[1339] Sending a confirmation email

[1340] Server: Confirms that the application has been completed and sends a confirmation email to User A.

[1341] This system is designed to provide users with quick and accurate solutions by combining natural language processing technology with database search. For example, by entering a prompt such as "Suggest services to improve internet speed when it's slow" into the generative AI model, an appropriate solution can be obtained.

[1342] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1343] Step 1: Accessing the user interface

[1344] User: Open a web browser and enter the URL of this system to access it.

[1345] Input: System URL

[1346] Output: Access Request

[1347] Server: Receives access requests and identifies whether the user is an individual or a legal entity.

[1348] Input: Access Request

[1349] Output: User type (individual or corporate)

[1350] Server: Dynamically generates the appropriate interface based on the user type, sends it to the terminal, and displays it.

[1351] Input: User Type

[1352] Output: Generated interface

[1353] Step 2: User input of problem details

[1354] Terminal: The user enters their problem in the text area of ​​the displayed interface and clicks the send button.

[1355] Input: Text of the problem

[1356] Output: Send Request

[1357] Server: Receives a transmission request and prepares the input data for analysis.

[1358] Input: Sending Request

[1359] Output: Data ready for analysis

[1360] Step 3: Problem analysis and solution proposal

[1361] Server: Starts the natural language processing engine and analyzes the problem text. For example, it extracts relevant keywords from the phrase "the internet is slow."

[1362] Input: Text of the problem

[1363] Data processing: Keyword extraction and semantic analysis using a natural language processing engine.

[1364] Output: Analysis results (keywords, etc.)

[1365] Server: Based on the analysis results, it searches the service database for appropriate products and services and generates a list of suggestions.

[1366] Input: Analysis results

[1367] Data processing: Database search

[1368] Output: Proposal List

[1369] Server: Presents a list of suggestions to the user.

[1370] Input: Proposal list

[1371] Output: Display of the suggestion list

[1372] Step 4: Select and view details of products and services.

[1373] User: Select and click on products or services of interest from the suggested list.

[1374] Input: Selected product or service

[1375] Output: Click Event

[1376] Server: Receives click events and retrieves detailed information about the corresponding product from the database.

[1377] Input: Click Event

[1378] Data processing: Information retrieval from databases

[1379] Output: Detailed information

[1380] Server: Displays detailed information to the user.

[1381] Input: Detailed information

[1382] Output: Detailed information display

[1383] Step 5: Completion of the application process

[1384] User: Review the details, fill in the required information (such as name and address) on the application form, and click the apply button.

[1385] Input: Application information (name, address, etc.)

[1386] Output: Application Request

[1387] Server: Receives application requests and validates the input data.

[1388] Input: Application Request

[1389] Data processing: validation

[1390] Output: Validation results

[1391] Server: If validation is successful, complete the application process.

[1392] Input: Validation result

[1393] Output: Application completion notification

[1394] Step 6: Sending a confirmation email

[1395] Server: Confirms that the application process is complete and sends a confirmation email to the user.

[1396] Input: Application completion notification

[1397] Output: Confirmation email sent

[1398] (Application Example 1)

[1399] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1400] Modern consumers want to quickly find products and services that meet their needs and concerns, and complete the purchase process easily and efficiently. However, currently, finding the right products and services often takes a lot of time and involves complicated procedures. This is especially true for online shopping, where selecting the right product from countless options is difficult and contributes to a poor user experience.

[1401] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1402] In this invention, the server includes means for receiving problem details from a terminal, performing analysis based on the entered problem details, and suggesting appropriate products and services; means for analyzing the input content using a natural language processing engine, generating a list of suggested products and presenting it to the user; and means for receiving necessary information for the application procedure, confirming the input content, and completing the application procedure. As a result, the user can receive prompt and appropriate suggestions for products and services that address their needs and problems, and complete the purchase procedure easily.

[1403] A "terminal" is a device used by a user to access and operate a system.

[1404] "Problem description" refers to text data in which the user enters their own worries or issues they want to solve.

[1405] "Performing analysis" refers to the process of understanding the input problem content using natural language processing technology and extracting relevant keywords.

[1406] "Means of proposing products and services" refers to a system function that searches a database for and presents suitable product and service candidates based on analyzed keywords.

[1407] A "suggestion list" is a list of products and services selected based on the user's input.

[1408] The "application process" is the process of entering and confirming the information necessary to complete the purchase of the selected product or service.

[1409] A "natural language processing engine" is a system component that analyzes user input and extracts meaning and keywords.

[1410] A "database" is an information aggregation system that stores information about the products and services being proposed.

[1411] A "confirmation email" is an email sent to a user to notify them that they have completed the application process.

[1412] An "application interface" is software that provides an interface for users to access and operate a system.

[1413] This invention is implemented as a "shopping assistant app" that users can use on their smartphones. By using this app, users can resolve their problems and concerns about products they want to buy, receive appropriate suggestions, and efficiently complete the purchase process.

[1414] Hardware and software to be used

[1415] Hardware: Smartphone (iOS or Android device)

[1416] software:

[1417] Smartphone app

[1418] Frontend: React Native, Flutter

[1419] Backend: Node.js, Django

[1420] Natural Language Processing Engine: Google Cloud Natural Language API

[1421] Database: MySQL

[1422] Email sending service: SendGrid API

[1423] Process Overview

[1424] 1. Access to the interface

[1425] When a user launches the smartphone app from their device, the server receives an access request and dynamically generates and displays an interface. This interface provides a text area where the user can enter their needs and concerns.

[1426] 2. Input and reception of problem details

[1427] When a user enters specific information about their problem or the product they want to buy into the interface's text area and presses the submit button, the device sends that data to the server. The server receives this data and begins preparing to pass it on to the natural language processing engine.

[1428] 3. Analysis using natural language processing

[1429] The server sends input data to a natural language processing engine, such as the Google Cloud Natural Language API, for analysis. The engine extracts keywords from the text and performs a process to understand their meaning.

[1430] 4. Generate a list of suggested products

[1431] The server searches the MySQL database for relevant products and services based on the analysis results obtained through natural language processing and generates a list of suggestions. By presenting this list to the user, the system enables the user to quickly find products and services that meet their needs.

[1432] 5. Displaying and selecting product details

[1433] When a user selects a specific product or service from the suggested list, the server retrieves its details from a MySQL database and displays them on the terminal. This allows the user to review the product details and consider purchasing it.

[1434] 6. Completion of the purchase procedure

[1435] When a user enters the required information into the purchase form and clicks the purchase button, the server receives the data and performs validation. If validation is successful, the server completes the purchase process.

[1436] 7. Sending a confirmation email

[1437] Once the application process is complete, the server uses an email sending service such as the SendGrid API to send a confirmation email to the user. This allows the user to confirm their purchase details.

[1438] Specific example

[1439] For example, if a user enters "I want to buy a refrigerator, but I'm not sure which one to get," the Google Cloud Natural Language API extracts keywords such as "refrigerator," "purchase," and "undecided." Based on these keywords, the server generates a list of suitable refrigerator suggestions and presents them to the user. The user can then view detailed information from the list and easily complete the purchase process from their smartphone.

[1440] Example of a prompt

[1441] An example of a text-based prompt is shown below:

[1442] "Input text describing a user's situation—that they are considering buying a refrigerator but are unsure which one to choose (e.g., 'I want to buy a refrigerator, but I'm not sure which one to get.')—provide the necessary analytical steps to design an application algorithm that extracts keywords using natural language processing and suggests appropriate products."

[1443] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1444] Step 1:

[1445] A user launches a smartphone app. An access request is sent from the device to the server. The server receives the access request, dynamically generates a user interface, and displays it on the device. The input is the user's access request, and the output is the displayed user interface.

[1446] Step 2:

[1447] The user enters specific information about their problem or the product they want to purchase into the interface's text area and presses the submit button. The terminal then sends this input data to the server. The input is the user's text data, and the output is the transmission of text data to the server.

[1448] Step 3:

[1449] The server sends the received text data to the Google Cloud Natural Language API for analysis. The analysis involves extracting keywords from the text and understanding their meaning. The input is the user's text data, and the output is the analyzed keyword data.

[1450] Step 4:

[1451] The server searches a MySQL database based on the extracted keywords and generates a list of suggested products and services. This list is structured to include products and services that meet the user's needs. The input is keyword data, and the output is a list of suggested products.

[1452] Step 5:

[1453] The server sends the generated suggestion list to the terminal and presents it to the user. The user selects a specific product or service from the presented list. The input is the suggestion list, and the output is the product selection data.

[1454] Step 6:

[1455] To display detailed information about a product selected by the user from a suggestion list, the server retrieves the selected product details from a MySQL database and sends them to the terminal. The terminal then displays the detailed information. The input is the product selection data, and the output is the display of the detailed information.

[1456] Step 7:

[1457] The user reviews the details and fills in the required information on a form to proceed with the purchase. The device sends this data to the server. The input is the data entered on the purchase form, and the output is the transmission of the input data to the server.

[1458] Step 8:

[1459] The server validates the received purchase procedure data and completes the purchase if there are no problems. Validation includes a process to check whether the format and content of the input data are correct. The input is the purchase form data, and the output is the completion status of the purchase procedure.

[1460] Step 9:

[1461] The server generates a confirmation email after the purchase process is complete and sends it to the user using the SendGrid API. The input is data indicating the completion of the purchase process, and the output is the sending of the confirmation email.

[1462] Step 10:

[1463] The user receives a confirmation email on their device and confirms that the purchase is complete. The input is the confirmation email, and the output is the user's confirmation.

[1464] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1465] This invention is a system that allows users to input their own needs, receive suggestions for appropriate products and services based on those needs, and support them until they complete the application process. Furthermore, this invention incorporates an emotion engine that recognizes the user's emotions and provides suggestions based on those emotions. The following describes specific embodiments for carrying out this invention.

[1466] Overall system configuration

[1467] This system consists of a server, terminals, and an emotion engine. The terminals are devices that users use to access and operate the system, while the server is the central unit that handles data processing and analysis, product and service recommendations, and application completion. The emotion engine is a technology that recognizes user emotions and uses that information to recommend appropriate products and services.

[1468] Program Processing Overview

[1469] 1. Access to the user interface

[1470] Device: The user launches a web browser or a dedicated app to access this system.

[1471] Server: Receives user access requests, dynamically generates and displays personal or corporate interfaces.

[1472] 2. User input of problems / issues

[1473] Terminal: The user enters their problem into the text area of ​​the displayed interface and clicks the send button.

[1474] Server: Receives the entered data.

[1475] 3. Emotion recognition by an emotion engine

[1476] Server: Sends the input text or audio data to the emotion engine.

[1477] Emotion Engine: Recognizes user emotions through text and voice analysis.

[1478] Server: Receives emotion analysis results from the emotion engine and performs further analysis based on that data.

[1479] 4. Analysis of problems and proposal of solutions

[1480] Server: Uses natural language processing technology to analyze problems, combines them with emotional data obtained from the emotion engine, and searches for the most suitable product or service candidates.

[1481] Server: Generates a list of products and services and presents it to the user.

[1482] 5. Selecting and displaying details of products and services

[1483] Terminal: The user clicks on a product or service from the presented list to view more details.

[1484] Server: Retrieves detailed information about the selected product from the database and displays it to the user.

[1485] 6. Completion of application procedure

[1486] Terminal: The user enters the required information into a form to view details and submit an application.

[1487] Server: Receives the input data and performs validation.

[1488] Server: If validation is successful, complete the application process.

[1489] 7. Sending a confirmation email

[1490] Server: Confirms that the application process is complete and sends a confirmation email to the user.

[1491] Specific example

[1492] This section explains a scenario where an individual user posts a complaint about slow internet speeds and expresses feelings of frustration and dissatisfaction.

[1493] Access to the interface

[1494] Terminal: User A opens a web browser and accesses this system.

[1495] Server: Receives user access requests and displays a personalized interface.

[1496] Input of problems and emotion recognition

[1497] Terminal: User A types "The internet is slow" and clicks the send button.

[1498] Server: Receives input data and sends it to the emotion engine.

[1499] Emotion Engine: Analyzes the input text and recognizes emotions such as "frustration" and "dissatisfaction."

[1500] Problem analysis and solution proposal

[1501] Server: Analyzes the user's problem and prioritizes suggesting quick solutions based on emotional data.

[1502] Server: Generates and presents suitable product options to user A, such as internet speed improvement services.

[1503] Select and view details of products and services.

[1504] Terminal: User A clicks on "Internet Speed ​​Improvement Plan".

[1505] Server: Retrieves detailed information about the selected product and displays it to the user.

[1506] Completion of application procedure

[1507] Terminal: User A enters required information such as name and address into the application form and clicks the submit button.

[1508] Server: Receives input data, performs validation, and completes the application process.

[1509] Sending a confirmation email

[1510] Server: Confirms that the application has been completed and sends a confirmation email to User A.

[1511] In this way, the system allows users to quickly and efficiently resolve their problems and easily apply for the most suitable products and services based on their emotions by utilizing an emotion engine.

[1512] The following describes the processing flow.

[1513] Step 1:

[1514] Device: The user launches a web browser or a dedicated app to access this system.

[1515] Step 2:

[1516] Server: Receives user access requests, dynamically generates and displays personal or corporate interfaces.

[1517] Step 3:

[1518] Terminal: The interface is displayed, and a text area is provided for the user to enter their problem.

[1519] Step 4:

[1520] Terminal: The user enters their problem into the text area and clicks the send button.

[1521] Step 5:

[1522] Server: Receives user input data and starts text analysis using a natural language processing (NLP) engine.

[1523] Step 6:

[1524] Server: Sends the input text data to the emotion engine.

[1525] Step 7:

[1526] Emotion Engine: Recognizes the user's emotions through text and voice analysis. For example, it can recognize the emotion of "frustration."

[1527] Step 8:

[1528] Server: Receives sentiment analysis results (e.g., "irritation") from the emotion engine.

[1529] Step 9:

[1530] Server: The NLP engine extracts keywords from the input problem and analyzes the sentiment and context. For example, it identifies keywords such as "internet" and "speed improvement."

[1531] Step 10:

[1532] Server: Based on text and sentiment analysis results, it searches the database for suitable product and service candidates and generates a list. If the sentiment is "frustrated," it prioritizes suggesting services that can provide a quick response.

[1533] Step 11:

[1534] Server: Generates a list of products and services in HTML format and sends it to the client terminal.

[1535] Step 12:

[1536] Terminal: The terminal receives a list of suggested products and services from the user and displays it on the screen.

[1537] Step 13:

[1538] Terminal: The user clicks on the product or service they want to view details about.

[1539] Step 14:

[1540] Terminal: Sends a request to display details to the server.

[1541] Step 15:

[1542] Server: Retrieves detailed information about the selected product from the database, formats it in HTML format, and sends it to the client terminal.

[1543] Step 16:

[1544] Terminal: The screen displays detailed information about the product selected by the user.

[1545] Step 17:

[1546] Terminal: The user reviews the details and fills out the required information in the application form.

[1547] Step 18:

[1548] Terminal: The user clicks the complete button and sends the application request to the server.

[1549] Step 19:

[1550] Server: Receives the required information entered and performs validation.

[1551] Step 20:

[1552] Server: If validation is successful, complete the application process within the system.

[1553] Step 21:

[1554] Server: Generates confirmation information for the completion of the application process and sends it to the client terminal.

[1555] Step 22:

[1556] Terminal: The user receives a confirmation message that the application process is complete.

[1557] Step 23:

[1558] Server: After the application process is complete, a confirmation email will be sent to the user's registered email address.

[1559] The above outlines the specific processing steps from when a user enters their problem to when they select the appropriate product or service and complete the application. By utilizing an emotion engine, it is possible to provide optimal suggestions tailored to the user's emotions and improve the user experience.

[1560] (Example 2)

[1561] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1562] Traditional systems simply required users to input their problems and receive suggestions for appropriate products or services, failing to consider the user's emotional state. As a result, user dissatisfaction and stress were not alleviated, and the suggested products and services were not sufficiently effective. Furthermore, the application process was often complex and time-consuming, resulting in low user convenience.

[1563] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1564] In this invention, the server includes means for inputting problem details from a terminal, performing analysis based on the input problem details, and proposing appropriate products and services; means for displaying detailed information selected by the user from the proposed products and services; means for inputting necessary information for the application procedure, confirming the input content, and completing the application procedure; and means for recognizing the user's emotions and proposing products and services based on those emotions. This makes it possible to propose the most suitable products considering the user's emotional state, and further improves the efficiency of the application procedure and enables quick resolution.

[1565] A "terminal" is a device used by a user to access and operate a system.

[1566] "Problem description" refers to the matter or issue that the user wants to solve, which they input into the system.

[1567] "Analysis" is the process of analyzing the input problem content and deriving appropriate products or services.

[1568] "Products and services" refer to specific products or support offered to solve users' problems.

[1569] "Suggestions" refer to the list of products or services presented to the user based on the analysis results.

[1570] "Detailed information" refers to more detailed descriptions and terms and conditions of the proposed product or service.

[1571] "Application process" refers to a series of operations and procedures that a user uses to formally apply for a product or service they have selected.

[1572] "Emotions" refer to the feelings and thoughts that the user is experiencing, and the system recognizes these.

[1573] "Emotion recognition" is the process of analyzing user input data and interpreting the user's emotions from it.

[1574] A "confirmation email" is an email sent to notify the user that the application process has been completed.

[1575] This invention is a system that allows users to input their own needs, receive suggestions for appropriate products and services based on those needs, and support them until they complete the application process. Furthermore, this invention incorporates an emotion engine that recognizes the user's emotions and provides suggestions based on those emotions.

[1576] System components

[1577] This system consists of a server, terminals, and an emotion engine. The terminals are devices that users use to access and operate the system, while the server is the central unit that handles data processing and analysis, product and service recommendations, and application completion. The emotion engine is a technology that recognizes the user's emotions and uses that information to recommend appropriate products and services.

[1578] Program Processing Overview

[1579] Access to the user interface

[1580] Device: Users access this system by launching a web browser or a dedicated app. Specifically, they access it by entering a URL or tapping the app icon.

[1581] Server: The server receives user access requests and dynamically generates and displays personal or corporate interfaces.

[1582] User's problem entry

[1583] Terminal: The user enters their problem into the text area of ​​the displayed interface and clicks the send button. Specifically, they might enter a problem such as "the internet is slow."

[1584] Server: The server receives data entered by the user and passes it to the analysis system.

[1585] Emotion recognition by an emotion engine

[1586] Server: The server sends the input text or audio data to the emotion engine. Specifically, it calls the text analysis API or the audio analysis API.

[1587] Emotion Engine: The emotion engine uses natural language processing technology to recognize the user's emotions. For example, it extracts emotions such as "frustration" or "dissatisfaction."

[1588] Server: The server receives the emotion analysis results obtained from the emotion engine and passes that data back to the analysis system.

[1589] Problem analysis and solution proposal

[1590] Server: The server uses natural language processing techniques to analyze problems and combines them with sentiment data to generate optimal product and service candidates. Specifically, it employs methods such as TF-IDF and Word2Vec.

[1591] Server: The server presents the user with a list of generated products and services. For example, it displays specific suggestions such as "Internet speed improvement plan" or "Wi-Fi router replacement."

[1592] Select and view details of products and services.

[1593] Terminal: The user clicks on the product or service they want to see more details about from the presented list. Specifically, they click on "Internet Speed ​​Improvement Plan".

[1594] Server: The server retrieves detailed information about the selected product from the database and displays it to the user. This information includes pricing, terms of service, and contract details.

[1595] Completion of application procedure

[1596] Terminal: The user reviews the details and fills in the required information on the application form. Specifically, they enter their name, address, contact information, etc., and click the "Apply" button.

[1597] Server: The server receives the input data and performs validation. For example, it checks if the format of the email address is correct.

[1598] Server: If validation is successful, save the application information to the database and send a notification to the relevant department.

[1599] Sending a confirmation email

[1600] Server: The server confirms that the application process is complete and calls the email sending API to send a confirmation email.

[1601] Specific example

[1602] The following is a specific example. It describes a case where an individual user enters a complaint about slow internet speeds and expresses feelings of frustration and dissatisfaction.

[1603] Access to the interface

[1604] Terminal: User A opens a web browser and accesses this system.

[1605] Server: The server receives user access requests and displays a personalized interface.

[1606] Input of problems and emotion recognition

[1607] Terminal: User A types "The internet is slow" and clicks the send button.

[1608] Server: The server receives input data and sends it to the emotion engine.

[1609] Emotion Engine: The emotion engine analyzes the input text and recognizes emotions such as "frustration" and "dissatisfaction."

[1610] Problem analysis and solution proposal

[1611] Server: The server analyzes the problem and prioritizes suggesting quick solutions that the user needs, based on sentiment data.

[1612] Server: Generates and presents suitable product options to user A, such as internet speed improvement services.

[1613] Select and view details of products and services.

[1614] Terminal: User A clicks on "Internet Speed ​​Improvement Plan".

[1615] Server: The server retrieves detailed information about the selected product and displays it to the user.

[1616] Completion of application procedure

[1617] Terminal: User A enters required information such as name and address into the application form and clicks the submit button.

[1618] Server: The server receives the input data, performs validation, and completes the application process.

[1619] Sending a confirmation email

[1620] Server: The server confirms that the application has been completed and sends a confirmation email to User A.

[1621] Example of a prompt

[1622] "My internet has been slow lately, and I want to increase the speed. What plans are available? It's really frustrating."

[1623] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1624] Step 1: Accessing the user interface

[1625] Device: The user launches a web browser or a dedicated app to access the system.

[1626] Input: Enter a URL or tap the app icon.

[1627] Action: The user accesses https: / / example.com in a browser or taps the app icon.

[1628] Output: An access request is sent to the server.

[1629] Server: The server dynamically generates and displays either a personal or corporate interface in response to user access requests.

[1630] Input: Access request.

[1631] Operation: The server generates a personalized interface and responds in HTML format.

[1632] Output: A personalized dashboard and consultation form are displayed on the device.

[1633] Step 2: User input of problem details

[1634] Terminal: The user enters their problem into the text area of ​​the displayed interface and clicks the send button.

[1635] Input: Enter text such as "The internet is slow."

[1636] Operation: The user enters their problem and clicks the submit button.

[1637] Output: Input data is sent to the server in JSON format.

[1638] Server: The server receives data entered by the user and passes it to the analysis system.

[1639] Input: Input data in JSON format.

[1640] Operation: Prepares the input data for transfer to the analysis system.

[1641] Output: The data is passed to the analysis system.

[1642] Step 3: Emotion recognition by the emotion engine

[1643] Server: The server sends the input text or audio data to the emotion engine.

[1644] Input: User's text input data.

[1645] Operation: Calls text analysis APIs and speech analysis APIs.

[1646] Output: Input data is sent to the emotion engine.

[1647] Emotion Engine: The emotion engine uses natural language processing technology to recognize the user's emotions.

[1648] Input: Text or audio data.

[1649] Operation: Executes an emotion recognition algorithm to detect "irritation" and "dissatisfaction."

[1650] Output: Sentiment analysis results are generated.

[1651] Server: The server receives the emotion analysis results obtained from the emotion engine and passes that data back to the analysis system.

[1652] Input: Sentiment analysis results.

[1653] Operation: Searches for relevant suggestions in an SQL database based on sentiment data.

[1654] Output: Emotional data is passed to the analysis system.

[1655] Step 4: Problem analysis and solution proposal

[1656] Server: The server uses natural language processing technology to analyze problems and combines them with sentiment data to generate optimal product and service candidates.

[1657] Input: Text input data and sentiment analysis results.

[1658] Operation: Analyzes text using methods such as TF-IDF and Word2Vec.

[1659] Output: A list of optimal product and service candidates is generated.

[1660] Server: The server presents the user with a list of generated products and services.

[1661] Input: A list of potential products or services.

[1662] Operation: Displays the list as an HTML page.

[1663] Output: A list of claimed goods and services is displayed on the terminal.

[1664] Step 5: Select and view details of products and services.

[1665] Terminal: The user clicks on a product or service from the presented list to view more details.

[1666] Input: Selection of specific products or services.

[1667] Action: The user clicks on "Internet Speed ​​Improvement Plan".

[1668] Output: The selection information is sent to the server.

[1669] Server: The server retrieves detailed information about the selected product from the database and displays it to the user.

[1670] Input: The ID of the selected product or service.

[1671] Operation: Retrieves detailed information from the database and returns it to the terminal in HTML format.

[1672] Output: Detailed information (e.g., price, terms and conditions, contract method) will be displayed on the device.

[1673] Step 6: Completion of the application process

[1674] Terminal: Users review detailed information and fill out the required fields in the application form.

[1675] Input: Application information such as name, address, and contact information.

[1676] Action: The user clicks the "Apply" button.

[1677] Output: Application information is sent to the server.

[1678] Server: The server receives the input data and performs validation.

[1679] Input: User application data.

[1680] Function: Data format check and validation.

[1681] Output: Validation success or failure result.

[1682] Server: If validation is successful, save the application information to the database and send a notification to the relevant department.

[1683] Input: Validated application data.

[1684] Operation: Saves to the database and sends a notification.

[1685] Output: Application process complete.

[1686] Step 7: Sending a confirmation email

[1687] Server: The server confirms that the application process is complete and calls the email sending API to send a confirmation email.

[1688] Input: Application completion information and user's email address.

[1689] Operation: Sends a confirmation email using an email sending API (e.g., SendGrid or Amazon SES).

[1690] Output: The user receives a confirmation email.

[1691] (Application Example 2)

[1692] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1693] Traditional food delivery systems have struggled to offer products and services that address users' emotions and specific needs. Furthermore, there is a growing demand for services that provide higher satisfaction by offering suggestions based on user emotions. Therefore, it is necessary to develop a system that analyzes user input and then makes appropriate suggestions that take user emotions into account.

[1694] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1695] In this invention, the server includes means for inputting problem details from a terminal, performing analysis based on the input problem details, and suggesting appropriate products or services; means for recognizing the user's emotions and suggesting products or services based on those emotions; means for displaying detailed information of the products or services selected by the user from the suggested products or services; means for inputting necessary information for the application procedure, confirming the input, and completing the application procedure; and means for suggesting specific meal options. This makes it possible to suggest products and services based on the user's emotions.

[1696] A "terminal" is a device used by a user for input and operation, and includes smartphones, tablets, and computers.

[1697] "Problem description" refers to the issues or problems that the user wants to solve, and is provided in the form of text or audio data.

[1698] "Analysis" is the process of analyzing the input problem content and then proposing appropriate products or services based on that analysis.

[1699] "Proposing products and services" means presenting the most suitable products or services to the user based on the analysis results.

[1700] "Emotion recognition" refers to the process of understanding and analyzing a user's emotions from the text or audio they input.

[1701] "Detailed information" refers to information about the specific content and characteristics of the proposed product or service.

[1702] The "application process" is the process by which a user enters the necessary information to formally request the provision of the selected product or service, and then verifies that information.

[1703] "Required information" refers to the user's information and data that is requested to complete the application process.

[1704] "Verification" is the process of checking whether the entered data is accurate and confirming that there are no errors.

[1705] "Dining options" refer to specific dishes and food choices offered to the user, and are selected from a variety of menus and restaurants.

[1706] "System" refers to a configuration that includes a set of processes and functions designed to work together to solve user problems.

[1707] A system for carrying out this invention consists of a terminal, a server, and an emotion engine.

[1708] Overall system configuration

[1709] 1. Terminal: A device used by a user for input and operation, including smartphones, tablets, and computers.

[1710] 2. Server: This is the central part of the system that handles data processing and analysis, product and service proposals, and application procedures.

[1711] 3. Emotion Engine: This is a technology that recognizes the user's emotions and uses that information to suggest appropriate products and services.

[1712] Program Processing Overview

[1713] 1. Access to the user interface

[1714] Users access this system by launching a web browser or dedicated app using their smartphone or other device. The server receives the user's access request and displays a dynamically generated interface.

[1715] 2. User input of problems / issues

[1716] The user enters their problem into the text area of ​​the displayed interface and clicks the submit button. The server receives this input data.

[1717] 3. Emotion recognition by an emotion engine

[1718] The server sends the received text or audio data to the emotion engine. The emotion engine recognizes the user's emotions through text or audio analysis. The server receives the emotion analysis results from the emotion engine and continues the analysis.

[1719] 4. Analysis of problems and proposal of solutions

[1720] The server uses natural language processing technology to analyze the user's problems, combines this with emotional data obtained from the emotion engine, and generates and presents optimal product and service candidates to the user.

[1721] 5. Selecting and displaying details of products and services

[1722] The user clicks on a product or service from the presented list to see more details. The server retrieves the details of the selected product from the database and displays them to the user.

[1723] 6. Completion of application procedure

[1724] The user reviews the details and fills in the required information on the application form. The server receives the input data, validates it, and completes the application process.

[1725] Example of initial setup

[1726] This document provides specific examples of how to use the emotion-responsive food delivery app of this invention.

[1727] Specific example

[1728] For example, if a user enters "I'm really tired today," the following process will occur.

[1729] 1. Emotion engine analysis result: The server receives emotion data indicating "fatigue".

[1730] 2. Examples of proposed products:

[1731] Dishes using ingredients that have fatigue-relieving effects (e.g., grilled salmon, spinach and cheese lasagna, relaxing tea, etc.)

[1732] Popular healthy delivery menu items (e.g., salads, soups)

[1733] Technology used

[1734] 1. Hardware: Smartphones, servers

[1735] 2. Software: Flask (a Python web framework), natural language processing libraries (such as NLTK and spaCy), sentiment analysis models (BERT-based sentiment analysis models)

[1736] Example of a prompt

[1737] The user is feeling very tired, so please suggest some relaxing meal options. For example, display options such as grilled salmon, spinach and cheese lasagna, and relaxing tea.

[1738] In this way, it becomes possible to create a system that understands users' emotions and provides products and services that match them.

[1739] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1740] Step 1:

[1741] The terminal receives user input. The user enters their problems or issues into the terminal in text or voice. This input becomes the system's initial data. Examples of input data include "The internet is slow" or "I'm really tired today."

[1742] Step 2:

[1743] The server receives input data from the terminal. The input data is received as text or audio data. The server converts this data into an appropriate format for transmission to the emotion engine. Here, the input is the user's text or audio data, and the output is the converted result of that data.

[1744] Step 3:

[1745] The emotion engine analyzes the input data sent from the server. The emotion engine uses natural language processing techniques to recognize the user's emotions. Specifically, it performs emotion analysis using the BERT model. The input is text or audio data, and the output is user emotion data (e.g., "tired" or "frustrated").

[1746] Step 4:

[1747] The server receives emotion data obtained from the emotion engine. Based on this emotion data, it analyzes the user's problems and suggests appropriate products and services. Specifically, it uses natural language processing techniques to analyze problems and combines them with emotion data to generate optimal service candidates. The input is emotion data and problem data, and the output is a list of suggested products and services.

[1748] Step 5:

[1749] The terminal displays a list of suggested products and services to the user. The user clicks on a product or service from this list to view more information. The input is the list of suggested products, and the output is the detailed information of the product selected by the user.

[1750] Step 6:

[1751] The server retrieves detailed information about the product selected by the user from the database and sends it to the terminal. The specific operation involves database searching and information retrieval. The input is the user's selection information, and the output is the product details.

[1752] Step 7:

[1753] The terminal displays the detailed information to the user. The user enters the required information into the application form and clicks the submit button. The input consists of detailed information and application form data, and the output is a confirmation screen of the user's input.

[1754] Step 8:

[1755] The server receives the application data and performs validation. If validation is successful, the application process is completed and a confirmation email is sent. The specific actions are checking the integrity of the input data and sending the email. The input is the application data, and the output is the sending of the confirmation email.

[1756] This enables a series of operations, from suggesting products and services based on the user's emotions to completing the application process.

[1757] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1758] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1759] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1760] [Fourth Embodiment]

[1761] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1762] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1763] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1764] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1765] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1766] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1767] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1768] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1769] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1770] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1771] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1772] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1773] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1774] This invention is a system that allows users to input their own needs, receive suggestions for appropriate products and services based on those needs, and support them until they complete the application process. Specific embodiments for implementing this invention are described below.

[1775] Overall system configuration

[1776] This system consists of a server, terminals, and users. Terminals are devices that users use to access and operate the system, while the server is the central unit that handles data processing and analysis, product and service recommendations, and application procedures.

[1777] Program Processing Overview

[1778] 1. Access to the user interface

[1779] Device: The user launches a web browser or a dedicated app to access this system.

[1780] Server: Receives user access requests, dynamically generates and displays personal or corporate interfaces.

[1781] 2. User input of problems / issues

[1782] Terminal: The user enters their problem into the text area of ​​the displayed interface and clicks the send button.

[1783] Server: Receives the input data and starts the analysis.

[1784] 3. Analysis of problems and proposal of solutions

[1785] Server: Analyzes input problems using natural language processing techniques. For example, it extracts keywords using text mining techniques and understands their meaning.

[1786] Server: Based on the analysis results, it searches the database for suitable product and service candidates and generates a list.

[1787] Server: Present this list to the user and prompt them to make a selection.

[1788] 4. Select and view details of products and services.

[1789] Terminal: The user clicks on a product or service from the presented list to view more details.

[1790] Server: Retrieves detailed information about the selected product from the database and displays it to the user.

[1791] 5. Completion of application procedure

[1792] Terminal: The user enters the required information into a form to view details and submit an application.

[1793] Server: Receives the input data and performs validation.

[1794] Server: If validation is successful, complete the application process.

[1795] 6. Sending a confirmation email

[1796] Server: Confirms that the application process is complete and sends a confirmation email to the user.

[1797] Specific example

[1798] This explains what happens when an individual user enters a problem, such as "the internet is slow."

[1799] Access to the interface

[1800] Terminal: User A opens a web browser and accesses this system.

[1801] Server: Receives user access requests and displays a personalized interface.

[1802] Enter your problem

[1803] Terminal: User A types "The internet is slow" and clicks the send button.

[1804] Server: Receives input data and begins analysis.

[1805] Problem analysis and solution proposal

[1806] Server: The phrase "the internet is slow" is analyzed using a natural language processing engine, and related keywords (e.g., speed improvement, plan change) are extracted.

[1807] Server: Based on the analysis results, it generates a list of suitable product candidates, such as internet plan speed improvement services, and presents them to User A.

[1808] Select and view details of products and services.

[1809] Terminal: User A clicks on "Internet Speed ​​Improvement Plan".

[1810] Server: Retrieves detailed information about the selected product and displays it to the user.

[1811] Completion of application procedure

[1812] Terminal: User A enters required information such as name and address into the application form and clicks the submit button.

[1813] Server: Receives input data, performs validation, and completes the application process.

[1814] Sending a confirmation email

[1815] Server: Confirms that the application has been completed and sends a confirmation email to User A.

[1816] In this way, the system allows users to quickly and efficiently resolve their problems and easily apply for the most suitable products and services.

[1817] The following describes the processing flow.

[1818] Step 1:

[1819] Device: The user launches a web browser or a dedicated app to access this system.

[1820] Step 2:

[1821] Server: Receives user access requests, dynamically generates and displays personal or corporate interfaces.

[1822] Step 3:

[1823] Terminal: The interface is displayed, and a text area is provided for the user to enter their problem.

[1824] Step 4:

[1825] Terminal: The user enters their problem into the text area and clicks the send button.

[1826] Step 5:

[1827] Server: Receives user input data and starts text analysis using a natural language processing (NLP) engine.

[1828] Step 6:

[1829] Server: The NLP engine extracts keywords related to the input problem and analyzes the sentiment and context.

[1830] Step 7:

[1831] Server: Based on the analysis results, it searches the database for suitable product and service candidates and generates a list.

[1832] Step 8:

[1833] Server: Generates a list of products and services in HTML format and sends it to the client terminal.

[1834] Step 9:

[1835] Terminal: The terminal receives a list of suggested products and services from the user and displays it on the screen.

[1836] Step 10:

[1837] Terminal: The user clicks on the product or service they want to view details about.

[1838] Step 11:

[1839] Terminal: Sends a request to display details to the server.

[1840] Step 12:

[1841] Server: Retrieves detailed information about the selected product from the database, formats it in HTML format, and sends it to the client terminal.

[1842] Step 13:

[1843] Terminal: The screen displays detailed information about the product selected by the user.

[1844] Step 14:

[1845] Terminal: The user reviews the details and fills out the required information in the application form.

[1846] Step 15:

[1847] Terminal: The user clicks the complete button and sends the application request to the server.

[1848] Step 16:

[1849] Server: Receives the required information entered and performs validation.

[1850] Step 17:

[1851] Server: If validation is successful, complete the application process within the system.

[1852] Step 18:

[1853] Server: Generates confirmation information for the completion of the application process and sends it to the client terminal.

[1854] Step 19:

[1855] Terminal: The user receives a confirmation message that the application process is complete.

[1856] Step 20:

[1857] Server: After the application process is complete, a confirmation email will be sent to the user's registered email address.

[1858] The above outlines the specific processing steps from when a user enters their problem to when they select the appropriate product or service and complete the application.

[1859] (Example 1)

[1860] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1861] Traditionally, there have been few systems that appropriately analyze users' problems and propose effective products and services based on that analysis. Furthermore, there has been a lack of systems that display detailed information about the proposed products and services and smoothly guide users through the application process. As a result, it has been difficult for users to quickly and efficiently resolve their problems. This invention aims to provide a system that analyzes the problem content entered by the user using natural language processing technology, proposes appropriate products and services based on the analysis results, and allows users to easily complete the application process.

[1862] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1863] In this invention, the server includes means for receiving problem details from a terminal, performing analysis based on the entered problem details, and suggesting appropriate products and services; means for displaying detailed information selected by the user from the suggested products and services; means for receiving necessary information for the application procedure, confirming the entered information, and completing the application procedure; means for sending a confirmation email to the user when the application procedure is completed; and means for analyzing the entered problem details using natural language processing technology, generating a list of suggestions from a service database based on the analysis results, and presenting it to the user. This enables users to solve their problems quickly and efficiently and easily apply for appropriate products and services.

[1864] A "terminal" refers to a device such as a computer, smartphone, or tablet that a user uses for input and operation.

[1865] "Problem description" refers to the text information about the challenges or problems that the user enters into the input field.

[1866] "Analysis" is the process by which a server understands the received problem content using natural language processing technology and extracts relevant keywords and meanings.

[1867] "Product and service suggestions" refers to selecting and displaying a list of products and services that provide appropriate solutions to the user based on the analyzed problem.

[1868] "Detailed information" refers to additional information, features, and specifications that help users gain a deeper understanding of the proposed product or service.

[1869] The "application process" is the process by which a user enters the information necessary to actually use the selected product or service and formally completes the application.

[1870] A "confirmation email" is a notification email sent to a user upon completion of the application process.

[1871] "Natural language processing technology" refers to techniques that enable computers to understand, analyze, and generate human language, and includes methods such as text mining and keyword extraction.

[1872] A "service database" is a database containing information about products and services that the server accesses in order to generate a list of suggestions.

[1873] A "suggestion list" is a list of appropriate products and services that the server generates and presents to the user based on the analysis results.

[1874] This invention is a system that allows users to input their own needs, receive suggestions for appropriate products and services based on those needs, and support them until they complete the application process. Specific embodiments for implementing this invention are described below.

[1875] Overall system configuration

[1876] This system consists of a server, terminals, and users. Terminals are devices that users use to access and operate the system, while the server is the central unit that handles data processing and analysis, product and service proposals, and application procedures.

[1877] Program Processing Overview

[1878] Access to the user interface

[1879] Device: The user launches a web browser or a dedicated app to access this system.

[1880] Server: Receives user access requests, dynamically generates and displays personal or corporate interfaces.

[1881] User's problem entry

[1882] Terminal: The user enters their problem into the text area of ​​the displayed interface and clicks the send button.

[1883] Server: Receives the input data and starts the analysis.

[1884] Problem analysis and solution proposal

[1885] Server: Analyzes input problems using natural language processing techniques. For example, it extracts keywords using text mining techniques and understands their meaning.

[1886] Server: Based on the analysis results, it searches the database for suitable product and service candidates and generates a list.

[1887] Server: Present this list to the user and prompt them to make a selection.

[1888] Select and view details of products and services.

[1889] Terminal: The user clicks on a product or service from the presented list to view more details.

[1890] Server: Retrieves detailed information about the selected product from the database and displays it to the user.

[1891] Completion of application procedure

[1892] Terminal: The user enters the required information into a form to view details and submit an application.

[1893] Server: Receives the input data and performs validation.

[1894] Server: If validation is successful, complete the application process.

[1895] Sending a confirmation email

[1896] Server: Confirms that the application process is complete and sends a confirmation email to the user.

[1897] Hardware or software to use

[1898] This system uses the following specific hardware and software:

[1899] Server: Web server (e.g., Apache HTTP Server)

[1900] Devices: Computers, smartphones, tablets

[1901] Software: Natural language processing engines (e.g., Apache OpenNLP), database management systems (e.g., MySQL)

[1902] Specific example

[1903] This explains what happens when an individual user enters a problem, such as "the internet is slow."

[1904] Access to the interface

[1905] Terminal: User A opens a web browser and accesses this system.

[1906] Server: Receives user access requests and displays a personalized interface.

[1907] Enter your problem

[1908] Terminal: User A types "The internet is slow" and clicks the send button.

[1909] Server: Receives input data and begins analysis.

[1910] Problem analysis and solution proposal

[1911] Server: The phrase "the internet is slow" is analyzed using a natural language processing engine, and related keywords (e.g., speed improvement, plan change) are extracted.

[1912] Server: Based on the analysis results, it generates a list of suitable product candidates, such as internet plan speed improvement services, and presents them to User A.

[1913] Select and view details of products and services.

[1914] Terminal: User A clicks on "Internet Speed ​​Improvement Plan".

[1915] Server: Retrieves detailed information about the selected product and displays it to the user.

[1916] Completion of application procedure

[1917] Terminal: User A enters required information such as name and address into the application form and clicks the submit button.

[1918] Server: Receives input data, performs validation, and completes the application process.

[1919] Sending a confirmation email

[1920] Server: Confirms that the application has been completed and sends a confirmation email to User A.

[1921] This system is designed to provide users with quick and accurate solutions by combining natural language processing technology with database search. For example, by entering a prompt such as "Suggest services to improve internet speed when it's slow" into the generative AI model, an appropriate solution can be obtained.

[1922] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1923] Step 1: Accessing the user interface

[1924] User: Open a web browser and enter the URL of this system to access it.

[1925] Input: System URL

[1926] Output: Access Request

[1927] Server: Receives access requests and identifies whether the user is an individual or a legal entity.

[1928] Input: Access Request

[1929] Output: User type (individual or corporate)

[1930] Server: Dynamically generates the appropriate interface based on the user type, sends it to the terminal, and displays it.

[1931] Input: User Type

[1932] Output: Generated interface

[1933] Step 2: User input of problem details

[1934] Terminal: The user enters their problem in the text area of ​​the displayed interface and clicks the send button.

[1935] Input: Text of the problem

[1936] Output: Send Request

[1937] Server: Receives a transmission request and prepares the input data for analysis.

[1938] Input: Sending Request

[1939] Output: Data ready for analysis

[1940] Step 3: Problem analysis and solution proposal

[1941] Server: Starts the natural language processing engine and analyzes the problem text. For example, it extracts relevant keywords from the phrase "the internet is slow."

[1942] Input: Text of the problem

[1943] Data processing: Keyword extraction and semantic analysis using a natural language processing engine.

[1944] Output: Analysis results (keywords, etc.)

[1945] Server: Based on the analysis results, it searches the service database for appropriate products and services and generates a list of suggestions.

[1946] Input: Analysis results

[1947] Data processing: Database search

[1948] Output: Proposal List

[1949] Server: Presents a list of suggestions to the user.

[1950] Input: Proposal list

[1951] Output: Display of the suggestion list

[1952] Step 4: Select and view details of products and services.

[1953] User: Select and click on products or services of interest from the suggested list.

[1954] Input: Selected product or service

[1955] Output: Click Event

[1956] Server: Receives click events and retrieves detailed information about the corresponding product from the database.

[1957] Input: Click Event

[1958] Data processing: Information retrieval from databases

[1959] Output: Detailed information

[1960] Server: Displays detailed information to the user.

[1961] Input: Detailed information

[1962] Output: Detailed information display

[1963] Step 5: Completion of the application process

[1964] User: Review the details, fill in the required information (such as name and address) on the application form, and click the apply button.

[1965] Input: Application information (name, address, etc.)

[1966] Output: Application Request

[1967] Server: Receives application requests and validates the input data.

[1968] Input: Application Request

[1969] Data processing: validation

[1970] Output: Validation results

[1971] Server: If validation is successful, complete the application process.

[1972] Input: Validation result

[1973] Output: Application completion notification

[1974] Step 6: Sending a confirmation email

[1975] Server: Confirms that the application process is complete and sends a confirmation email to the user.

[1976] Input: Application completion notification

[1977] Output: Confirmation email sent

[1978] (Application Example 1)

[1979] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1980] Modern consumers want to quickly find products and services that meet their needs and concerns, and complete the purchase process easily and efficiently. However, currently, finding the right products and services often takes a lot of time and involves complicated procedures. This is especially true for online shopping, where selecting the right product from countless options is difficult and contributes to a poor user experience.

[1981] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1982] In this invention, the server includes means for receiving problem details from a terminal, performing analysis based on the entered problem details, and suggesting appropriate products and services; means for analyzing the input content using a natural language processing engine, generating a list of suggested products and presenting it to the user; and means for receiving necessary information for the application procedure, confirming the input content, and completing the application procedure. As a result, the user can receive prompt and appropriate suggestions for products and services that address their needs and problems, and complete the purchase procedure easily.

[1983] A "terminal" is a device used by a user to access and operate a system.

[1984] "Problem description" refers to text data in which the user enters their own worries or issues they want to solve.

[1985] "Performing analysis" refers to the process of understanding the input problem content using natural language processing technology and extracting relevant keywords.

[1986] "Means of proposing products and services" refers to a system function that searches a database for and presents suitable product and service candidates based on analyzed keywords.

[1987] A "suggestion list" is a list of products and services selected based on the user's input.

[1988] The "application process" is the process of entering and confirming the information necessary to complete the purchase of the selected product or service.

[1989] A "natural language processing engine" is a system component that analyzes user input and extracts meaning and keywords.

[1990] A "database" is an information aggregation system that stores information about the products and services being proposed.

[1991] A "confirmation email" is an email sent to a user to notify them that they have completed the application process.

[1992] An "application interface" is software that provides an interface for users to access and operate a system.

[1993] This invention is implemented as a "shopping assistant app" that users can use on their smartphones. By using this app, users can resolve their problems and concerns about products they want to buy, receive appropriate suggestions, and efficiently complete the purchase process.

[1994] Hardware and software to be used

[1995] Hardware: Smartphone (iOS or Android device)

[1996] software:

[1997] Smartphone app

[1998] Frontend: React Native, Flutter

[1999] Backend: Node.js, Django

[2000] Natural Language Processing Engine: Google Cloud Natural Language API

[2001] Database: MySQL

[2002] Email sending service: SendGrid API

[2003] Process Overview

[2004] 1. Access to the interface

[2005] When a user launches the smartphone app from their device, the server receives an access request and dynamically generates and displays an interface. This interface provides a text area where the user can enter their needs and concerns.

[2006] 2. Input and reception of problem details

[2007] When a user enters specific information about their problem or the product they want to buy into the interface's text area and presses the submit button, the device sends that data to the server. The server receives this data and begins preparing to pass it on to the natural language processing engine.

[2008] 3. Analysis using natural language processing

[2009] The server sends input data to a natural language processing engine, such as the Google Cloud Natural Language API, for analysis. The engine extracts keywords from the text and performs a process to understand their meaning.

[2010] 4. Generate a list of suggested products

[2011] The server searches the MySQL database for relevant products and services based on the analysis results obtained through natural language processing and generates a list of suggestions. By presenting this list to the user, the system enables the user to quickly find products and services that meet their needs.

[2012] 5. Displaying and selecting product details

[2013] When a user selects a specific product or service from the suggested list, the server retrieves its details from a MySQL database and displays them on the terminal. This allows the user to review the product details and consider purchasing it.

[2014] 6. Completion of the purchase procedure

[2015] When a user enters the required information into the purchase form and clicks the purchase button, the server receives the data and performs validation. If validation is successful, the server completes the purchase process.

[2016] 7. Sending a confirmation email

[2017] Once the application process is complete, the server uses an email sending service such as the SendGrid API to send a confirmation email to the user. This allows the user to confirm their purchase details.

[2018] Specific example

[2019] For example, if a user enters "I want to buy a refrigerator, but I'm not sure which one to get," the Google Cloud Natural Language API extracts keywords such as "refrigerator," "purchase," and "undecided." Based on these keywords, the server generates a list of suitable refrigerator suggestions and presents them to the user. The user can then view detailed information from the list and easily complete the purchase process from their smartphone.

[2020] Example of a prompt

[2021] An example of a text-based prompt is shown below:

[2022] "Input text describing a user's situation—that they are considering buying a refrigerator but are unsure which one to choose (e.g., 'I want to buy a refrigerator, but I'm not sure which one to get.')—provide the necessary analytical steps to design an application algorithm that extracts keywords using natural language processing and suggests appropriate products."

[2023] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[2024] Step 1:

[2025] A user launches a smartphone app. An access request is sent from the device to the server. The server receives the access request, dynamically generates a user interface, and displays it on the device. The input is the user's access request, and the output is the displayed user interface.

[2026] Step 2:

[2027] The user enters specific information about their problem or the product they want to purchase into the interface's text area and presses the submit button. The terminal then sends this input data to the server. The input is the user's text data, and the output is the transmission of text data to the server.

[2028] Step 3:

[2029] The server sends the received text data to the Google Cloud Natural Language API for analysis. The analysis involves extracting keywords from the text and understanding their meaning. The input is the user's text data, and the output is the analyzed keyword data.

[2030] Step 4:

[2031] The server searches a MySQL database based on the extracted keywords and generates a list of suggested products and services. This list is structured to include products and services that meet the user's needs. The input is keyword data, and the output is a list of suggested products.

[2032] Step 5:

[2033] The server sends the generated suggestion list to the terminal and presents it to the user. The user selects a specific product or service from the presented list. The input is the suggestion list, and the output is the product selection data.

[2034] Step 6:

[2035] To display detailed information about a product selected by the user from a suggestion list, the server retrieves the selected product details from a MySQL database and sends them to the terminal. The terminal then displays the detailed information. The input is the product selection data, and the output is the display of the detailed information.

[2036] Step 7:

[2037] The user reviews the details and fills in the required information on a form to proceed with the purchase. The device sends this data to the server. The input is the data entered on the purchase form, and the output is the transmission of the input data to the server.

[2038] Step 8:

[2039] The server validates the received purchase procedure data and completes the purchase if there are no problems. Validation includes a process to check whether the format and content of the input data are correct. The input is the purchase form data, and the output is the completion status of the purchase procedure.

[2040] Step 9:

[2041] The server generates a confirmation email after the purchase process is complete and sends it to the user using the SendGrid API. The input is data indicating the completion of the purchase process, and the output is the sending of the confirmation email.

[2042] Step 10:

[2043] The user receives a confirmation email on their device and confirms that the purchase is complete. The input is the confirmation email, and the output is the user's confirmation.

[2044] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[2045] This invention is a system that allows users to input their own needs, receive suggestions for appropriate products and services based on those needs, and support them until they complete the application process. Furthermore, this invention incorporates an emotion engine that recognizes the user's emotions and provides suggestions based on those emotions. The following describes specific embodiments for carrying out this invention.

[2046] Overall system configuration

[2047] This system consists of a server, terminals, and an emotion engine. The terminals are devices that users use to access and operate the system, while the server is the central unit that handles data processing and analysis, product and service recommendations, and application completion. The emotion engine is a technology that recognizes user emotions and uses that information to recommend appropriate products and services.

[2048] Program Processing Overview

[2049] 1. Access to the user interface

[2050] Device: The user launches a web browser or a dedicated app to access this system.

[2051] Server: Receives user access requests, dynamically generates and displays personal or corporate interfaces.

[2052] 2. User input of problems / issues

[2053] Terminal: The user enters their problem into the text area of ​​the displayed interface and clicks the send button.

[2054] Server: Receives the entered data.

[2055] 3. Emotion recognition by an emotion engine

[2056] Server: Sends the input text or audio data to the emotion engine.

[2057] Emotion Engine: Recognizes user emotions through text and voice analysis.

[2058] Server: Receives emotion analysis results from the emotion engine and performs further analysis based on that data.

[2059] 4. Analysis of problems and proposal of solutions

[2060] Server: Uses natural language processing technology to analyze problems, combines them with emotional data obtained from the emotion engine, and searches for the most suitable product or service candidates.

[2061] Server: Generates a list of products and services and presents it to the user.

[2062] 5. Selecting and displaying details of products and services

[2063] Terminal: The user clicks on a product or service from the presented list to view more details.

[2064] Server: Retrieves detailed information about the selected product from the database and displays it to the user.

[2065] 6. Completion of application procedure

[2066] Terminal: The user enters the required information into a form to view details and submit an application.

[2067] Server: Receives the input data and performs validation.

[2068] Server: If validation is successful, complete the application process.

[2069] 7. Sending a confirmation email

[2070] Server: Confirms that the application process is complete and sends a confirmation email to the user.

[2071] Specific example

[2072] This section explains a scenario where an individual user posts a complaint about slow internet speeds and expresses feelings of frustration and dissatisfaction.

[2073] Access to the interface

[2074] Terminal: User A opens a web browser and accesses this system.

[2075] Server: Receives user access requests and displays a personalized interface.

[2076] Input of problems and emotion recognition

[2077] Terminal: User A types "The internet is slow" and clicks the send button.

[2078] Server: Receives input data and sends it to the emotion engine.

[2079] Emotion Engine: Analyzes the input text and recognizes emotions such as "frustration" and "dissatisfaction."

[2080] Problem analysis and solution proposal

[2081] Server: Analyzes the user's problem and prioritizes suggesting quick solutions based on emotional data.

[2082] Server: Generates and presents suitable product options to user A, such as internet speed improvement services.

[2083] Select and view details of products and services.

[2084] Terminal: User A clicks on "Internet Speed ​​Improvement Plan".

[2085] Server: Retrieves detailed information about the selected product and displays it to the user.

[2086] Completion of application procedure

[2087] Terminal: User A enters required information such as name and address into the application form and clicks the submit button.

[2088] Server: Receives input data, performs validation, and completes the application process.

[2089] Sending a confirmation email

[2090] Server: Confirms that the application has been completed and sends a confirmation email to User A.

[2091] In this way, the system allows users to quickly and efficiently resolve their problems and easily apply for the most suitable products and services based on their emotions by utilizing an emotion engine.

[2092] The following describes the processing flow.

[2093] Step 1:

[2094] Device: The user launches a web browser or a dedicated app to access this system.

[2095] Step 2:

[2096] Server: Receives user access requests, dynamically generates and displays personal or corporate interfaces.

[2097] Step 3:

[2098] Terminal: The interface is displayed, and a text area is provided for the user to enter their problem.

[2099] Step 4:

[2100] Terminal: The user enters their problem into the text area and clicks the send button.

[2101] Step 5:

[2102] Server: Receives user input data and starts text analysis using a natural language processing (NLP) engine.

[2103] Step 6:

[2104] Server: Sends the input text data to the emotion engine.

[2105] Step 7:

[2106] Emotion Engine: Recognizes the user's emotions through text and voice analysis. For example, it can recognize the emotion of "frustration."

[2107] Step 8:

[2108] Server: Receives sentiment analysis results (e.g., "irritation") from the emotion engine.

[2109] Step 9:

[2110] Server: The NLP engine extracts keywords from the input problem and analyzes the sentiment and context. For example, it identifies keywords such as "internet" and "speed improvement."

[2111] Step 10:

[2112] Server: Based on text and sentiment analysis results, it searches the database for suitable product and service candidates and generates a list. If the sentiment is "frustrated," it prioritizes suggesting services that can provide a quick response.

[2113] Step 11:

[2114] Server: Generates a list of products and services in HTML format and sends it to the client terminal.

[2115] Step 12:

[2116] Terminal: The terminal receives a list of suggested products and services from the user and displays it on the screen.

[2117] Step 13:

[2118] Terminal: The user clicks on the product or service they want to view details about.

[2119] Step 14:

[2120] Terminal: Sends a request to display details to the server.

[2121] Step 15:

[2122] Server: Retrieves detailed information about the selected product from the database, formats it in HTML format, and sends it to the client terminal.

[2123] Step 16:

[2124] Terminal: The screen displays detailed information about the product selected by the user.

[2125] Step 17:

[2126] Terminal: The user reviews the details and fills out the required information in the application form.

[2127] Step 18:

[2128] Terminal: The user clicks the complete button and sends the application request to the server.

[2129] Step 19:

[2130] Server: Receives the required information entered and performs validation.

[2131] Step 20:

[2132] Server: If validation is successful, complete the application process within the system.

[2133] Step 21:

[2134] Server: Generates confirmation information for the completion of the application process and sends it to the client terminal.

[2135] Step 22:

[2136] Terminal: The user receives a confirmation message that the application process is complete.

[2137] Step 23:

[2138] Server: After the application process is complete, a confirmation email will be sent to the user's registered email address.

[2139] The above outlines the specific processing steps from when a user enters their problem to when they select the appropriate product or service and complete the application. By utilizing an emotion engine, it is possible to provide optimal suggestions tailored to the user's emotions and improve the user experience.

[2140] (Example 2)

[2141] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[2142] Traditional systems simply required users to input their problems and receive suggestions for appropriate products or services, failing to consider the user's emotional state. As a result, user dissatisfaction and stress were not alleviated, and the suggested products and services were not sufficiently effective. Furthermore, the application process was often complex and time-consuming, resulting in low user convenience.

[2143] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[2144] In this invention, the server includes means for inputting problem details from a terminal, performing analysis based on the input problem details, and proposing appropriate products and services; means for displaying detailed information selected by the user from the proposed products and services; means for inputting necessary information for the application procedure, confirming the input content, and completing the application procedure; and means for recognizing the user's emotions and proposing products and services based on those emotions. This makes it possible to propose the most suitable products considering the user's emotional state, and further improves the efficiency of the application procedure and enables quick resolution.

[2145] A "terminal" is a device used by a user to access and operate a system.

[2146] "Problem description" refers to the matter or issue that the user wants to solve, which they input into the system.

[2147] "Analysis" is the process of analyzing the input problem content and deriving appropriate products or services.

[2148] "Products and services" refer to specific products or support offered to solve users' problems.

[2149] "Suggestions" refer to the list of products or services presented to the user based on the analysis results.

[2150] "Detailed information" refers to more detailed descriptions and terms and conditions of the proposed product or service.

[2151] "Application process" refers to a series of operations and procedures that a user uses to formally apply for a product or service they have selected.

[2152] "Emotions" refer to the feelings and thoughts that the user is experiencing, and the system recognizes these.

[2153] "Emotion recognition" is the process of analyzing user input data and interpreting the user's emotions from it.

[2154] A "confirmation email" is an email sent to notify the user that the application process has been completed.

[2155] This invention is a system that allows users to input their own needs, receive suggestions for appropriate products and services based on those needs, and support them until they complete the application process. Furthermore, this invention incorporates an emotion engine that recognizes the user's emotions and provides suggestions based on those emotions.

[2156] System components

[2157] This system consists of a server, terminals, and an emotion engine. The terminals are devices that users use to access and operate the system, while the server is the central unit that handles data processing and analysis, product and service recommendations, and application completion. The emotion engine is a technology that recognizes the user's emotions and uses that information to recommend appropriate products and services.

[2158] Program Processing Overview

[2159] Access to the user interface

[2160] Device: Users access this system by launching a web browser or a dedicated app. Specifically, they access it by entering a URL or tapping the app icon.

[2161] Server: The server receives user access requests and dynamically generates and displays personal or corporate interfaces.

[2162] User's problem entry

[2163] Terminal: The user enters their problem into the text area of ​​the displayed interface and clicks the send button. Specifically, they might enter a problem such as "the internet is slow."

[2164] Server: The server receives data entered by the user and passes it to the analysis system.

[2165] Emotion recognition by an emotion engine

[2166] Server: The server sends the input text or audio data to the emotion engine. Specifically, it calls the text analysis API or the audio analysis API.

[2167] Emotion Engine: The emotion engine uses natural language processing technology to recognize the user's emotions. For example, it extracts emotions such as "frustration" or "dissatisfaction."

[2168] Server: The server receives the emotion analysis results obtained from the emotion engine and passes that data back to the analysis system.

[2169] Problem analysis and solution proposal

[2170] Server: The server uses natural language processing techniques to analyze problems and combines them with sentiment data to generate optimal product and service candidates. Specifically, it employs methods such as TF-IDF and Word2Vec.

[2171] Server: The server presents the user with a list of generated products and services. For example, it displays specific suggestions such as "Internet speed improvement plan" or "Wi-Fi router replacement."

[2172] Select and view details of products and services.

[2173] Terminal: The user clicks on the product or service they want to see more details about from the presented list. Specifically, they click on "Internet Speed ​​Improvement Plan".

[2174] Server: The server retrieves detailed information about the selected product from the database and displays it to the user. This information includes pricing, terms of service, and contract details.

[2175] Completion of application procedure

[2176] Terminal: The user reviews the details and fills in the required information on the application form. Specifically, they enter their name, address, contact information, etc., and click the "Apply" button.

[2177] Server: The server receives the input data and performs validation. For example, it checks if the format of the email address is correct.

[2178] Server: If validation is successful, save the application information to the database and send a notification to the relevant department.

[2179] Sending a confirmation email

[2180] Server: The server confirms that the application process is complete and calls the email sending API to send a confirmation email.

[2181] Specific example

[2182] The following is a specific example. It describes a case where an individual user enters a complaint about slow internet speeds and expresses feelings of frustration and dissatisfaction.

[2183] Access to the interface

[2184] Terminal: User A opens a web browser and accesses this system.

[2185] Server: The server receives user access requests and displays a personalized interface.

[2186] Input of problems and emotion recognition

[2187] Terminal: User A types "The internet is slow" and clicks the send button.

[2188] Server: The server receives input data and sends it to the emotion engine.

[2189] Emotion Engine: The emotion engine analyzes the input text and recognizes emotions such as "frustration" and "dissatisfaction."

[2190] Problem analysis and solution proposal

[2191] Server: The server analyzes the problem and prioritizes suggesting quick solutions that the user needs, based on sentiment data.

[2192] Server: Generates and presents suitable product options to user A, such as internet speed improvement services.

[2193] Select and view details of products and services.

[2194] Terminal: User A clicks on "Internet Speed ​​Improvement Plan".

[2195] Server: The server retrieves detailed information about the selected product and displays it to the user.

[2196] Completion of application procedure

[2197] Terminal: User A enters required information such as name and address into the application form and clicks the submit button.

[2198] Server: The server receives the input data, performs validation, and completes the application process.

[2199] Sending a confirmation email

[2200] Server: The server confirms that the application has been completed and sends a confirmation email to User A.

[2201] Example of a prompt

[2202] "My internet has been slow lately, and I want to increase the speed. What plans are available? It's really frustrating."

[2203] The flow of the specific processing in Example 2 will be explained using Figure 13.

[2204] Step 1: Accessing the user interface

[2205] Device: The user launches a web browser or a dedicated app to access the system.

[2206] Input: Enter a URL or tap the app icon.

[2207] Action: The user accesses https: / / example.com in a browser or taps the app icon.

[2208] Output: An access request is sent to the server.

[2209] Server: The server dynamically generates and displays either a personal or corporate interface in response to user access requests.

[2210] Input: Access request.

[2211] Operation: The server generates a personalized interface and responds in HTML format.

[2212] Output: A personalized dashboard and consultation form are displayed on the device.

[2213] Step 2: User input of problem details

[2214] Terminal: The user enters their problem into the text area of ​​the displayed interface and clicks the send button.

[2215] Input: Enter text such as "The internet is slow."

[2216] Operation: The user enters their problem and clicks the submit button.

[2217] Output: Input data is sent to the server in JSON format.

[2218] Server: The server receives data entered by the user and passes it to the analysis system.

[2219] Input: Input data in JSON format.

[2220] Operation: Prepares the input data for transfer to the analysis system.

[2221] Output: The data is passed to the analysis system.

[2222] Step 3: Emotion recognition by the emotion engine

[2223] Server: The server sends the input text or audio data to the emotion engine.

[2224] Input: User's text input data.

[2225] Operation: Calls text analysis APIs and speech analysis APIs.

[2226] Output: Input data is sent to the emotion engine.

[2227] Emotion Engine: The emotion engine uses natural language processing technology to recognize the user's emotions.

[2228] Input: Text or audio data.

[2229] Operation: Executes an emotion recognition algorithm to detect "irritation" and "dissatisfaction."

[2230] Output: Sentiment analysis results are generated.

[2231] Server: The server receives the emotion analysis results obtained from the emotion engine and passes that data back to the analysis system.

[2232] Input: Sentiment analysis results.

[2233] Operation: Searches for relevant suggestions in an SQL database based on sentiment data.

[2234] Output: Emotional data is passed to the analysis system.

[2235] Step 4: Problem analysis and solution proposal

[2236] Server: The server uses natural language processing technology to analyze problems and combines them with sentiment data to generate optimal product and service candidates.

[2237] Input: Text input data and sentiment analysis results.

[2238] Operation: Analyzes text using methods such as TF-IDF and Word2Vec.

[2239] Output: A list of optimal product and service candidates is generated.

[2240] Server: The server presents the user with a list of generated products and services.

[2241] Input: A list of potential products or services.

[2242] Operation: Displays the list as an HTML page.

[2243] Output: A list of claimed goods and services is displayed on the terminal.

[2244] Step 5: Select and view details of products and services.

[2245] Terminal: The user clicks on a product or service from the presented list to view more details.

[2246] Input: Selection of specific products or services.

[2247] Action: The user clicks on "Internet Speed ​​Improvement Plan".

[2248] Output: The selection information is sent to the server.

[2249] Server: The server retrieves detailed information about the selected product from the database and displays it to the user.

[2250] Input: The ID of the selected product or service.

[2251] Operation: Retrieves detailed information from the database and returns it to the terminal in HTML format.

[2252] Output: Detailed information (e.g., price, terms and conditions, contract method) will be displayed on the device.

[2253] Step 6: Completion of the application process

[2254] Terminal: Users review detailed information and fill out the required fields in the application form.

[2255] Input: Application information such as name, address, and contact information.

[2256] Action: The user clicks the "Apply" button.

[2257] Output: Application information is sent to the server.

[2258] Server: The server receives the input data and performs validation.

[2259] Input: User application data.

[2260] Function: Data format check and validation.

[2261] Output: Validation success or failure result.

[2262] Server: If validation is successful, save the application information to the database and send a notification to the relevant department.

[2263] Input: Validated application data.

[2264] Operation: Saves to the database and sends a notification.

[2265] Output: Application process complete.

[2266] Step 7: Sending a confirmation email

[2267] Server: The server confirms that the application process is complete and calls the email sending API to send a confirmation email.

[2268] Input: Application completion information and user's email address.

[2269] Operation: Sends a confirmation email using an email sending API (e.g., SendGrid or Amazon SES).

[2270] Output: The user receives a confirmation email.

[2271] (Application Example 2)

[2272] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[2273] Traditional food delivery systems have struggled to offer products and services that address users' emotions and specific needs. Furthermore, there is a growing demand for services that provide higher satisfaction by offering suggestions based on user emotions. Therefore, it is necessary to develop a system that analyzes user input and then makes appropriate suggestions that take user emotions into account.

[2274] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[2275] In this invention, the server includes means for inputting problem details from a terminal, performing analysis based on the input problem details, and suggesting appropriate products or services; means for recognizing the user's emotions and suggesting products or services based on those emotions; means for displaying detailed information of the products or services selected by the user from the suggested products or services; means for inputting necessary information for the application procedure, confirming the input, and completing the application procedure; and means for suggesting specific meal options. This makes it possible to suggest products and services based on the user's emotions.

[2276] A "terminal" is a device used by a user for input and operation, and includes smartphones, tablets, and computers.

[2277] "Problem description" refers to the issues or problems that the user wants to solve, and is provided in the form of text or audio data.

[2278] "Analysis" is the process of analyzing the input problem content and then proposing appropriate products or services based on that analysis.

[2279] "Proposing products and services" means presenting the most suitable products or services to the user based on the analysis results.

[2280] "Emotion recognition" refers to the process of understanding and analyzing a user's emotions from the text or audio they input.

[2281] "Detailed information" refers to information about the specific content and characteristics of the proposed product or service.

[2282] The "application process" is the process by which a user enters the necessary information to formally request the provision of the selected product or service, and then verifies that information.

[2283] "Required information" refers to the user's information and data that is requested to complete the application process.

[2284] "Verification" is the process of checking whether the entered data is accurate and confirming that there are no errors.

[2285] "Dining options" refer to specific dishes and food choices offered to the user, and are selected from a variety of menus and restaurants.

[2286] "System" refers to a configuration that includes a set of processes and functions designed to work together to solve user problems.

[2287] A system for carrying out this invention consists of a terminal, a server, and an emotion engine.

[2288] Overall system configuration

[2289] 1. Terminal: A device used by a user for input and operation, including smartphones, tablets, and computers.

[2290] 2. Server: This is the central part of the system that handles data processing and analysis, product and service proposals, and application procedures.

[2291] 3. Emotion Engine: This is a technology that recognizes the user's emotions and uses that information to suggest appropriate products and services.

[2292] Program Processing Overview

[2293] 1. Access to the user interface

[2294] Users access this system by launching a web browser or dedicated app using their smartphone or other device. The server receives the user's access request and displays a dynamically generated interface.

[2295] 2. User input of problems / issues

[2296] The user enters their problem into the text area of ​​the displayed interface and clicks the submit button. The server receives this input data.

[2297] 3. Emotion recognition by an emotion engine

[2298] The server sends the received text or audio data to the emotion engine. The emotion engine recognizes the user's emotions through text or audio analysis. The server receives the emotion analysis results from the emotion engine and continues the analysis.

[2299] 4. Analysis of problems and proposal of solutions

[2300] The server uses natural language processing technology to analyze the user's problems, combines this with emotional data obtained from the emotion engine, and generates and presents optimal product and service candidates to the user.

[2301] 5. Selecting and displaying details of products and services

[2302] The user clicks on a product or service from the presented list to see more details. The server retrieves the details of the selected product from the database and displays them to the user.

[2303] 6. Completion of application procedure

[2304] The user reviews the details and fills in the required information on the application form. The server receives the input data, validates it, and completes the application process.

[2305] Example of initial setup

[2306] This document provides specific examples of how to use the emotion-responsive food delivery app of this invention.

[2307] Specific example

[2308] For example, if a user enters "I'm really tired today," the following process will occur.

[2309] 1. Emotion engine analysis result: The server receives emotion data indicating "fatigue".

[2310] 2. Examples of proposed products:

[2311] Dishes using ingredients that have fatigue-relieving effects (e.g., grilled salmon, spinach and cheese lasagna, relaxing tea, etc.)

[2312] Popular healthy delivery menu items (e.g., salads, soups)

[2313] Technology used

[2314] 1. Hardware: Smartphones, servers

[2315] 2. Software: Flask (a Python web framework), natural language processing libraries (such as NLTK and spaCy), sentiment analysis models (BERT-based sentiment analysis models)

[2316] Example of a prompt

[2317] The user is feeling very tired, so please suggest some relaxing meal options. For example, display options such as grilled salmon, spinach and cheese lasagna, and relaxing tea.

[2318] In this way, it becomes possible to create a system that understands users' emotions and provides products and services that match them.

[2319] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[2320] Step 1:

[2321] The terminal receives user input. The user enters their problems or issues into the terminal in text or voice. This input becomes the system's initial data. Examples of input data include "The internet is slow" or "I'm really tired today."

[2322] Step 2:

[2323] The server receives input data from the terminal. The input data is received as text or audio data. The server converts this data into an appropriate format for transmission to the emotion engine. Here, the input is the user's text or audio data, and the output is the converted result of that data.

[2324] Step 3:

[2325] The emotion engine analyzes the input data sent from the server. The emotion engine uses natural language processing techniques to recognize the user's emotions. Specifically, it performs emotion analysis using the BERT model. The input is text or audio data, and the output is user emotion data (e.g., "tired" or "frustrated").

[2326] Step 4:

[2327] The server receives emotion data obtained from the emotion engine. Based on this emotion data, it analyzes the user's problems and suggests appropriate products and services. Specifically, it uses natural language processing techniques to analyze problems and combines them with emotion data to generate optimal service candidates. The input is emotion data and problem data, and the output is a list of suggested products and services.

[2328] Step 5:

[2329] The terminal displays a list of suggested products and services to the user. The user clicks on a product or service from this list to view more information. The input is the list of suggested products, and the output is the detailed information of the product selected by the user.

[2330] Step 6:

[2331] The server retrieves detailed information about the product selected by the user from the database and sends it to the terminal. The specific operation involves database searching and information retrieval. The input is the user's selection information, and the output is the product details.

[2332] Step 7:

[2333] The terminal displays the detailed information to the user. The user enters the required information into the application form and clicks the submit button. The input consists of detailed information and application form data, and the output is a confirmation screen of the user's input.

[2334] Step 8:

[2335] The server receives the application data and performs validation. If validation is successful, the application process is completed and a confirmation email is sent. The specific actions are checking the integrity of the input data and sending the email. The input is the application data, and the output is the sending of the confirmation email.

[2336] This enables a series of operations, from suggesting products and services based on the user's emotions to completing the application process.

[2337] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[2338] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2339] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[2340] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2341] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[2342] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[2343] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[2344] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[2345] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[2346] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[2347] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[2348] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[2349] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[2350] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2351] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[2352] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[2353] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[2354] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[2355] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[2356] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[2357] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference.

[2358] The following is further disclosed regarding the embodiments described above.

[2359] (Claim 1)

[2360] A method for inputting problem details from a terminal, performing analysis based on the input details, and proposing appropriate products or services,

[2361] A means for displaying detailed information selected by the user from among the proposed products and services,

[2362] A means of entering the necessary information for the application process, confirming the entered information, and completing the application process.

[2363] A system that includes this.

[2364] (Claim 2)

[2365] The system according to claim 1, which analyzes the input of the aforementioned problem content using natural language processing technology and proposes products or services based on the analysis results.

[2366] (Claim 3)

[2367] The system according to claim 1, further comprising means for sending a confirmation email to the user upon completion of the aforementioned application procedure.

[2368] "Example 1"

[2369] (Claim 1)

[2370] A method for inputting problem details from a terminal, performing analysis based on the input details, and proposing appropriate products or services,

[2371] A means for displaying detailed information selected by the user from among the proposed products and services,

[2372] A means of entering the necessary information for the application process, confirming the entered information, and completing the application process.

[2373] A means of sending a confirmation email to the user upon completion of the aforementioned application procedure,

[2374] A means of analyzing the input problem content using natural language processing technology, generating a list of suggestions from a service database based on the analysis results, and presenting them to the user,

[2375] A system that includes this.

[2376] (Claim 2)

[2377] The system according to claim 1, which analyzes the input of the aforementioned problem content using natural language processing technology and proposes products or services based on the analysis results.

[2378] (Claim 3)

[2379] The system according to claim 1, further comprising means for displaying detailed information of products or services selected by the user from the aforementioned proposal list and for inputting necessary information for the application process.

[2380] "Application Example 1"

[2381] (Claim 1)

[2382] A method for inputting problem details from a terminal, performing analysis based on the input details, and proposing appropriate products or services,

[2383] A means for displaying detailed information selected by the user from among the proposed products and services,

[2384] A means of entering the necessary information for the application process, confirming the entered information, and completing the application process.

[2385] A method for analyzing input content using a natural language processing engine, generating a list of suggested products, and presenting it to the user,

[2386] A means of retrieving and displaying detailed information of the product selected by the user from the database,

[2387] A method for sending a confirmation email to the user upon completion of the purchase process,

[2388] A means of assisting users in making purchases through an application interface,

[2389] A system that includes this.

[2390] (Claim 2)

[2391] The system according to claim 1, which includes means for analyzing the input of the aforementioned problem content using natural language processing technology and proposing products or services based on the analysis results.

[2392] (Claim 3)

[2393] The system according to claim 1, further comprising means for sending a confirmation email to the user upon completion of the aforementioned application procedure.

[2394] "Example 2 of combining an emotion engine"

[2395] (Claim 1)

[2396] A method for inputting problem details from a terminal, performing analysis based on the input details, and proposing appropriate products or services,

[2397] A means for displaying detailed information selected by the user from among the proposed products and services,

[2398] A means of entering the necessary information for the application process, confir...

Claims

1. A method for inputting problem details from a terminal, performing analysis based on the input details, and proposing appropriate products or services, A means for displaying detailed information selected by the user from among the proposed products and services, A means of entering the necessary information for the application process, confirming the entered information, and completing the application process. A system that includes this.

2. The system according to claim 1, which analyzes the input of the aforementioned problem content using natural language processing technology and proposes products or services based on the analysis results.

3. The system according to claim 1, further comprising means for sending a confirmation email to the user when the application procedure is completed.

Images