System

The system addresses user challenges in service account management by providing intelligent service recommendations, summaries of terms, secure data storage, and streamlined cancellation processes, improving user experience.

JP2026023356APending Publication Date: 2026-02-13SOFTBANK GROUP CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024125291
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-07-31
Publication Date
2026-02-13

AI Technical Summary

Technical Problem

Users face challenges in managing multiple service accounts, including difficulty in selecting the best service, understanding lengthy terms of use, remembering passwords, and navigating complex cancellation processes.

Method used

A system that includes input means for category selection, extraction means for service information, comparison means for evaluation, presentation means for recommendations, acquisition means for membership terms, natural language processing for summaries, storage means for registration information, and checking means for periodic feedback and cancellation support.

Benefits of technology

The system simplifies service management by recommending suitable services, summarizing terms, securely managing registration data, and assisting with cancellations, thereby enhancing user convenience and efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026023356000001_ABST
    Figure 2026023356000001_ABST
Patent Text Reader

Abstract

A system is provided.SOLUTION: A system comprising: input means for inputting a category of a service desired by a user; extraction means for extracting similar service information from a database based on category information input via the input means; comparison means for comparing similar services extracted by the extraction means using an evaluation algorithm; and presentation means for presenting a recommended service based on a comparison result by the comparison means.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In today's world, many users have to sign up for various services and manage multiple accounts, which can lead to the following issues:

[0005] One is that there are so many similar services that it's hard to know which one is best.

[0006] Second, the service's terms of use are lengthy and difficult to understand, making it difficult to quickly understand the key points.

[0007] Furthermore, users may forget their passwords or membership registration status, and managing multiple accounts can be cumbersome.

[0008] Finally, the cancellation process is complicated, and you may miss the cancellation deadline.

[0009] To solve these problems, a user-friendly and efficient system is required. [Means for solving the problem]

[0010] In order to solve the above problems, the present invention provides the following means.

[0011] First, a system is provided that includes an input means for a user to input a desired service category, an extraction means for extracting similar service information from a database based on the input category information, a comparison means for comparing the extracted similar services using an evaluation algorithm, and a presentation means for presenting recommended services based on the comparison results.

[0012] Furthermore, the present invention provides an acquisition means for acquiring text data of the membership terms and conditions of the service designated by the user, a natural language processing means for analyzing the acquired text data and extracting important points, and a presentation means for presenting the extracted important points to the user as a summary.

[0013] The system also includes an input means for inputting registration information that is input when a user registers for a new service, a storage means for encrypting and storing the input registration information, and a check means for periodically checking the stored registration information and providing feedback to the user.

[0014] In this way, it is possible to improve convenience for users and simplify complex service management.

[0015] "Input means" refers to an interface or device for inputting desired information by the user.

[0016] "Extraction means" refers to a function or device that extracts necessary data from a database based on input information.

[0017] A "comparison means" is a function or device that analyzes and evaluates extracted data using a certain algorithm.

[0018] "Presentation means" refers to an interface or device for displaying the comparison results and important information to the user.

[0019] "Acquisition means" refers to the functions or devices for collecting necessary data from a specific information source.

[0020] "Natural language processing means" refers to technology or devices for analyzing text data and extracting important points.

[0021] "Storage means" refers to a function or device for storing user registration information and passwords.

[0022] "Checking means" refers to a function or device that periodically checks stored information and provides appropriate alerts or feedback. [Brief explanation of the drawings]

[0023] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0024] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0025] First, the terms used in the following description will be explained.

[0026] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0027] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0028] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0029] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0030] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0031] [First embodiment]

[0032] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0033] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0034] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0035] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0036] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0037] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0038] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0039] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0040] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0041] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0042] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0043] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0044] MODE FOR CARRYING OUT THE INVENTION

[0045] Recommended features of the service

[0046] overview

[0047] In this invention, a system is constructed in which a user inputs the category of a desired service, and the server compares and evaluates similar services and presents recommended services.

[0048] Program processing

[0049] 1. The user's terminal displays an interface for inputting service category information.

[0050] 2. The user enters the category information of the desired service and submits it.

[0051] 3. The server receives the input category information and extracts related service information from the database based on that information.

[0052] 4. The server evaluates the extracted services based on price, features, user reviews, etc., and selects the most suitable service using a comparison algorithm.

[0053] 5. The server sends the selected recommended services to the user's device.

[0054] 6. The user's device will display the recommended services for the user to review.

[0055] Specific examples

[0056] For example, if a user requests a "video streaming service," the server extracts service information from Netflix, Hulu, Amazon Prime Video, etc., and compares them based on their prices, features, and user reviews. Using a comparison algorithm, the server selects Netflix as the optimal service and presents that information to the user.

[0057] Membership terms summary function

[0058] overview

[0059] To provide a system in which a server extracts important points of a membership agreement and presents them in a summary form so that a user can efficiently understand the membership agreement of a service.

[0060] Program processing

[0061] 1. The user's device displays an interface for obtaining the URL of the service's membership terms page.

[0062] 2. The user enters the URL of the membership terms page and submits it.

[0063] 3. The server retrieves the text data of the membership terms page based on the entered URL.

[0064] 4. The server analyzes the text data using a natural language processing engine and extracts important points.

[0065] 5. The server generates a summary of the extracted points and sends it to the user's device.

[0066] 6. The user's device displays a summary of the membership terms and conditions for the user to review.

[0067] Specific examples

[0068] For example, if a user is trying to sign up for a new video streaming service, they can submit the URL of the membership terms and conditions, and the server will extract important points such as "automatic renewal," "how to cancel," and "price changes" and provide a summary to the user.

[0069] Membership registration status and password management function

[0070] overview

[0071] The system aims to securely manage users' membership registration information and passwords and provide regular feedback.

[0072] Program processing

[0073] 1. The user's device displays a form for registering for the service.

[0074] 2. The user enters the required registration information (username, email address, password, etc.) and submits it.

[0075] 3. The server receives the entered information, encrypts it, and stores it in a database.

[0076] 4. The server periodically scans the database to check the status of registration information and passwords.

[0077] 5. The server sends the user a password change alert and a registration status list as needed.

[0078] 6. The user's device displays the feedback for the user to review.

[0079] Specific examples

[0080] For example, if a user registers for service A and then later registers for service B, the server will encrypt and store both registration information and passwords, and periodically send the user alerts about their registration status and password management.

[0081] Cancellation procedure support function

[0082] overview

[0083] To provide a system that simplifies the procedure for a user to cancel a service and prevents the user from missing the cancellation deadline.

[0084] Program processing

[0085] 1. The user's device displays an interface for selecting the service they wish to cancel.

[0086] 2. The user selects the service they wish to cancel and submits it.

[0087] 3. The server retrieves information about the cancellation procedure from the database.

[0088] 4. The server generates forms and instructions to simplify the cancellation process.

[0089] 5. The server automatically fills in the cancellation form and sends it to the user's device.

[0090] 6. The user's device will display an automatically filled-in cancellation form, making the cancellation process easy.

[0091] 7. The server checks the progress of the cancellation procedure and sends a completion notification to the user's device.

[0092] 8. The user's device will display the completion status of the cancellation procedure so that the user can check it.

[0093] Specific examples

[0094] For example, if a user wants to cancel a video streaming service, the server retrieves the necessary cancellation procedures from the database and automatically generates a form to provide to the user. The user can complete the cancellation procedure with just a few clicks, and a notification is sent before the cancellation deadline to prevent the user from forgetting to cancel.

[0095] As described above, the system of the present invention provides a wide range of functions to improve user convenience.

[0096] The processing flow will be explained below.

[0097] Recommended features of the service

[0098] overview

[0099] In this invention, a system is constructed in which a user inputs the category of a desired service, and the server compares and evaluates similar services and presents recommended services.

[0100] Program processing

[0101] Step 1:

[0102] The user's terminal displays a form interface to allow the user to input the service category information.

[0103] Step 2:

[0104] The user inputs the category information of the desired service and presses the send button.

[0105] Step 3:

[0106] The server analyzes the category information received from the user.

[0107] Step 4:

[0108] The server extracts the service information for the relevant category from the database.

[0109] Step 5:

[0110] The server rates the extracted services based on criteria such as price, features, and user reviews.

[0111] Step 6:

[0112] The server compares the services using a rating algorithm and generates a list of the best services.

[0113] Step 7:

[0114] The server transmits recommended service information to the user's terminal.

[0115] Step 8:

[0116] The user's device will display a list of recommended services for the user to review.

[0117] Membership terms summary function

[0118] overview

[0119] To provide a system in which a server extracts important points of a membership agreement and presents them in a summary form so that a user can efficiently understand the membership agreement of a service.

[0120] Program processing

[0121] Step 1:

[0122] The user's terminal displays an interface for entering the URL of the membership agreement.

[0123] Step 2:

[0124] The user enters the URL for the membership agreement and submits it.

[0125] Step 3:

[0126] The server retrieves the text data of the membership agreement page based on the entered URL.

[0127] Step 4:

[0128] The server analyzes the acquired text data using a natural language processing engine.

[0129] Step 5:

[0130] The server extracts important points from the text data.

[0131] Step 6:

[0132] The server generates a summary of the extracted points.

[0133] Step 7:

[0134] The server transmits the generated summary to the user's terminal.

[0135] Step 8:

[0136] The user's terminal displays the summarized membership terms and conditions for the user to review.

[0137] Membership registration status and password management function

[0138] overview

[0139] The system aims to securely manage users' membership registration information and passwords and provide regular feedback.

[0140] Program processing

[0141] Step 1:

[0142] The user's device displays a form for registering for the service.

[0143] Step 2:

[0144] The user enters the required registration information (user name, email address, password, etc.) and submits it.

[0145] Step 3:

[0146] The server receives the entered registration information, encrypts it, and stores it in a database.

[0147] Step 4:

[0148] The server periodically scans the database to check the status of registration information and passwords.

[0149] Step 5:

[0150] The server sends the user password change alerts and registration status lists as needed.

[0151] Step 6:

[0152] The user's terminal displays the feedback for the user to review.

[0153] Cancellation procedure support function

[0154] overview

[0155] To provide a system that simplifies the procedure for a user to cancel a service and prevents the user from missing the cancellation deadline.

[0156] Program processing

[0157] Step 1:

[0158] The user's terminal displays an interface for selecting the service the user wishes to cancel.

[0159] Step 2:

[0160] The user selects the service they wish to cancel and submits it.

[0161] Step 3:

[0162] The server retrieves information about the cancellation procedure for the relevant service from the database.

[0163] Step 4:

[0164] The server generates forms and instructions to simplify the cancellation process.

[0165] Step 5:

[0166] The server sends a cancellation form with auto-filled information to the user's device.

[0167] Step 6:

[0168] The user's device will display a simplified cancellation form, which the user will fill out and submit.

[0169] Step 7:

[0170] The server checks the progress of the cancellation procedure and sends a completion notice to the user's terminal.

[0171] Step 8:

[0172] The user's terminal displays the completion status of the cancellation procedure so that the user can check it.

[0173] Example 1

[0174] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0175] Today's service users must choose the most suitable service from a wide variety of options, but this selection process often requires time and effort. Understanding service membership terms and conditions can be difficult, putting users at risk of overlooking important information. Furthermore, managing registration information and canceling service subscriptions can be complicated, placing a burden on users. A system that can solve these problems and improve user convenience is needed.

[0176] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0177] In this invention, the server includes an input means for inputting a category of a service desired by a user, an extraction means for extracting similar service information from a database based on the category information input via the input means, a comparison means for evaluating the similar services extracted by the extraction means based on price, function, user reviews, etc., and selecting the most suitable service using a comparison algorithm, a presentation means for presenting recommended services based on the selection result by the comparison means, an acquisition means for acquiring a URL of the membership terms of the service designated by the user, a natural language processing means for extracting and analyzing text data from the URL acquired by the acquisition means, and a weighting factor analysis means for analyzing the weighting factor extracted by the natural language processing means. The system includes a presentation means for presenting a summary of key points to the user, an input means for inputting registration information to be input when the user registers for a new service, a storage means for encrypting and storing the registration information input by the input means, a check means for periodically checking the registration information stored in the storage means and providing feedback to the user, an input means for selecting a service the user wishes to cancel, an acquisition means for acquiring information on cancellation procedures for the service selected via the input means from a database, a generation means for generating a form and procedure for the cancellation procedure based on the information acquired by the acquisition means, and a presentation means for providing the user with the cancellation procedure information generated by the generation means. This enables the user to easily select the most suitable service, efficiently understand the service's membership terms and conditions, safely manage registration information, and quickly complete the cancellation procedure.

[0178] The "input means" is a means for providing an interface for the user to input desired information and categories.

[0179] The "extraction means" is a means for searching and acquiring related data from a database based on information input via the input means.

[0180] The "comparison means" is a means for comparing the data obtained by the extraction means based on multiple evaluation criteria such as price, functionality, and user reviews, and using an algorithm to select the optimal option.

[0181] The "presentation means" is a means for displaying the information and results obtained by the comparison means, analysis means, and generation means in an easy-to-understand manner for the user.

[0182] "Means of acquisition" refers to the means for acquiring the necessary information from a specified URL or data source.

[0183] "Natural language processing means" refers to means that uses natural language processing techniques to analyze acquired text data and extract important information.

[0184] "Storage means" refers to a means for securely encrypting and storing input information.

[0185] The "checking means" is a means for periodically checking the information stored by the storage means and providing necessary feedback to the user.

[0186] "Generation means" refers to a means for automatically generating forms and procedures based on acquired data and information.

[0187] MODE FOR CARRYING OUT THE INVENTION

[0188] Recommended features of the service

[0189] In this system, a user inputs category information of a desired service, and a process is executed to recommend the most suitable service.

[0190] Hardware and software configuration:

[0191] User devices: PCs, smartphones, tablets, etc. Using a web browser or dedicated application.

[0192] Server: A powerful server machine with web server software (Apache, Nginx, etc.) and database management system (MySQL, PostgreSQL, etc.).

[0193] Natural language processing engines: Scikit-learn, TensorFlow, NLTK, SpaCy, etc.

[0194] Interface: Web forms using HTML, CSS and JavaScript.

[0195] Examples:

[0196] For example, if a user wishes to search for a "video streaming service," the user enters category information and clicks the submit button. The user's device sends the information to the server, which extracts similar services from a database, evaluates them based on price, features, user reviews, etc., and uses a comparison algorithm to select the most suitable service. If Netflix is ​​recommended as a result of the selection, that information is displayed on the user's device. Example prompt: "Please recommend a video streaming service."

[0197] Membership terms summary function

[0198] This system provides a summary of the important points of the membership terms of the service specified by the user so that the user can efficiently understand the terms.

[0199] Hardware and software configuration:

[0200] User devices: PCs, smartphones, tablets, etc. Using a web browser or dedicated application.

[0201] Server: A high-performance server machine with web server software (Apache, Nginx, etc.).

[0202] Natural language processing engines: BeautifulSoup, Requests, NLTK, SpaCy, etc.

[0203] Examples:

[0204] For example, if a user is trying to sign up for a new video streaming service, they enter the URL of the membership terms and conditions page into the input form and click the submit button. The server retrieves the text data from the specified URL and analyzes it using a natural language processing engine. Important points such as "automatic renewal," "how to cancel," and "price changes" are extracted and presented to the user as a summary. An example of a prompt sentence: "Please tell me a summary of the membership terms and conditions for this video streaming service."

[0205] Membership registration status and password management function

[0206] This system has the function of safely managing users' membership registration information and passwords and providing feedback.

[0207] Hardware and software configuration:

[0208] User devices: PCs, smartphones, tablets, etc. Using a web browser or dedicated application.

[0209] Server: A high-performance server machine, including web server software (Apache, Nginx, etc.) and database management system (MongoDB, etc.).

[0210] Cryptography library: OpenSSL, bcrypt, etc.

[0211] Examples:

[0212] For example, if a user registers for service A and then later registers for service B, both registration information and passwords are encrypted and stored on the server. The database is periodically scanned to check the status of registration information and passwords, and an alert is sent to the user. An example prompt is: "Please check the services that manage my membership status and password."

[0213] Cancellation procedure support function

[0214] This system simplifies the process for users to cancel their service and helps them avoid missing the cancellation deadline.

[0215] Hardware and software configuration:

[0216] User devices: PCs, smartphones, tablets, etc. Using a web browser or dedicated application.

[0217] Server: A high-performance server machine, web server software (Apache, Nginx, etc.), and database management system.

[0218] RPA tools: UiPath, etc.

[0219] Examples:

[0220] For example, if a user wants to cancel a video streaming service, they select the service they wish to cancel and click the submit button. The server collects the information necessary for cancellation and generates a form and procedure for the cancellation procedure. The automatically filled-in cancellation form is displayed on the user's device, and after confirming it, the user can quickly complete the cancellation procedure. A notification is sent before the cancellation deadline to prevent users from forgetting to cancel. Example prompt: "Please help me with the procedure to cancel this video streaming service."

[0221] The above is a specific embodiment of the present invention. By using this system, users can efficiently use various services, avoid missing important information, safely manage data, and easily complete cancellation procedures.

[0222] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0223] Recommended features of the service

[0224] Processing Steps

[0225] Step 1:

[0226] The user's terminal displays a GUI (Graphical User Interface) for inputting service category information. Specifically, the HTML form has text boxes and drop-down menus, and the user inputs the desired service category.

[0227] Input: The user inputs the service category and clicks the submit button.

[0228] Output: The entered service category information is sent to the server.

[0229] Step 2:

[0230] The server analyzes the HTTP request received from the user's device and extracts the category information, which is included in the request.

[0231] Input: The server receives an HTTP request and parses the JSON data.

[0232] Output: Category information is extracted and used to perform database queries.

[0233] Step 3:

[0234] The server connects to a database (MySQL or PostgreSQL) based on the category information and executes a query to search for similar service information.

[0235] Input: Category information to use in database queries.

[0236] Output: Information about similar services (price, features, user reviews, etc.).

[0237] Step 4:

[0238] The server scores the extracted service information based on multiple evaluation criteria (price, features, user reviews, etc.), evaluates each service using machine learning libraries such as Scikit-learn and TensorFlow, and ranks them using a comparison algorithm.

[0239] Input: Extracted service information.

[0240] Output: Evaluation and scoring results.

[0241] Step 5:

[0242] The server converts the recommended service information selected by the comparison algorithm into JSON format and sends it to the user's device as an HTTP response.

[0243] Input: Evaluation and scoring results.

[0244] Output: Recommendation information in JSON format.

[0245] Step 6:

[0246] The user's device analyzes the HTTP response received from the server and displays recommended service information on the screen. The services are listed in order of ranking, and detailed information is also displayed.

[0247] Input: The HTTP response from the server.

[0248] Output: Recommended service information is displayed to the user.

[0249] Membership terms summary function

[0250] Processing Steps

[0251] Step 1:

[0252] The user's device displays an interface with an input field for obtaining the URL of the membership terms page and a "Submit" button.

[0253] Input: The user enters the URL of the membership agreement page and clicks the submit button.

[0254] Output: The entered URL information is sent to the server.

[0255] Step 2:

[0256] The server analyzes the HTTP request received from the user's terminal and extracts the URL.

[0257] Input: The server receives an HTTP request and parses the JSON data.

[0258] Output: The extracted URL.

[0259] Step 3:

[0260] The server accesses the specified URL and retrieves the HTML of the membership agreement page using a web scraping library such as BeautifulSoup or Requests.

[0261] Input: The HTTP request based on the extracted URL.

[0262] Output: The retrieved HTML data.

[0263] Step 4:

[0264] The server extracts text data from the HTML data and analyzes it using a natural language processing engine (NLTK or SpaCy).

[0265] Input: The retrieved HTML data.

[0266] Output: The extracted text data.

[0267] Step 5:

[0268] The server analyzes the text data and identifies important keywords and phrases using a natural language processing engine.

[0269] Input: Extracted text data.

[0270] Output: A list of key points.

[0271] Step 6:

[0272] The server summarizes the key points it has identified, presents them in an easy-to-understand format, and sends this to the user's device as a JSON response.

[0273] Input: A list of key points.

[0274] Output: Summary information in JSON format.

[0275] Step 7:

[0276] The user's device analyzes the summary information received from the server and displays it on the screen, with important points listed in bullet points.

[0277] Input: The HTTP response from the server.

[0278] Output: A summarized membership agreement is displayed to the user.

[0279] Membership registration status and password management function

[0280] Processing Steps

[0281] Step 1:

[0282] The user's device displays a form to sign up for a new service, which includes fields for entering a username, email address, and password.

[0283] Enter: The user enters the required registration information and clicks the submit button.

[0284] Output: The entered registration information is sent to the server.

[0285] Step 2:

[0286] The server analyzes the HTTP request received from the user's terminal and obtains the registration information.

[0287] Input: The server receives an HTTP request and parses the JSON data.

[0288] Output: The extracted registration information.

[0289] Step 3:

[0290] The server encrypts the registration information it receives using libraries such as OpenSSL and bcrypt.

[0291] Input: Extracted registration information.

[0292] Output: Encrypted registration information.

[0293] Step 4:

[0294] The server stores the encrypted registration information in a database (such as MongoDB).

[0295] Input: Encrypted registration information.

[0296] Output: Saved data.

[0297] Step 5:

[0298] The server periodically scans the database to check the validity of registration information and passwords, and can also use an external security API to check if passwords have been leaked.

[0299] Input: Database registration information and password.

[0300] Output: Check results and alert information.

[0301] Step 6:

[0302] The server will send the user a password change alert or a list of registration status via email or in-app notification as needed.

[0303] Input: Check results and alert information.

[0304] Output: Notification as feedback.

[0305] Step 7:

[0306] The user's device displays the notification and alert information received from the server, allowing the user to take the necessary action.

[0307] Input: Notifications and alerts from the server.

[0308] Output: Display of alerts and feedback information.

[0309] Cancellation procedure support function

[0310] Processing Steps

[0311] Step 1:

[0312] The user's device displays an interface for selecting the service they wish to cancel, including a list box and a search bar.

[0313] Input: The user selects the service they wish to cancel and clicks the submit button.

[0314] Output: The selected service information is sent to the server.

[0315] Step 2:

[0316] The server analyzes the HTTP request received from the user's terminal and obtains service information.

[0317] Input: The server receives an HTTP request and parses the JSON data.

[0318] Output: The extracted service information.

[0319] Step 3:

[0320] The server accesses the database and searches for and obtains the information necessary for the cancellation procedure (such as the URL for the procedure and the necessary forms).

[0321] Input: Service information.

[0322] Output: Cancellation procedure information (URL, form, etc.).

[0323] Step 4:

[0324] The server generates forms and instructions based on the acquired information to simplify the cancellation process, and uses RPA tools such as UiPath to automatically fill them in.

[0325] Input: Cancellation procedure information.

[0326] Output: The generated cancellation form.

[0327] Step 5:

[0328] The server sends the generated cancellation form to the user's terminal.

[0329] Input: Generated cancellation form.

[0330] Output: The URL of the cancellation form.

[0331] Step 6:

[0332] The user's terminal displays the cancellation form received from the server, allowing the user to confirm and submit the cancellation procedure.

[0333] Input: Cancellation form URL.

[0334] Output: The cancellation form displayed.

[0335] Step 7:

[0336] The server monitors the progress of the cancellation procedure and notifies the user's terminal of the information once the procedure is complete.

[0337] Input: Progress of cancellation procedure.

[0338] Output: Completion notification.

[0339] Step 8:

[0340] The user's terminal displays the confirmation of completion of the cancellation procedure received from the server so that the user can confirm it.

[0341] Input: Completion notification.

[0342] Output: Display of cancellation procedure completion information.

[0343] (Application example 1)

[0344] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0345] On conventional online shopping sites, when users select the product they want, it is difficult to find the best product from the wide range of information available, and in many cases, proper comparison and evaluation are not performed. It is also difficult to grasp a large amount of information at once, which makes selection laborious for users. Furthermore, there is a lack of an efficient way to grasp important information such as registration information and membership terms and conditions.

[0346] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0347] In this invention, the server

[0348] an input means for inputting a desired product category by the user;

[0349] extraction means for extracting related product information from a database based on the product category information input via the input means;

[0350] a comparison means for evaluating the products extracted by the extraction means using a comparison algorithm based on evaluation criteria such as price, function, and reviews;

[0351] a presentation means for presenting optimal products based on the evaluation results by the comparison means;

[0352] An acquisition means for acquiring text data of the membership terms and conditions of the product designated by the user;

[0353] natural language processing means for analyzing the text data acquired by the acquisition means and extracting important points;

[0354] a presentation means for presenting the important points extracted by the natural language processing means to a user as a summary;

[0355] an input means for inputting registration information to be input when a user registers for a new service;

[0356] a storage means for encrypting and storing the registration information input by the input means;

[0357] a check means for periodically checking the registration information stored in the storage means and providing feedback to the user;

[0358] Includes.

[0359] This not only allows users to easily compare and evaluate the products they want and select the most suitable product, but also allows them to efficiently understand important information such as membership terms and conditions, and allows them to safely and conveniently manage their registration information.

[0360] The "input means" is a means for the user to input desired product category information.

[0361] The "extraction means" is a means for extracting related product information from the database based on the product category information input via the input means.

[0362] The "comparison means" is a means for evaluating the products extracted by the extraction means using a comparison algorithm based on evaluation criteria such as price, function, and reviews.

[0363] The "presentation means" is a means for presenting the most suitable product to the user based on the evaluation results by the comparison means.

[0364] The "acquisition means" is a means for acquiring text data of the membership terms and conditions of the product designated by the user.

[0365] The "natural language processing means" is a means for analyzing the text data acquired by the acquisition means and extracting important points.

[0366] The "storage means" is a means for encrypting and storing the registration information input by the input means.

[0367] The "checking means" is a means for periodically checking the registration information stored in the storage means and providing feedback to the user.

[0368] The present invention provides a system that inputs desired product category information from a user and presents optimal products based on that information. This system is made up of the following main components:

[0369] First, a user inputs a product category using a smartphone or other mobile device. A mobile application is used as the input means, and an interface built using a front-end library such as React Native is provided. When category information is input through the user interface in this application, the information is sent to the server.

[0370] The server extracts related product information from a database based on the input information. Databases such as SQLite and MongoDB are often used. The extraction method is implemented using a Python backend that uses the Flask framework. This backend retrieves product data from the database that corresponds to the product category information entered by the user.

[0371] Next, the extracted product information is compared based on evaluation criteria such as price, features, and reviews. An evaluation algorithm is used as the comparison method, using libraries such as Python's scikit-learn or TensorFlow. The evaluation algorithm compares the characteristic values ​​of each product and selects the most suitable product.

[0372] The information about the selected products is presented to the user by a presentation means, again using a mobile application, and the selection results are displayed on a user interface, allowing the user to easily check the optimal products that have been selected.

[0373] It also has a means to retrieve and analyze the text data of the membership terms and conditions for the product specified by the user. The retrieval method is a backend using Flask that sends a request to the URL to retrieve the text data. For natural language processing, it uses Python natural language processing libraries NLTK and SpaCy to analyze and extract important points from the text and present them to the user as a summary.

[0374] In addition, there is also a means for users to input registration information when registering for a new service, and for this information to be encrypted and stored. The aforementioned mobile application is used as the input means. The input registration information is securely stored in encrypted form in the storage means. For example, an encryption algorithm such as AES (Advanced Encryption Standard) is used. The registration information stored in the storage means is checked periodically, and feedback is provided to the user regarding password changes and registration status. A Flask-based backend manages this periodic job.

[0375] Here's a specific example: When a user accesses a smartphone application and types in "smartphone," the server selects the product with the highest review rating from candidates such as "iPhone 14" and "latest smartphone models" and displays it to the user.

[0376] Examples of prompts using generative AI models include:

[0377] "Please select a service category: [Smartphones, Home Appliances, Clothing, ...]"

[0378] -> Smartphone

[0379] Looking for smartphone recommendations based on price, features, and user reviews?

[0380] -> Recommended Smartphone: Latest Smartphone Model (Price: $899, Review: 4.7)

[0381] As described above, the present invention provides a system that allows users to easily compare and evaluate desired products and select the most suitable product. In addition, it also allows users to efficiently understand important information such as membership terms and conditions, and allows for safe and convenient management of registration information.

[0382] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0383] Step 1:

[0384] The user starts the smartphone application and inputs the desired product category. This input is done through the user interface. The input data is formatted in JSON format or similar and sent to the server.

[0385] Input: Product category entered through a smartphone application (e.g., "smartphone").

[0386] Output: Product category information sent to the server.

[0387] Specific behavior:

[0388] Enter the category in the input field on the smartphone's user interface and press the "Send" button to send the data to the server.

[0389] Step 2:

[0390] The server extracts related product information from the database based on the received product category information, and executes a database query to obtain the corresponding product data.

[0391] Input: Product category information (e.g., "Smartphone").

[0392] Output: A list of relevant product data (e.g., information on multiple smartphone models).

[0393] Specific behavior:

[0394] The server executes SQL queries based on the product category information and extracts relevant product data from the database.

[0395] Step 3:

[0396] The server compares the extracted product data using a rating algorithm that calculates a rating score for the product based on criteria such as price, features, and review ratings.

[0397] Input: Extracted product data.

[0398] Output: Rating score for each product.

[0399] Specific behavior:

[0400] The server calculates the characteristics of each extracted product (price, features, review rating, etc.) and calculates a score for each product using a rating algorithm.

[0401] Step 4:

[0402] The server selects the best product based on the rating score, with the product with the highest score being chosen as the best product.

[0403] Input: Rating score for each product.

[0404] Output: The best products (e.g., smartphone models with the highest reviews).

[0405] Specific behavior:

[0406] The server compares the evaluation scores and selects the product with the highest score.

[0407] Step 5:

[0408] The server transmits the selected optimal product to the user's terminal, including detailed information about the selected product.

[0409] Input: Optimal product information.

[0410] Output: Product details sent to the user's device.

[0411] Specific behavior:

[0412] The server formats detailed information about the best products and sends it to the user's device in JSON format or similar.

[0413] Step 6:

[0414] The user's device displays the received product information, and the user can check the selected optimal product through the application interface.

[0415] Input: Product details sent from the server.

[0416] Output: Product information displayed on the user interface.

[0417] Specific behavior:

[0418] The smartphone application reflects the received data on the user interface and displays it to the user.

[0419] The above processing steps realize a system that allows a user to simply input a desired product category and select the most suitable product.

[0420] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0421] MODE FOR CARRYING OUT THE INVENTION

[0422] Recommended features of the service

[0423] overview

[0424] In this invention, we build a system in which a user inputs the category of service they want, and the server compares and evaluates similar services and presents recommended services. Furthermore, we combine it with an emotion engine that recognizes the user's emotions to improve the user experience.

[0425] Program processing

[0426] 1. The user's terminal displays an interface for inputting service category information.

[0427] 2. The user enters the category information of the desired service and submits it.

[0428] 3. The server receives the input category information and extracts related service information from the database based on that information.

[0429] 4. The server evaluates the extracted services based on price, features, user reviews, etc., and selects the most suitable service using a comparison algorithm.

[0430] 5. The emotion engine recognizes the user's emotions using data collected from the user's device.

[0431] 6. The server adjusts the list of recommended services based on the user's emotions recognized by the emotion engine.

[0432] 7. The server sends the optimal recommended service to the user's device.

[0433] 8. The user's device will display recommended services for the user to review.

[0434] Specific examples

[0435] For example, if a user desires a "video streaming service" and is feeling stressed, the server will extract service information from Netflix, Hulu, Amazon Prime Video, etc., and compare them based on their prices, features, and user reviews. If the emotion engine recognizes that the user is feeling stressed, the server will prioritize recommending services with an abundance of content that has a relaxing effect to reduce stress.

[0436] Membership terms summary function

[0437] overview

[0438] To help users understand the membership terms of a service efficiently, we provide a system in which the server extracts and summarizes the important points of the membership terms. Furthermore, by combining it with an emotion engine, we provide explanations that correspond to the user's emotions.

[0439] Program processing

[0440] 1. The user's device displays an interface for obtaining the URL of the membership terms page.

[0441] 2. The user enters the URL of the membership terms page and submits it.

[0442] 3. The server retrieves the text data of the membership terms page based on the entered URL.

[0443] 4. The server analyzes the text data using a natural language processing engine and extracts important points.

[0444] 5. The emotion engine recognizes the user's emotions using data collected from the user's device.

[0445] 6. The server adjusts the summarized content of the terms and conditions based on the user's emotions recognized by the emotion engine and provides it in a form appropriate for the user.

[0446] 7. The server sends the summary results to the user's terminal.

[0447] 8. The user's device will display a summary of the membership terms and conditions for the user to review.

[0448] Specific examples

[0449] For example, if a user is feeling anxious about signing up for a new video streaming service, the server can analyze the URL of the membership terms and conditions, extract important points such as "automatic renewal," "how to cancel," and "price changes," and provide a summary highlighting particularly reassuring information to alleviate the anxiety recognized by the emotion engine.

[0450] Membership registration status and password management function

[0451] overview

[0452] The system aims to securely manage users' membership registration information and passwords, and provide regular feedback. Furthermore, by combining it with an emotion engine, it provides feedback according to the user's emotions.

[0453] Program processing

[0454] 1. The user's device displays a form for registering for the service.

[0455] 2. The user enters the required registration information (username, email address, password, etc.) and submits it.

[0456] 3. The server receives the entered information, encrypts it, and stores it in a database.

[0457] 4. The server periodically scans the database to check the status of registration information and passwords.

[0458] 5. The emotion engine recognizes the user's emotions using data collected from the user's device.

[0459] 6. The server adjusts feedback regarding password and registration information management based on the user's emotions recognized by the emotion engine.

[0460] 7. The server sends the adjusted feedback to the user's device.

[0461] 8. The user's device displays the feedback for the user to review.

[0462] Specific examples

[0463] For example, if a user feels confused or hesitant when signing up for a new service, the server can encrypt and store the registration information and password, and provide clear and reassuring feedback based on the user's emotions as recognized by the emotion engine.

[0464] Cancellation procedure support function

[0465] overview

[0466] We provide a system that simplifies the process for users to cancel their service and prevents them from missing the cancellation deadline. Furthermore, by combining it with an emotion engine, we provide support that responds to the user's emotions.

[0467] Program processing

[0468] 1. The user's device displays an interface for selecting the service they wish to cancel.

[0469] 2. The user selects the service they wish to cancel and submits it.

[0470] 3. The server retrieves information regarding the cancellation procedure for the relevant service from the database.

[0471] 4. The server generates forms and instructions to simplify the cancellation process.

[0472] 5. The emotion engine recognizes the user's emotions using data collected from the user's device.

[0473] 6. The server provides appropriate support for the cancellation procedure based on the user's emotions recognized by the emotion engine.

[0474] 7. The server automatically fills in the cancellation form and sends it to the user's device.

[0475] 8. The user's device will display an automatically filled-in cancellation form to facilitate the cancellation process.

[0476] 9. The server checks the progress of the cancellation procedure and sends a completion notification to the user's device.

[0477] 10. The user's device will display the completion status of the cancellation procedure so that the user can check it.

[0478] Specific examples

[0479] For example, if a user is trying to cancel a video streaming service but is finding it troublesome, the server obtains information about the cancellation procedure, and in order to reduce the hassle recognized by the emotion engine, simplifies the steps of the cancellation procedure and provides support that allows the user to cancel with peace of mind.

[0480] As described above, the system of the present invention provides a wide range of functions to improve user convenience, and by combining it with an emotion engine, it significantly improves the user experience.

[0481] The processing flow will be explained below.

[0482] Recommended features of the service

[0483] Program processing

[0484] Step 1:

[0485] The user's terminal displays an interface for inputting service category information, allowing the user to input the information.

[0486] Step 2:

[0487] The user inputs the category information of the desired service and presses the send button.

[0488] Step 3:

[0489] The server receives the category information sent by the user.

[0490] Step 4:

[0491] The server extracts the corresponding service information from the database based on the received category information.

[0492] Step 5:

[0493] The server evaluates the extracted service information based on price, features, user reviews, etc.

[0494] Step 6:

[0495] The emotion engine analyzes the user's emotions based on data collected from the user's device.

[0496] Step 7:

[0497] The server receives the analyzed emotion data and reflects it in the evaluation algorithm to compare services.

[0498] Step 8:

[0499] The server generates a list of optimal recommended services and sends it to the user's terminal.

[0500] Step 9:

[0501] The user's device displays a list of recommended services and asks the user to confirm them.

[0502] Membership terms summary function

[0503] Program processing

[0504] Step 1:

[0505] The user's device displays an interface for entering the URL of the membership agreement page.

[0506] Step 2:

[0507] The user enters the URL for the membership agreement and submits it.

[0508] Step 3:

[0509] The server retrieves the text data of the membership terms page based on the sent URL.

[0510] Step 4:

[0511] The server analyzes the acquired text data using a natural language processing engine.

[0512] Step 5:

[0513] The server extracts important points from the text data.

[0514] Step 6:

[0515] The emotion engine analyzes the user's emotions based on data collected from the user's device.

[0516] Step 7:

[0517] The server adjusts the summarized membership agreement based on the analyzed emotion data.

[0518] Step 8:

[0519] The server transmits the adjusted summary result to the user's terminal.

[0520] Step 9:

[0521] The user's terminal displays the summarized membership terms and conditions and asks the user to confirm them.

[0522] Membership registration status and password management function

[0523] Program processing

[0524] Step 1:

[0525] The user's device displays a form for registering for the service.

[0526] Step 2:

[0527] The user enters the required registration information (user name, email address, password, etc.) and submits it.

[0528] Step 3:

[0529] The server receives the entered information, encrypts it, and stores it in a database.

[0530] Step 4:

[0531] The server periodically scans the database to check the status of registration information and passwords.

[0532] Step 5:

[0533] The emotion engine analyzes the user's emotions based on data collected from the user's device.

[0534] Step 6:

[0535] The server adjusts feedback regarding password and registration information management based on the analyzed emotional data.

[0536] Step 7:

[0537] The server transmits the adjusted feedback to the user's terminal.

[0538] Step 8:

[0539] The user's terminal displays the feedback for the user to confirm.

[0540] Cancellation procedure support function

[0541] Program processing

[0542] Step 1:

[0543] The user's terminal displays an interface for selecting the service the user wishes to cancel.

[0544] Step 2:

[0545] The user selects the service they wish to cancel and submits it.

[0546] Step 3:

[0547] The server retrieves information about the cancellation procedure for the relevant service from the database.

[0548] Step 4:

[0549] The server generates forms and instructions to simplify the cancellation process.

[0550] Step 5:

[0551] The emotion engine analyzes the user's emotions based on data collected from the user's device.

[0552] Step 6:

[0553] The server provides optimal support for cancellation procedures based on the analyzed emotion data.

[0554] Step 7:

[0555] The server sends the automatically filled-out cancellation form to the user's terminal.

[0556] Step 8:

[0557] The user's device will display a cancellation form that the user can easily fill out and submit.

[0558] Step 9:

[0559] The server checks the progress of the cancellation procedure and sends a completion notice to the user's terminal.

[0560] Step 10:

[0561] The user's terminal displays the completion status of the cancellation procedure and asks the user to confirm it.

[0562] Example 2

[0563] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0564] Previous service proposal systems and membership agreement summary systems failed to adequately address user needs and emotions, making it difficult to improve the user experience. Furthermore, when registering for a new service, there were insufficient measures to alleviate user anxiety and confusion regarding the management of registration information and feedback, resulting in a poor user experience. The service cancellation process was also complicated, and there was a risk of missing deadlines.

[0565] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0566] In this invention, the server includes: input means for inputting a category of service desired by the user; extraction means for extracting similar service information from a database based on category information input via the input means; comparison means for evaluating and comparing the similar services extracted by the extraction means using a plurality of indicators such as price, functionality, and user reviews; presentation means for presenting recommended services based on the comparison results by the comparison means; emotion recognition means for recognizing a user's emotion; adjustment means for adjusting a list of recommended services based on the user's emotion recognized by the emotion recognition means; means for presenting to the user the optimal recommended service adjusted by the adjustment means; acquisition means for acquiring text data of membership terms and conditions specified by the user; analysis means for analyzing the text data acquired by the acquisition means using a natural language processing engine and extracting important points; presentation means for presenting to the user the important points extracted by the analysis means as a summary; input means for inputting registration information entered by the user when registering for a new service; storage means for encrypting and storing the registration information input by the input means; and check means for periodically checking the registration information stored in the storage means and providing feedback to the user. This enables the recommendation of optimal services based on the user's needs and emotions, easy-to-understand summaries of membership terms and conditions, secure management of registration information, and prompt feedback.

[0567] The "input means" is a device or function that provides an interface for the user to input the category of service desired and registration information.

[0568] The "extraction means" is a device or function that extracts related service information from the database based on the input category information.

[0569] A "comparison means" is a device or function that evaluates and compares extracted services based on multiple indicators such as price, functionality, and user reviews.

[0570] The "presentation means" is a device or function that presents the user with recommended content or summary information based on the results of the comparison means and analysis means.

[0571] The "emotion recognition means" is a device or function that analyzes the user's input speed, keystroke patterns, facial recognition data, etc., and recognizes the user's emotions.

[0572] The "adjustment means" is a device or function that adjusts the recommendation content and summary information based on the user's emotion recognized by the emotion recognition means.

[0573] The "acquisition means" is a device or function for acquiring the text data of the membership terms and conditions specified by the user from the Internet.

[0574] The "analysis means" is a device or function that analyzes the text data acquired by the acquisition means using a natural language processing engine and extracts important points.

[0575] The "storage means" is a device or function that encrypts the registration information entered by the input means and stores it in a database.

[0576] The "checking means" is a device or function that periodically scans the registration information stored in the storage means and provides feedback to the user.

[0577] This invention provides a system that allows users to input the category of services they desire, a system that recommends them, a system that summarizes the membership terms of the services specified by the user, and a system that manages users' registration information and passwords. Furthermore, it combines this with a system that supports cancellation procedures and utilizes an emotion recognition engine to improve the user experience.

[0578] Recommended features of the service

[0579] The user's device displays an interface for entering service category information. When the user enters and submits the category information for the service they desire, the server receives that information and uses an SQL query to extract related service information from a database. The extracted services are then evaluated and compared using multiple indicators, such as price, features, and user reviews, using a Python or Java program. TensorFlow is also used as an emotion engine to analyze data collected from the user's device (such as input speed, keystroke patterns, and facial recognition data) to recognize the user's emotions. The server adjusts the list of recommended services based on the emotion recognition results and sends the optimal service recommendation information in JSON format to the user's device. The device then parses the received data and displays it in a visually easy-to-understand format.

[0580] As a specific example, if a user requests a "video streaming service" and is feeling stressed, the server will evaluate services such as Netflix, Hulu, and Amazon Prime Video and prioritize recommending content that has a high relaxing effect.

[0581] Example prompt sentence:

[0582] "Can you recommend a video streaming service? I've been feeling stressed at work lately, so I'm looking for content that helps me relax."

[0583] Membership terms summary function

[0584] The user's device displays an interface for entering the URL of the membership terms page. When the user enters the URL and submits it, the server retrieves the text data of the membership terms from that URL. The server analyzes the retrieved text data using SpaCy and NLTK to extract important points such as "automatic renewal," "cancellation method," and "price changes." The IBM Watson Tone Analyzer is used as an emotion engine to recognize emotions from the user's input and operation patterns, and adjusts the summary by adding information that alleviates anxiety and confusion. The adjusted summary is sent to the user's device in JSON format and displayed in an easy-to-understand manner.

[0585] As a concrete example, if a user is feeling anxious about signing up for a new video streaming service, a summary highlighting the key points that will reassure them is provided.

[0586] Example prompt sentence:

[0587] "I would like to check the membership terms of a new video streaming service, so I am entering its URL. I am feeling uneasy, so please summarize the important points in an easy-to-understand way."

[0588] Membership registration status and password management function

[0589] The user's device displays a form for registering for the service. When the user enters and submits the required registration information (username, email address, password, etc.), the server encrypts the information using encryption technology such as AES and stores it in a database. The server periodically scans the database to check the expiration date of the registration information and the strength of the password. As an emotion engine, it recognizes emotions from biometric data, input speed, and operation patterns, and sends easy-to-understand feedback in JSON format to the user's device, which displays it on the screen.

[0590] For example, if a user is feeling confused or overwhelmed when signing up for a new service, providing feedback that is particularly reassuring.

[0591] Example prompt sentence:

[0592] "I signed up for a new service, but I'm worried about managing my registration information and password. I'd appreciate some clear feedback."

[0593] Cancellation procedure support function

[0594] The user's device displays an interface for selecting the service they wish to cancel. When the user selects and submits the service they wish to cancel, the server retrieves information about the cancellation procedure for that service from a database and generates a form and instructions for a simplified cancellation process. The emotion engine performs emotion recognition, simplifies the steps in the cancellation process, and provides information that gives a sense of security. The server automatically fills in the cancellation form and sends it in JSON format to the user's device. The device parses the received data to make it easy to complete the cancellation process. The progress of the cancellation process is checked, and a completion notification is sent to the user's device and displayed on the screen.

[0595] As a specific example, if a user is having trouble canceling a video streaming service, we will simplify the steps in the cancellation process and help them cancel easily.

[0596] Example prompt sentence:

[0597] "I want to cancel my video streaming service, but the process is complicated. Please provide a simplified method."

[0598] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0599] Recommended features of the service

[0600] Processing Steps

[0601] Step 1:

[0602] The user's terminal displays an interface for inputting service category information.

[0603] Input: Category selection screen for the user

[0604] Output: User category selection and input

[0605] Specific behavior: A user interface built with HTML / CSS is launched, displaying input fields where the user can enter information and a submit button.

[0606] Step 2:

[0607] The user inputs and submits the category information of the desired service.

[0608] Input: Service category information (e.g. video streaming service)

[0609] Output: Sent to the server as an HTTP request

[0610] Specific behavior: When a user enters category information into the text field and clicks the submit button, the input data is sent to the server as an HTTP POST request.

[0611] Step 3:

[0612] The server receives the input category information and extracts related service information from the database based on that information.

[0613] Input: Category information

[0614] Output: Extracted service information

[0615] Specific operation: The server executes an SQL query to extract the corresponding service information from a database (e.g. MySQL).

[0616] Step 4:

[0617] The server evaluates the extracted services based on price, features, user reviews, etc., and uses a comparison algorithm to select the most suitable service.

[0618] Input: Extracted service information

[0619] Output: The result of the comparison algorithm that was performed.

[0620] How it works: The server uses Python or Java programs to score each service's metrics (price, features, reviews) and run comparison algorithms such as weighted averages.

[0621] Step 5:

[0622] The emotion engine recognizes the user's emotions using data collected from the user's device.

[0623] Input: User operation data (typing speed, keystroke patterns, facial recognition data, etc.)

[0624] Output: Recognized emotion data

[0625] Specific operation: The emotion engine uses a machine learning model (e.g., TensorFlow) to analyze user operation data and recognize emotions (stress, relaxation, etc.).

[0626] Step 6:

[0627] The server adjusts the list of recommended services based on the user's emotions recognized by the emotion engine.

[0628] Input: Comparison results and emotion data

[0629] Output: A tailored list of recommended services

[0630] How it works: The server reevaluates the results of the comparison algorithm and optimizes the service list based on the emotional data, for example prioritizing services with a relaxing effect for a user who is feeling stressed.

[0631] Step 7:

[0632] The server sends the optimal recommended service to the user's terminal.

[0633] Input: Adjusted service list

[0634] Output: Recommendation service data sent to the user's device

[0635] Specific operation: The server generates a list of recommended services in JSON format and sends it to the user's device as an HTTP response.

[0636] Step 8:

[0637] The user's device displays the recommended services so that the user can check them.

[0638] Input: Submitted recommendation service data

[0639] Output: Displayed list of recommended services

[0640] What it does: The device parses the data it receives and displays it to the user in a visually understandable format, such as a card displaying the name, price, key features, and reviews of each service.

[0641] Membership terms summary function

[0642] Processing Steps

[0643] Step 1:

[0644] The user's terminal displays an interface for obtaining the URL of the membership terms page.

[0645] Input: Membership Terms URL input screen

[0646] Output: User input URL and submit

[0647] Specific behavior: The user interface will launch and display a text field for entering the URL of the membership agreement and a submit button.

[0648] Step 2:

[0649] The user enters the URL of the membership agreement page and submits it.

[0650] Input: Membership Terms and Conditions page URL

[0651] Output: Sent to the server as an HTTP request

[0652] Specific behavior: When a user enters a URL and clicks the submit button, the input data is sent to the server as an HTTP POST request.

[0653] Step 3:

[0654] The server retrieves the text data of the membership agreement page based on the entered URL.

[0655] Input: Membership Terms URL

[0656] Output: The retrieved text data

[0657] Specific operation: The server uses an HTTP GET request to download the HTML content of the membership agreement from the specified URL and converts it into data for text analysis.

[0658] Step 4:

[0659] The server analyzes the text data using a natural language processing engine and extracts important points.

[0660] Input: Obtained text data

[0661] Output: Extracted key points

[0662] What it does: The server uses a natural language processing engine (e.g., SpaCy, NLTK) to parse the text of the membership agreement and extract key phrases and sentences such as "auto-renewal," "how to cancel," and "price change."

[0663] Step 5:

[0664] The emotion engine recognizes the user's emotions using data collected from the user's device.

[0665] Input: User operation data (typing speed, keystroke patterns, etc.)

[0666] Output: Recognized emotion data

[0667] Specific operation: The emotion engine uses a machine learning model (e.g., IBM Watson Tone Analyzer) to analyze the user's operation data and recognize emotions (anxiety, relief, etc.).

[0668] Step 6:

[0669] The server adjusts the summarized content of the terms and conditions based on the user's emotions recognized by the emotion engine and provides it in a form suitable for the user.

[0670] Input: Extracted key points and sentiment data

[0671] Output: Adjusted summary content

[0672] What it does: The server adjusts the summary based on the emotion data, optimizing the summary by adding reassuring information especially for anxious users.

[0673] Step 7:

[0674] The server transmits the summary result to the user's terminal.

[0675] Input: Adjusted summary content

[0676] Output: Summary data sent to the user's terminal

[0677] Specific operation: The server packages the generated summary content in JSON format and sends it to the user's device as an HTTP response.

[0678] Step 8:

[0679] The user's terminal displays the summarized membership terms and conditions for the user to review.

[0680] Input: Summary data sent

[0681] Output: The displayed summary

[0682] Specific operation: The device parses the data it receives, highlights important points with colors and markers, and displays them to the user in a visually easy-to-understand format.

[0683] Membership registration status and password management function

[0684] Processing Steps

[0685] Step 1:

[0686] The user's terminal displays a form for registering for the service.

[0687] Input: Registration form screen

[0688] Output: User input and transmission

[0689] What happens: The user interface launches and displays a form for entering username, email address, password, etc.

[0690] Step 2:

[0691] The user enters the required registration information (user name, email address, password, etc.) and submits it.

[0692] Input: Registration information (username, email address, password, etc.)

[0693] Output: Sent to the server as an HTTP request

[0694] Specific behavior: When a user enters the required information into the form fields and clicks the submit button, the input data is sent to the server as an HTTP POST request.

[0695] Step 3:

[0696] The server receives the entered information, encrypts it, and stores it in a database.

[0697] Input: Registration information

[0698] Output: Encrypted registration information stored in a database

[0699] Specific operation: The server encrypts the data it receives using encryption technology such as AES and stores it in a database (e.g., MySQL).

[0700] Step 4:

[0701] The server periodically scans the database to check the status of registration information and passwords.

[0702] Input: Registration information in the database

[0703] Output: Password and registration information validity check results

[0704] What it does: The server sets up a scheduled job to periodically scan the database for password expiration and strength.

[0705] Step 5:

[0706] The emotion engine recognizes the user's emotions using data collected from the user's device.

[0707] Input: User operation data (typing speed, keystroke patterns, etc.)

[0708] Output: Recognized emotion data

[0709] Specific operation: The emotion engine analyzes biometric data and operation patterns to recognize the user's emotions (e.g., relief, anxiety).

[0710] Step 6:

[0711] The server adjusts feedback regarding password and registration information management based on the user's emotions recognized by the emotion engine.

[0712] Input: Password and registration information check results and emotional data

[0713] Output: Adjusted feedback content

[0714] What it does: The server uses the recognized emotion data to tailor the feedback and add clear explanations and hints to reduce the user's anxiety and confusion.

[0715] Step 7:

[0716] The server transmits the adjusted feedback to the user's terminal.

[0717] Input: Adjusted feedback

[0718] Output: Feedback data sent to the user's device

[0719] Specific operation: The server packages the generated feedback content in JSON format and sends it to the user's device as an HTTP response.

[0720] Step 8:

[0721] The user's terminal displays the feedback for the user to review.

[0722] Input: Submitted feedback data

[0723] Output: The displayed feedback

[0724] What it does: Parses the data the device receives and displays it visually as alerts and tips.

[0725] Cancellation procedure support function

[0726] Processing Steps

[0727] Step 1:

[0728] The user's terminal displays an interface for selecting the service that the user wishes to cancel.

[0729] Input: Cancellation service selection screen

[0730] Output: User service selection and transmission

[0731] Specific behavior: A user interface will launch, displaying a list and checkboxes for selecting the services you wish to cancel.

[0732] Step 2:

[0733] The user selects the service for which they wish to cancel and submits the selection.

[0734] Input: Service information you wish to cancel

[0735] Output: Sent to the server as an HTTP request

[0736] Specific operation: When the user selects a service and clicks the submit button, the selected data is sent to the server as an HTTP POST request.

[0737] Step 3:

[0738] The server retrieves information regarding the cancellation procedure for the relevant service from the database.

[0739] Input: Service information you wish to cancel

[0740] Output: Cancellation procedure information

[0741] Specific operation: The server retrieves information about the cancellation procedure for the relevant service from the database and extracts the necessary procedure information.

[0742] Step 4:

[0743] The server generates forms and procedures that simplify the cancellation process.

[0744] Input: Cancellation procedure information

[0745] Output: Simplified cancellation form and instructions

[0746] Specific operation: Using the cancellation procedure information obtained by the server, generate a form and instructions that allow the user to easily cancel.

[0747] Step 5:

[0748] The emotion engine recognizes the user's emotions using data collected from the user's device.

[0749] Input: User operation data (typing speed, keystroke patterns, etc.)

[0750] Output: Recognized emotion data

[0751] Specific operation: The emotion engine analyzes the user's operation data and recognizes the user's emotions (annoyance, relief, etc.).

[0752] Step 6:

[0753] The server provides support appropriate for the cancellation procedure based on the user's emotions recognized by the emotion engine.

[0754] Input: Tailored cancellation form and sentiment data

[0755] Output: Adjusted cancellation support details

[0756] Specific operation: The server adjusts the procedures and explanations based on the emotion data to make the cancellation process easy and safe.

[0757] Step 7:

[0758] The server automatically fills in the cancellation form and sends it to the user's terminal.

[0759] Input: Adjusted cancellation support details

[0760] Output: Cancellation form data sent to the user's device

[0761] Specific operation: The cancellation form generated by the server is automatically filled in, packaged in JSON format, and sent to the user's device as an HTTP response.

[0762] Step 8:

[0763] The user's device will display an automatically filled-in cancellation form, making it easy to complete the cancellation procedure.

[0764] Input: Submitted cancellation form data

[0765] Output: Cancellation form displayed

[0766] What happens: The device parses the data it receives and displays a pre-filled cancellation form to the user.

[0767] Step 9:

[0768] The server checks the progress of the cancellation procedure and sends a completion notice to the user's terminal.

[0769] Input: Cancellation procedure progress

[0770] Output: A completion notification sent to the user's device

[0771] Specific operation: The server monitors the progress of the cancellation procedure, generates a notification when the procedure is complete, and sends it to the user's device as an HTTP response.

[0772] Step 10:

[0773] The user's terminal displays the completion status of the cancellation procedure so that the user can check it.

[0774] Input: Completion notification sent

[0775] Output: Displayed completion notification

[0776] Specific operation: The device parses the received data and displays the completion status of the cancellation procedure to the user.

[0777] (Application example 2)

[0778] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0779] Conventional service recommendation systems only provide similar service information based on the category of service desired by the user, but they are unable to take the user's emotional state into account when making recommendations, making it difficult to provide an optimal user experience. It is also difficult for users to understand the membership terms and conditions and information provided related to the service they desire, which increases user stress. Furthermore, there are insufficient measures to alleviate confusion and bewilderment when users sign up for a new service.

[0780] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes an input means for inputting a category of a service desired by the user, an extraction means for extracting similar service information from a database based on the category information input via the input means, a comparison means for comparing the similar services extracted by the extraction means using an evaluation algorithm, a presentation means for presenting recommended services based on the comparison results by the comparison means, an emotion recognition means for recognizing the user's emotion, and an adjustment means for adjusting the presentation results of recommended services based on the user's emotion recognized by the emotion recognition means. This enables optimal service recommendation taking the user's emotion into consideration.

[0781] The server also includes an acquisition means for acquiring text data of the membership terms of the service designated by the user, a natural language processing means for analyzing the text data acquired by the acquisition means and extracting important points, a presentation means for presenting the important points extracted by the natural language processing means as a summary to the user, an emotion recognition means for recognizing the user's emotion, and an adjustment means for adjusting the summary content based on the user's emotion recognized by the emotion recognition means, thereby making it possible to provide a summary of the membership terms and conditions taking the user's emotion into consideration and promote understanding.

[0782] The server further includes an input means for inputting registration information entered by the user when registering for a new service, a storage means for encrypting and storing the registration information input by the input means, a check means for periodically checking the registration information stored in the storage means and providing feedback to the user, an emotion recognition means for recognizing the user's emotion, and an adjustment means for adjusting the feedback content based on the user's emotion recognized by the emotion recognition means. This makes it possible to manage the registration information and provide feedback taking the user's emotion into consideration, thereby reducing user confusion and bewilderment.

[0783] The "input means" is a device or interface for a user to input service category information and registration information.

[0784] The "extraction means" is a device or algorithm that extracts relevant information from the database based on information input through the input means.

[0785] The "comparison means" is a device or algorithm that uses an evaluation algorithm to perform a comparative analysis using the information extracted by the extraction means.

[0786] The "presentation means" is a device or interface that presents the most suitable service or information to the user based on the analysis results by the comparison means.

[0787] An "emotion recognition means" is a device or algorithm for recognizing a user's emotions, and analyzes audio and video using a camera or microphone.

[0788] The "adjustment means" is a device or algorithm that adjusts the presented service information or recommendation results based on the user's emotions recognized by the emotion recognition means.

[0789] The "acquisition means" is a device or interface for acquiring text data and membership terms and conditions specified by the user.

[0790] A "natural language processing means" is a device or algorithm for analyzing acquired text data and extracting important points.

[0791] "Storage means" refers to a device or database for encrypting and safely storing user registration information.

[0792] The "checking means" is a device or algorithm that periodically checks the registration information stored in the storage means and provides feedback to the user.

[0793] The present invention is a system for recognizing a user's emotions and recommending optimal services and products based on the emotions. Hereinafter, an embodiment of the present invention will be described in detail.

[0794] System Configuration

[0795] This system consists of an "input means" for users to input desired services and product categories, an "extraction means" for extracting relevant information from a database based on the user's input, a "comparison means" for evaluating and comparing the extracted information, an "emotion recognition means" for recognizing the user's emotions, an "adjustment means" for adjusting recommendations based on the emotion recognition results, and a "presentation means" for presenting the final recommendation results to the user.

[0796] Hardware and Software

[0797] 1. Hardware

[0798] Smartphone: User input, emotion recognition using camera and microphone

[0799] Server: Database management, high-performance CPU, GPU

[0800] 2. Software

[0801] Smartphone app: Developed with React Native

[0802] Server side: Developed in Python (Django)

[0803] Database: PostgreSQL

[0804] Emotion recognition engine: Google Cloud Vision API, IBM Watson Tone Analyzer

[0805] Processing flow

[0806] The system operates as follows:

[0807] 1. Input method (within smartphone app)

[0808] The user enters the desired service or product category, for example, "home coffee maker."

[0809] 2. Extraction method (server)

[0810] It receives information entered by the user and extracts relevant product information from a database.

[0811] 3. Comparison Method (Server)

[0812] The extracted product information is compared based on price, ratings, features, etc.

[0813] 4. Emotion Recognition Methods (Smartphone App and Cloud API)

[0814] Analyzes emotions using the user's camera footage and voice using Google Cloud Vision API and IBM Watson Tone Analyzer.

[0815] 5. Coordination mechanism (server)

[0816] Based on the emotion recognition results, product information suitable for the user's emotional state is adjusted.

[0817] 6. Presentation method (within smartphone app)

[0818] The final recommendation results are presented to the user.

[0819] Specific examples

[0820] For example, if a user requests a "home coffee maker" and the emotion recognition means recognizes that the user is feeling stressed, the server can prioritize and recommend products that are easy to operate and effective in reducing stress.

[0821] Prompt Sentence Examples

[0822] "Product category: Home coffee maker"

[0823] "User Emotions: Stress"

[0824] "Emotion Engine Recommendations: Easy Operation, Low Price, Relaxing Features"

[0825] This system configuration and processing procedure makes it possible to recommend optimal services and products that take into account the user's emotions.

[0826] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0827] Step 1:

[0828] A user opens a smartphone app and inputs the desired service or product category. The input is done through a user interface such as a text box. For example, the user inputs "home coffee maker."

[0829] Step 2:

[0830] The terminal sends the entered category information to the server. At this time, the information entered by the user, "home coffee maker," is sent as data.

[0831] Step 3:

[0832] Based on the category information received by the server, related product information is extracted from the database. Specifically, multiple product data (price, ratings, features, etc.) related to "home coffee makers" are retrieved from the PostgreSQL database.

[0833] Step 4:

[0834] The server compares the extracted product information using a rating algorithm, scoring the products based on multiple criteria such as price, rating, and features, generating a ranking. This ranking data is then input to the next processing step.

[0835] Step 5:

[0836] The device uses a built-in camera and microphone to collect the user's facial expressions and voice, and sends them to an emotion recognition engine (Google Cloud Vision API or IBM Watson Tone Analyzer). The emotion recognition engine uses this data to analyze the user's emotional state and output the results.

[0837] Step 6:

[0838] The server adjusts the ranking of recommended products based on the emotional state data received from the emotion recognition engine. For example, if the user is feeling stressed, the ranking will be reevaluated to prioritize products that are easy to operate, inexpensive, and have a high relaxation effect.

[0839] Step 7:

[0840] The server sends the final adjusted ranking data to the smartphone app, which outputs the optimal product list based on the adjusted ranking.

[0841] Step 8:

[0842] The device displays the received ranking data on the user interface. For example, a list of recommended "home coffee makers" is presented to the user. The user can instantly check the best products based on their emotions.

[0843] This series of processes makes it possible to recommend optimal services and products in real time, taking into account the user's emotions.

[0844] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0845] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0846] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0847] [Second embodiment]

[0848] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0849] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0850] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0851] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0852] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0853] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0854] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0855] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0856] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0857] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0858] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0859] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0860] MODE FOR CARRYING OUT THE INVENTION

[0861] Recommended features of the service

[0862] overview

[0863] In this invention, a system is constructed in which a user inputs the category of a desired service, and the server compares and evaluates similar services and presents recommended services.

[0864] Program processing

[0865] 1. The user's terminal displays an interface for inputting service category information.

[0866] 2. The user enters the category information of the desired service and submits it.

[0867] 3. The server receives the input category information and extracts related service information from the database based on that information.

[0868] 4. The server evaluates the extracted services based on price, features, user reviews, etc., and selects the most suitable service using a comparison algorithm.

[0869] 5. The server sends the selected recommended services to the user's device.

[0870] 6. The user's device will display the recommended services for the user to review.

[0871] Specific examples

[0872] For example, if a user requests a "video streaming service," the server extracts service information from Netflix, Hulu, Amazon Prime Video, etc., and compares them based on their prices, features, and user reviews. Using a comparison algorithm, the server selects Netflix as the optimal service and presents that information to the user.

[0873] Membership terms summary function

[0874] overview

[0875] To provide a system in which a server extracts important points of a membership agreement and presents them in a summary form so that a user can efficiently understand the membership agreement of a service.

[0876] Program processing

[0877] 1. The user's device displays an interface for obtaining the URL of the service's membership terms page.

[0878] 2. The user enters the URL of the membership terms page and submits it.

[0879] 3. The server retrieves the text data of the membership terms page based on the entered URL.

[0880] 4. The server analyzes the text data using a natural language processing engine and extracts important points.

[0881] 5. The server generates a summary of the extracted points and sends it to the user's device.

[0882] 6. The user's device displays a summary of the membership terms and conditions for the user to review.

[0883] Specific examples

[0884] For example, if a user is trying to sign up for a new video streaming service, they can submit the URL of the membership terms and conditions, and the server will extract important points such as "automatic renewal," "how to cancel," and "price changes" and provide a summary to the user.

[0885] Membership registration status and password management function

[0886] overview

[0887] The system aims to securely manage users' membership registration information and passwords and provide regular feedback.

[0888] Program processing

[0889] 1. The user's device displays a form for registering for the service.

[0890] 2. The user enters the required registration information (username, email address, password, etc.) and submits it.

[0891] 3. The server receives the entered information, encrypts it, and stores it in a database.

[0892] 4. The server periodically scans the database to check the status of registration information and passwords.

[0893] 5. The server sends the user a password change alert and a registration status list as needed.

[0894] 6. The user's device displays the feedback for the user to review.

[0895] Specific examples

[0896] For example, if a user registers for service A and then later registers for service B, the server will encrypt and store both registration information and passwords, and periodically send the user alerts about their registration status and password management.

[0897] Cancellation procedure support function

[0898] overview

[0899] To provide a system that simplifies the procedure for a user to cancel a service and prevents the user from missing the cancellation deadline.

[0900] Program processing

[0901] 1. The user's device displays an interface for selecting the service they wish to cancel.

[0902] 2. The user selects the service they wish to cancel and submits it.

[0903] 3. The server retrieves information about the cancellation procedure from the database.

[0904] 4. The server generates forms and instructions to simplify the cancellation process.

[0905] 5. The server automatically fills in the cancellation form and sends it to the user's device.

[0906] 6. The user's device will display an automatically filled-in cancellation form, making the cancellation process easy.

[0907] 7. The server checks the progress of the cancellation procedure and sends a completion notification to the user's device.

[0908] 8. The user's device will display the completion status of the cancellation procedure so that the user can check it.

[0909] Specific examples

[0910] For example, if a user wants to cancel a video streaming service, the server retrieves the necessary cancellation procedures from the database and automatically generates a form to provide to the user. The user can complete the cancellation procedure with just a few clicks, and a notification is sent before the cancellation deadline to prevent the user from forgetting to cancel.

[0911] As described above, the system of the present invention provides a wide range of functions to improve user convenience.

[0912] The processing flow will be explained below.

[0913] Recommended features of the service

[0914] overview

[0915] In this invention, a system is constructed in which a user inputs the category of a desired service, and the server compares and evaluates similar services and presents recommended services.

[0916] Program processing

[0917] Step 1:

[0918] The user's terminal displays a form interface to allow the user to input the service category information.

[0919] Step 2:

[0920] The user inputs the category information of the desired service and presses the send button.

[0921] Step 3:

[0922] The server analyzes the category information received from the user.

[0923] Step 4:

[0924] The server extracts the service information for the relevant category from the database.

[0925] Step 5:

[0926] The server rates the extracted services based on criteria such as price, features, and user reviews.

[0927] Step 6:

[0928] The server compares the services using a rating algorithm and generates a list of the best services.

[0929] Step 7:

[0930] The server transmits recommended service information to the user's terminal.

[0931] Step 8:

[0932] The user's device will display a list of recommended services for the user to review.

[0933] Membership terms summary function

[0934] overview

[0935] To provide a system in which a server extracts important points of a membership agreement and presents them in a summary form so that a user can efficiently understand the membership agreement of a service.

[0936] Program processing

[0937] Step 1:

[0938] The user's terminal displays an interface for entering the URL of the membership agreement.

[0939] Step 2:

[0940] The user enters the URL for the membership agreement and submits it.

[0941] Step 3:

[0942] The server retrieves the text data of the membership agreement page based on the entered URL.

[0943] Step 4:

[0944] The server analyzes the acquired text data using a natural language processing engine.

[0945] Step 5:

[0946] The server extracts important points from the text data.

[0947] Step 6:

[0948] The server generates a summary of the extracted points.

[0949] Step 7:

[0950] The server transmits the generated summary to the user's terminal.

[0951] Step 8:

[0952] The user's terminal displays the summarized membership terms and conditions for the user to review.

[0953] Membership registration status and password management function

[0954] overview

[0955] The system aims to securely manage users' membership registration information and passwords and provide regular feedback.

[0956] Program processing

[0957] Step 1:

[0958] The user's device displays a form for registering for the service.

[0959] Step 2:

[0960] The user enters the required registration information (user name, email address, password, etc.) and submits it.

[0961] Step 3:

[0962] The server receives the entered registration information, encrypts it, and stores it in a database.

[0963] Step 4:

[0964] The server periodically scans the database to check the status of registration information and passwords.

[0965] Step 5:

[0966] The server sends the user password change alerts and registration status lists as needed.

[0967] Step 6:

[0968] The user's terminal displays the feedback for the user to review.

[0969] Cancellation procedure support function

[0970] overview

[0971] To provide a system that simplifies the procedure for a user to cancel a service and prevents the user from missing the cancellation deadline.

[0972] Program processing

[0973] Step 1:

[0974] The user's terminal displays an interface for selecting the service the user wishes to cancel.

[0975] Step 2:

[0976] The user selects the service they wish to cancel and submits it.

[0977] Step 3:

[0978] The server retrieves information about the cancellation procedure for the relevant service from the database.

[0979] Step 4:

[0980] The server generates forms and instructions to simplify the cancellation process.

[0981] Step 5:

[0982] The server sends a cancellation form with auto-filled information to the user's device.

[0983] Step 6:

[0984] The user's device will display a simplified cancellation form, which the user will fill out and submit.

[0985] Step 7:

[0986] The server checks the progress of the cancellation procedure and sends a completion notice to the user's terminal.

[0987] Step 8:

[0988] The user's terminal displays the completion status of the cancellation procedure so that the user can check it.

[0989] Example 1

[0990] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0991] Today's service users must choose the most suitable service from a wide variety of options, but this selection process often requires time and effort. Understanding service membership terms and conditions can be difficult, putting users at risk of overlooking important information. Furthermore, managing registration information and canceling service subscriptions can be complicated, placing a burden on users. A system that can solve these problems and improve user convenience is needed.

[0992] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0993] In this invention, the server includes an input means for inputting a category of a service desired by a user, an extraction means for extracting similar service information from a database based on the category information input via the input means, a comparison means for evaluating the similar services extracted by the extraction means based on price, function, user reviews, etc., and selecting the most suitable service using a comparison algorithm, a presentation means for presenting recommended services based on the selection result by the comparison means, an acquisition means for acquiring a URL of the membership terms of the service designated by the user, a natural language processing means for extracting and analyzing text data from the URL acquired by the acquisition means, and a weighting factor analysis means for analyzing the weighting factor extracted by the natural language processing means. The system includes a presentation means for presenting a summary of key points to the user, an input means for inputting registration information to be input when the user registers for a new service, a storage means for encrypting and storing the registration information input by the input means, a check means for periodically checking the registration information stored in the storage means and providing feedback to the user, an input means for selecting a service the user wishes to cancel, an acquisition means for acquiring information on cancellation procedures for the service selected via the input means from a database, a generation means for generating a form and procedure for the cancellation procedure based on the information acquired by the acquisition means, and a presentation means for providing the user with the cancellation procedure information generated by the generation means. This enables the user to easily select the most suitable service, efficiently understand the service's membership terms and conditions, safely manage registration information, and quickly complete the cancellation procedure.

[0994] The "input means" is a means for providing an interface for the user to input desired information and categories.

[0995] The "extraction means" is a means for searching and acquiring related data from a database based on information input via the input means.

[0996] The "comparison means" is a means for comparing the data obtained by the extraction means based on multiple evaluation criteria such as price, functionality, and user reviews, and using an algorithm to select the optimal option.

[0997] The "presentation means" is a means for displaying the information and results obtained by the comparison means, analysis means, and generation means in an easy-to-understand manner for the user.

[0998] "Means of acquisition" refers to the means for acquiring the necessary information from a specified URL or data source.

[0999] "Natural language processing means" refers to means that uses natural language processing techniques to analyze acquired text data and extract important information.

[1000] "Storage means" refers to a means for securely encrypting and storing input information.

[1001] The "checking means" is a means for periodically checking the information stored by the storage means and providing necessary feedback to the user.

[1002] "Generation means" refers to a means for automatically generating forms and procedures based on acquired data and information.

[1003] MODE FOR CARRYING OUT THE INVENTION

[1004] Recommended features of the service

[1005] In this system, a user inputs category information of a desired service, and a process is executed to recommend the most suitable service.

[1006] Hardware and software configuration:

[1007] User devices: PCs, smartphones, tablets, etc. Using a web browser or dedicated application.

[1008] Server: A powerful server machine with web server software (Apache, Nginx, etc.) and database management system (MySQL, PostgreSQL, etc.).

[1009] Natural language processing engines: Scikit-learn, TensorFlow, NLTK, SpaCy, etc.

[1010] Interface: Web forms using HTML, CSS and JavaScript.

[1011] Examples:

[1012] For example, if a user wishes to search for a "video streaming service," the user enters category information and clicks the submit button. The user's device sends the information to the server, which extracts similar services from a database, evaluates them based on price, features, user reviews, etc., and uses a comparison algorithm to select the most suitable service. If Netflix is ​​recommended as a result of the selection, that information is displayed on the user's device. Example prompt: "Please recommend a video streaming service."

[1013] Membership terms summary function

[1014] This system provides a summary of the important points of the membership terms of the service specified by the user so that the user can efficiently understand the terms.

[1015] Hardware and software configuration:

[1016] User devices: PCs, smartphones, tablets, etc. Using a web browser or dedicated application.

[1017] Server: A high-performance server machine with web server software (Apache, Nginx, etc.).

[1018] Natural language processing engines: BeautifulSoup, Requests, NLTK, SpaCy, etc.

[1019] Examples:

[1020] For example, if a user is trying to sign up for a new video streaming service, they enter the URL of the membership terms and conditions page into the input form and click the submit button. The server retrieves the text data from the specified URL and analyzes it using a natural language processing engine. Important points such as "automatic renewal," "how to cancel," and "price changes" are extracted and presented to the user as a summary. An example of a prompt sentence: "Please tell me a summary of the membership terms and conditions for this video streaming service."

[1021] Membership registration status and password management function

[1022] This system has the function of safely managing users' membership registration information and passwords and providing feedback.

[1023] Hardware and software configuration:

[1024] User devices: PCs, smartphones, tablets, etc. Using a web browser or dedicated application.

[1025] Server: A high-performance server machine, including web server software (Apache, Nginx, etc.) and database management system (MongoDB, etc.).

[1026] Cryptography library: OpenSSL, bcrypt, etc.

[1027] Examples:

[1028] For example, if a user registers for service A and then later registers for service B, both registration information and passwords are encrypted and stored on the server. The database is periodically scanned to check the status of registration information and passwords, and an alert is sent to the user. An example prompt is: "Please check the services that manage my membership status and password."

[1029] Cancellation procedure support function

[1030] This system simplifies the process for users to cancel their service and helps them avoid missing the cancellation deadline.

[1031] Hardware and software configuration:

[1032] User devices: PCs, smartphones, tablets, etc. Using a web browser or dedicated application.

[1033] Server: A high-performance server machine, web server software (Apache, Nginx, etc.), and database management system.

[1034] RPA tools: UiPath, etc.

[1035] Examples:

[1036] For example, if a user wants to cancel a video streaming service, they select the service they wish to cancel and click the submit button. The server collects the information necessary for cancellation and generates a form and procedure for the cancellation procedure. The automatically filled-in cancellation form is displayed on the user's device, and after confirming it, the user can quickly complete the cancellation procedure. A notification is sent before the cancellation deadline to prevent users from forgetting to cancel. Example prompt: "Please help me with the procedure to cancel this video streaming service."

[1037] The above is a specific embodiment of the present invention. By using this system, users can efficiently use various services, avoid missing important information, safely manage data, and easily complete cancellation procedures.

[1038] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1039] Recommended features of the service

[1040] Processing Steps

[1041] Step 1:

[1042] The user's terminal displays a GUI (Graphical User Interface) for inputting service category information. Specifically, the HTML form has text boxes and drop-down menus, and the user inputs the desired service category.

[1043] Input: The user inputs the service category and clicks the submit button.

[1044] Output: The entered service category information is sent to the server.

[1045] Step 2:

[1046] The server analyzes the HTTP request received from the user's device and extracts the category information, which is included in the request.

[1047] Input: The server receives an HTTP request and parses the JSON data.

[1048] Output: Category information is extracted and used to perform database queries.

[1049] Step 3:

[1050] The server connects to a database (MySQL or PostgreSQL) based on the category information and executes a query to search for similar service information.

[1051] Input: Category information to use in database queries.

[1052] Output: Information about similar services (price, features, user reviews, etc.).

[1053] Step 4:

[1054] The server scores the extracted service information based on multiple evaluation criteria (price, features, user reviews, etc.), evaluates each service using machine learning libraries such as Scikit-learn and TensorFlow, and ranks them using a comparison algorithm.

[1055] Input: Extracted service information.

[1056] Output: Evaluation and scoring results.

[1057] Step 5:

[1058] The server converts the recommended service information selected by the comparison algorithm into JSON format and sends it to the user's device as an HTTP response.

[1059] Input: Evaluation and scoring results.

[1060] Output: Recommendation information in JSON format.

[1061] Step 6:

[1062] The user's device analyzes the HTTP response received from the server and displays recommended service information on the screen. The services are listed in order of ranking, and detailed information is also displayed.

[1063] Input: The HTTP response from the server.

[1064] Output: Recommended service information is displayed to the user.

[1065] Membership terms summary function

[1066] Processing Steps

[1067] Step 1:

[1068] The user's device displays an interface with an input field for obtaining the URL of the membership terms page and a "Submit" button.

[1069] Input: The user enters the URL of the membership agreement page and clicks the submit button.

[1070] Output: The entered URL information is sent to the server.

[1071] Step 2:

[1072] The server analyzes the HTTP request received from the user's terminal and extracts the URL.

[1073] Input: The server receives an HTTP request and parses the JSON data.

[1074] Output: The extracted URL.

[1075] Step 3:

[1076] The server accesses the specified URL and retrieves the HTML of the membership agreement page using a web scraping library such as BeautifulSoup or Requests.

[1077] Input: The HTTP request based on the extracted URL.

[1078] Output: The retrieved HTML data.

[1079] Step 4:

[1080] The server extracts text data from the HTML data and analyzes it using a natural language processing engine (NLTK or SpaCy).

[1081] Input: The retrieved HTML data.

[1082] Output: The extracted text data.

[1083] Step 5:

[1084] The server analyzes the text data and identifies important keywords and phrases using a natural language processing engine.

[1085] Input: Extracted text data.

[1086] Output: A list of key points.

[1087] Step 6:

[1088] The server summarizes the key points it has identified, presents them in an easy-to-understand format, and sends this to the user's device as a JSON response.

[1089] Input: A list of key points.

[1090] Output: Summary information in JSON format.

[1091] Step 7:

[1092] The user's device analyzes the summary information received from the server and displays it on the screen, with important points listed in bullet points.

[1093] Input: The HTTP response from the server.

[1094] Output: A summarized membership agreement is displayed to the user.

[1095] Membership registration status and password management function

[1096] Processing Steps

[1097] Step 1:

[1098] The user's device displays a form to sign up for a new service, which includes fields for entering a username, email address, and password.

[1099] Enter: The user enters the required registration information and clicks the submit button.

[1100] Output: The entered registration information is sent to the server.

[1101] Step 2:

[1102] The server analyzes the HTTP request received from the user's terminal and obtains the registration information.

[1103] Input: The server receives an HTTP request and parses the JSON data.

[1104] Output: The extracted registration information.

[1105] Step 3:

[1106] The server encrypts the registration information it receives using libraries such as OpenSSL and bcrypt.

[1107] Input: Extracted registration information.

[1108] Output: Encrypted registration information.

[1109] Step 4:

[1110] The server stores the encrypted registration information in a database (such as MongoDB).

[1111] Input: Encrypted registration information.

[1112] Output: Saved data.

[1113] Step 5:

[1114] The server periodically scans the database to check the validity of registration information and passwords, and can also use an external security API to check if passwords have been leaked.

[1115] Input: Database registration information and password.

[1116] Output: Check results and alert information.

[1117] Step 6:

[1118] The server will send the user a password change alert or a list of registration status via email or in-app notification as needed.

[1119] Input: Check results and alert information.

[1120] Output: Notification as feedback.

[1121] Step 7:

[1122] The user's device displays the notification and alert information received from the server, allowing the user to take the necessary action.

[1123] Input: Notifications and alerts from the server.

[1124] Output: Display of alerts and feedback information.

[1125] Cancellation procedure support function

[1126] Processing Steps

[1127] Step 1:

[1128] The user's device displays an interface for selecting the service they wish to cancel, including a list box and a search bar.

[1129] Input: The user selects the service they wish to cancel and clicks the submit button.

[1130] Output: The selected service information is sent to the server.

[1131] Step 2:

[1132] The server analyzes the HTTP request received from the user's terminal and obtains service information.

[1133] Input: The server receives an HTTP request and parses the JSON data.

[1134] Output: The extracted service information.

[1135] Step 3:

[1136] The server accesses the database and searches for and obtains the information necessary for the cancellation procedure (such as the URL for the procedure and the necessary forms).

[1137] Input: Service information.

[1138] Output: Cancellation procedure information (URL, form, etc.).

[1139] Step 4:

[1140] The server generates forms and instructions based on the acquired information to simplify the cancellation process, and uses RPA tools such as UiPath to automatically fill them in.

[1141] Input: Cancellation procedure information.

[1142] Output: The generated cancellation form.

[1143] Step 5:

[1144] The server sends the generated cancellation form to the user's terminal.

[1145] Input: Generated cancellation form.

[1146] Output: The URL of the cancellation form.

[1147] Step 6:

[1148] The user's terminal displays the cancellation form received from the server, allowing the user to confirm and submit the cancellation procedure.

[1149] Input: Cancellation form URL.

[1150] Output: The cancellation form displayed.

[1151] Step 7:

[1152] The server monitors the progress of the cancellation procedure and notifies the user's terminal of the information once the procedure is complete.

[1153] Input: Progress of cancellation procedure.

[1154] Output: Completion notification.

[1155] Step 8:

[1156] The user's terminal displays the confirmation of completion of the cancellation procedure received from the server so that the user can confirm it.

[1157] Input: Completion notification.

[1158] Output: Display of cancellation procedure completion information.

[1159] (Application example 1)

[1160] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1161] On conventional online shopping sites, when users select the product they want, it is difficult to find the best product from the wide range of information available, and in many cases, proper comparison and evaluation are not performed. It is also difficult to grasp a large amount of information at once, which makes selection laborious for users. Furthermore, there is a lack of an efficient way to grasp important information such as registration information and membership terms and conditions.

[1162] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1163] In this invention, the server

[1164] an input means for inputting a desired product category by the user;

[1165] extraction means for extracting related product information from a database based on the product category information input via the input means;

[1166] a comparison means for evaluating the products extracted by the extraction means using a comparison algorithm based on evaluation criteria such as price, function, and reviews;

[1167] a presentation means for presenting optimal products based on the evaluation results by the comparison means;

[1168] An acquisition means for acquiring text data of the membership terms and conditions of the product designated by the user;

[1169] natural language processing means for analyzing the text data acquired by the acquisition means and extracting important points;

[1170] a presentation means for presenting the important points extracted by the natural language processing means to a user as a summary;

[1171] an input means for inputting registration information to be input when a user registers for a new service;

[1172] a storage means for encrypting and storing the registration information input by the input means;

[1173] a check means for periodically checking the registration information stored in the storage means and providing feedback to the user;

[1174] Includes.

[1175] This not only allows users to easily compare and evaluate the products they want and select the most suitable product, but also allows them to efficiently understand important information such as membership terms and conditions, and allows them to safely and conveniently manage their registration information.

[1176] The "input means" is a means for the user to input desired product category information.

[1177] The "extraction means" is a means for extracting related product information from the database based on the product category information input via the input means.

[1178] The "comparison means" is a means for evaluating the products extracted by the extraction means using a comparison algorithm based on evaluation criteria such as price, function, and reviews.

[1179] The "presentation means" is a means for presenting the most suitable product to the user based on the evaluation results by the comparison means.

[1180] The "acquisition means" is a means for acquiring text data of the membership terms and conditions of the product designated by the user.

[1181] The "natural language processing means" is a means for analyzing the text data acquired by the acquisition means and extracting important points.

[1182] The "storage means" is a means for encrypting and storing the registration information input by the input means.

[1183] The "checking means" is a means for periodically checking the registration information stored in the storage means and providing feedback to the user.

[1184] The present invention provides a system that inputs desired product category information from a user and presents optimal products based on that information. This system is made up of the following main components:

[1185] First, a user inputs a product category using a smartphone or other mobile device. A mobile application is used as the input means, and an interface built using a front-end library such as React Native is provided. When category information is input through the user interface in this application, the information is sent to the server.

[1186] The server extracts related product information from a database based on the input information. Databases such as SQLite and MongoDB are often used. The extraction method is implemented using a Python backend that uses the Flask framework. This backend retrieves product data from the database that corresponds to the product category information entered by the user.

[1187] Next, the extracted product information is compared based on evaluation criteria such as price, features, and reviews. An evaluation algorithm is used as the comparison method, using libraries such as Python's scikit-learn or TensorFlow. The evaluation algorithm compares the characteristic values ​​of each product and selects the most suitable product.

[1188] The information about the selected products is presented to the user by a presentation means, again using a mobile application, and the selection results are displayed on a user interface, allowing the user to easily check the optimal products that have been selected.

[1189] It also has a means to retrieve and analyze the text data of the membership terms and conditions for the product specified by the user. The retrieval method is a backend using Flask that sends a request to the URL to retrieve the text data. For natural language processing, it uses Python natural language processing libraries NLTK and SpaCy to analyze and extract important points from the text and present them to the user as a summary.

[1190] In addition, there is also a means for users to input registration information when registering for a new service, and for this information to be encrypted and stored. The aforementioned mobile application is used as the input means. The input registration information is securely stored in encrypted form in the storage means. For example, an encryption algorithm such as AES (Advanced Encryption Standard) is used. The registration information stored in the storage means is checked periodically, and feedback is provided to the user regarding password changes and registration status. A Flask-based backend manages this periodic job.

[1191] Here's a specific example: When a user accesses a smartphone application and types in "smartphone," the server selects the product with the highest review rating from candidates such as "iPhone 14" and "latest smartphone models" and displays it to the user.

[1192] Examples of prompts using generative AI models include:

[1193] "Please select a service category: [Smartphones, Home Appliances, Clothing, ...]"

[1194] -> Smartphone

[1195] Looking for smartphone recommendations based on price, features, and user reviews?

[1196] -> Recommended Smartphone: Latest Smartphone Model (Price: $899, Review: 4.7)

[1197] As described above, the present invention provides a system that allows users to easily compare and evaluate desired products and select the most suitable product. In addition, it also allows users to efficiently understand important information such as membership terms and conditions, and allows for safe and convenient management of registration information.

[1198] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1199] Step 1:

[1200] The user starts the smartphone application and inputs the desired product category. This input is done through the user interface. The input data is formatted in JSON format or similar and sent to the server.

[1201] Input: Product category entered through a smartphone application (e.g., "smartphone").

[1202] Output: Product category information sent to the server.

[1203] Specific behavior:

[1204] Enter the category in the input field on the smartphone's user interface and press the "Send" button to send the data to the server.

[1205] Step 2:

[1206] The server extracts related product information from the database based on the received product category information, and executes a database query to obtain the corresponding product data.

[1207] Input: Product category information (e.g., "Smartphone").

[1208] Output: A list of relevant product data (e.g., information on multiple smartphone models).

[1209] Specific behavior:

[1210] The server executes SQL queries based on the product category information and extracts relevant product data from the database.

[1211] Step 3:

[1212] The server compares the extracted product data using a rating algorithm that calculates a rating score for the product based on criteria such as price, features, and review ratings.

[1213] Input: Extracted product data.

[1214] Output: Rating score for each product.

[1215] Specific behavior:

[1216] The server calculates the characteristics of each extracted product (price, features, review rating, etc.) and calculates a score for each product using a rating algorithm.

[1217] Step 4:

[1218] The server selects the best product based on the rating score, with the product with the highest score being chosen as the best product.

[1219] Input: Rating score for each product.

[1220] Output: The best products (e.g., smartphone models with the highest reviews).

[1221] Specific behavior:

[1222] The server compares the evaluation scores and selects the product with the highest score.

[1223] Step 5:

[1224] The server transmits the selected optimal product to the user's terminal, including detailed information about the selected product.

[1225] Input: Optimal product information.

[1226] Output: Product details sent to the user's device.

[1227] Specific behavior:

[1228] The server formats detailed information about the best products and sends it to the user's device in JSON format or similar.

[1229] Step 6:

[1230] The user's device displays the received product information, and the user can check the selected optimal product through the application interface.

[1231] Input: Product details sent from the server.

[1232] Output: Product information displayed on the user interface.

[1233] Specific behavior:

[1234] The smartphone application reflects the received data on the user interface and displays it to the user.

[1235] The above processing steps realize a system that allows a user to simply input a desired product category and select the most suitable product.

[1236] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1237] MODE FOR CARRYING OUT THE INVENTION

[1238] Recommended features of the service

[1239] overview

[1240] In this invention, we build a system in which a user inputs the category of service they want, and the server compares and evaluates similar services and presents recommended services. Furthermore, we combine it with an emotion engine that recognizes the user's emotions to improve the user experience.

[1241] Program processing

[1242] 1. The user's terminal displays an interface for inputting service category information.

[1243] 2. The user enters the category information of the desired service and submits it.

[1244] 3. The server receives the input category information and extracts related service information from the database based on that information.

[1245] 4. The server evaluates the extracted services based on price, features, user reviews, etc., and selects the most suitable service using a comparison algorithm.

[1246] 5. The emotion engine recognizes the user's emotions using data collected from the user's device.

[1247] 6. The server adjusts the list of recommended services based on the user's emotions recognized by the emotion engine.

[1248] 7. The server sends the optimal recommended service to the user's device.

[1249] 8. The user's device will display recommended services for the user to review.

[1250] Specific examples

[1251] For example, if a user desires a "video streaming service" and is feeling stressed, the server will extract service information from Netflix, Hulu, Amazon Prime Video, etc., and compare them based on their prices, features, and user reviews. If the emotion engine recognizes that the user is feeling stressed, the server will prioritize recommending services with an abundance of content that has a relaxing effect to reduce stress.

[1252] Membership terms summary function

[1253] overview

[1254] To help users understand the membership terms of a service efficiently, we provide a system in which the server extracts and summarizes the important points of the membership terms. Furthermore, by combining it with an emotion engine, we provide explanations that correspond to the user's emotions.

[1255] Program processing

[1256] 1. The user's device displays an interface for obtaining the URL of the membership terms page.

[1257] 2. The user enters the URL of the membership terms page and submits it.

[1258] 3. The server retrieves the text data of the membership terms page based on the entered URL.

[1259] 4. The server analyzes the text data using a natural language processing engine and extracts important points.

[1260] 5. The emotion engine recognizes the user's emotions using data collected from the user's device.

[1261] 6. The server adjusts the summarized content of the terms and conditions based on the user's emotions recognized by the emotion engine and provides it in a form appropriate for the user.

[1262] 7. The server sends the summary results to the user's terminal.

[1263] 8. The user's device will display a summary of the membership terms and conditions for the user to review.

[1264] Specific examples

[1265] For example, if a user is feeling anxious about signing up for a new video streaming service, the server can analyze the URL of the membership terms and conditions, extract important points such as "automatic renewal," "how to cancel," and "price changes," and provide a summary highlighting particularly reassuring information to alleviate the anxiety recognized by the emotion engine.

[1266] Membership registration status and password management function

[1267] overview

[1268] The system aims to securely manage users' membership registration information and passwords, and provide regular feedback. Furthermore, by combining it with an emotion engine, it provides feedback according to the user's emotions.

[1269] Program processing

[1270] 1. The user's device displays a form for registering for the service.

[1271] 2. The user enters the required registration information (username, email address, password, etc.) and submits it.

[1272] 3. The server receives the entered information, encrypts it, and stores it in a database.

[1273] 4. The server periodically scans the database to check the status of registration information and passwords.

[1274] 5. The emotion engine recognizes the user's emotions using data collected from the user's device.

[1275] 6. The server adjusts feedback regarding password and registration information management based on the user's emotions recognized by the emotion engine.

[1276] 7. The server sends the adjusted feedback to the user's device.

[1277] 8. The user's device displays the feedback for the user to review.

[1278] Specific examples

[1279] For example, if a user feels confused or hesitant when signing up for a new service, the server can encrypt and store the registration information and password, and provide clear and reassuring feedback based on the user's emotions as recognized by the emotion engine.

[1280] Cancellation procedure support function

[1281] overview

[1282] We provide a system that simplifies the process for users to cancel their service and prevents them from missing the cancellation deadline. Furthermore, by combining it with an emotion engine, we provide support that responds to the user's emotions.

[1283] Program processing

[1284] 1. The user's device displays an interface for selecting the service they wish to cancel.

[1285] 2. The user selects the service they wish to cancel and submits it.

[1286] 3. The server retrieves information regarding the cancellation procedure for the relevant service from the database.

[1287] 4. The server generates forms and instructions to simplify the cancellation process.

[1288] 5. The emotion engine recognizes the user's emotions using data collected from the user's device.

[1289] 6. The server provides appropriate support for the cancellation procedure based on the user's emotions recognized by the emotion engine.

[1290] 7. The server automatically fills in the cancellation form and sends it to the user's device.

[1291] 8. The user's device will display an automatically filled-in cancellation form to facilitate the cancellation process.

[1292] 9. The server checks the progress of the cancellation procedure and sends a completion notification to the user's device.

[1293] 10. The user's device will display the completion status of the cancellation procedure so that the user can check it.

[1294] Specific examples

[1295] For example, if a user is trying to cancel a video streaming service but is finding it troublesome, the server obtains information about the cancellation procedure, and in order to reduce the hassle recognized by the emotion engine, simplifies the steps of the cancellation procedure and provides support that allows the user to cancel with peace of mind.

[1296] As described above, the system of the present invention provides a wide range of functions to improve user convenience, and by combining it with an emotion engine, it significantly improves the user experience.

[1297] The processing flow will be explained below.

[1298] Recommended features of the service

[1299] Program processing

[1300] Step 1:

[1301] The user's terminal displays an interface for inputting service category information, allowing the user to input the information.

[1302] Step 2:

[1303] The user inputs the category information of the desired service and presses the send button.

[1304] Step 3:

[1305] The server receives the category information sent by the user.

[1306] Step 4:

[1307] The server extracts the corresponding service information from the database based on the received category information.

[1308] Step 5:

[1309] The server evaluates the extracted service information based on price, features, user reviews, etc.

[1310] Step 6:

[1311] The emotion engine analyzes the user's emotions based on data collected from the user's device.

[1312] Step 7:

[1313] The server receives the analyzed emotion data and reflects it in the evaluation algorithm to compare services.

[1314] Step 8:

[1315] The server generates a list of optimal recommended services and sends it to the user's terminal.

[1316] Step 9:

[1317] The user's device displays a list of recommended services and asks the user to confirm them.

[1318] Membership terms summary function

[1319] Program processing

[1320] Step 1:

[1321] The user's device displays an interface for entering the URL of the membership agreement page.

[1322] Step 2:

[1323] The user enters the URL for the membership agreement and submits it.

[1324] Step 3:

[1325] The server retrieves the text data of the membership terms page based on the sent URL.

[1326] Step 4:

[1327] The server analyzes the acquired text data using a natural language processing engine.

[1328] Step 5:

[1329] The server extracts important points from the text data.

[1330] Step 6:

[1331] The emotion engine analyzes the user's emotions based on data collected from the user's device.

[1332] Step 7:

[1333] The server adjusts the summarized membership agreement based on the analyzed emotion data.

[1334] Step 8:

[1335] The server transmits the adjusted summary result to the user's terminal.

[1336] Step 9:

[1337] The user's terminal displays the summarized membership terms and conditions and asks the user to confirm them.

[1338] Membership registration status and password management function

[1339] Program processing

[1340] Step 1:

[1341] The user's device displays a form for registering for the service.

[1342] Step 2:

[1343] The user enters the required registration information (user name, email address, password, etc.) and submits it.

[1344] Step 3:

[1345] The server receives the entered information, encrypts it, and stores it in a database.

[1346] Step 4:

[1347] The server periodically scans the database to check the status of registration information and passwords.

[1348] Step 5:

[1349] The emotion engine analyzes the user's emotions based on data collected from the user's device.

[1350] Step 6:

[1351] The server adjusts feedback regarding password and registration information management based on the analyzed emotional data.

[1352] Step 7:

[1353] The server transmits the adjusted feedback to the user's terminal.

[1354] Step 8:

[1355] The user's terminal displays the feedback for the user to confirm.

[1356] Cancellation procedure support function

[1357] Program processing

[1358] Step 1:

[1359] The user's terminal displays an interface for selecting the service the user wishes to cancel.

[1360] Step 2:

[1361] The user selects the service they wish to cancel and submits it.

[1362] Step 3:

[1363] The server retrieves information about the cancellation procedure for the relevant service from the database.

[1364] Step 4:

[1365] The server generates forms and instructions to simplify the cancellation process.

[1366] Step 5:

[1367] The emotion engine analyzes the user's emotions based on data collected from the user's device.

[1368] Step 6:

[1369] The server provides optimal support for cancellation procedures based on the analyzed emotion data.

[1370] Step 7:

[1371] The server sends the automatically filled-out cancellation form to the user's terminal.

[1372] Step 8:

[1373] The user's device will display a cancellation form that the user can easily fill out and submit.

[1374] Step 9:

[1375] The server checks the progress of the cancellation procedure and sends a completion notice to the user's terminal.

[1376] Step 10:

[1377] The user's terminal displays the completion status of the cancellation procedure and asks the user to confirm it.

[1378] Example 2

[1379] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1380] Previous service proposal systems and membership agreement summary systems failed to adequately address user needs and emotions, making it difficult to improve the user experience. Furthermore, when registering for a new service, there were insufficient measures to alleviate user anxiety and confusion regarding the management of registration information and feedback, resulting in a poor user experience. The service cancellation process was also complicated, and there was a risk of missing deadlines.

[1381] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1382] In this invention, the server includes: input means for inputting a category of service desired by the user; extraction means for extracting similar service information from a database based on category information input via the input means; comparison means for evaluating and comparing the similar services extracted by the extraction means using a plurality of indicators such as price, functionality, and user reviews; presentation means for presenting recommended services based on the comparison results by the comparison means; emotion recognition means for recognizing a user's emotion; adjustment means for adjusting a list of recommended services based on the user's emotion recognized by the emotion recognition means; means for presenting to the user the optimal recommended service adjusted by the adjustment means; acquisition means for acquiring text data of membership terms and conditions specified by the user; analysis means for analyzing the text data acquired by the acquisition means using a natural language processing engine and extracting important points; presentation means for presenting to the user the important points extracted by the analysis means as a summary; input means for inputting registration information entered by the user when registering for a new service; storage means for encrypting and storing the registration information input by the input means; and check means for periodically checking the registration information stored in the storage means and providing feedback to the user. This enables the recommendation of optimal services based on the user's needs and emotions, easy-to-understand summaries of membership terms and conditions, secure management of registration information, and prompt feedback.

[1383] The "input means" is a device or function that provides an interface for the user to input the category of service desired and registration information.

[1384] The "extraction means" is a device or function that extracts related service information from the database based on the input category information.

[1385] A "comparison means" is a device or function that evaluates and compares extracted services based on multiple indicators such as price, functionality, and user reviews.

[1386] The "presentation means" is a device or function that presents the user with recommended content or summary information based on the results of the comparison means and analysis means.

[1387] The "emotion recognition means" is a device or function that analyzes the user's input speed, keystroke patterns, facial recognition data, etc., and recognizes the user's emotions.

[1388] The "adjustment means" is a device or function that adjusts the recommendation content and summary information based on the user's emotion recognized by the emotion recognition means.

[1389] The "acquisition means" is a device or function for acquiring the text data of the membership terms and conditions specified by the user from the Internet.

[1390] The "analysis means" is a device or function that analyzes the text data acquired by the acquisition means using a natural language processing engine and extracts important points.

[1391] The "storage means" is a device or function that encrypts the registration information entered by the input means and stores it in a database.

[1392] The "checking means" is a device or function that periodically scans the registration information stored in the storage means and provides feedback to the user.

[1393] This invention provides a system that allows users to input the category of services they desire, a system that recommends them, a system that summarizes the membership terms of the services specified by the user, and a system that manages users' registration information and passwords. Furthermore, it combines this with a system that supports cancellation procedures and utilizes an emotion recognition engine to improve the user experience.

[1394] Recommended features of the service

[1395] The user's device displays an interface for entering service category information. When the user enters and submits the category information for the service they desire, the server receives that information and uses an SQL query to extract related service information from a database. The extracted services are then evaluated and compared using multiple indicators, such as price, features, and user reviews, using a Python or Java program. TensorFlow is also used as an emotion engine to analyze data collected from the user's device (such as input speed, keystroke patterns, and facial recognition data) to recognize the user's emotions. The server adjusts the list of recommended services based on the emotion recognition results and sends the optimal service recommendation information in JSON format to the user's device. The device then parses the received data and displays it in a visually easy-to-understand format.

[1396] As a specific example, if a user requests a "video streaming service" and is feeling stressed, the server will evaluate services such as Netflix, Hulu, and Amazon Prime Video and prioritize recommending content that has a high relaxing effect.

[1397] Example prompt sentence:

[1398] "Can you recommend a video streaming service? I've been feeling stressed at work lately, so I'm looking for content that helps me relax."

[1399] Membership terms summary function

[1400] The user's device displays an interface for entering the URL of the membership terms page. When the user enters the URL and submits it, the server retrieves the text data of the membership terms from that URL. The server analyzes the retrieved text data using SpaCy and NLTK to extract important points such as "automatic renewal," "cancellation method," and "price changes." The IBM Watson Tone Analyzer is used as an emotion engine to recognize emotions from the user's input and operation patterns, and adjusts the summary by adding information that alleviates anxiety and confusion. The adjusted summary is sent to the user's device in JSON format and displayed in an easy-to-understand manner.

[1401] As a concrete example, if a user is feeling anxious about signing up for a new video streaming service, a summary highlighting the key points that will reassure them is provided.

[1402] Example prompt sentence:

[1403] "I would like to check the membership terms of a new video streaming service, so I am entering its URL. I am feeling uneasy, so please summarize the important points in an easy-to-understand way."

[1404] Membership registration status and password management function

[1405] The user's device displays a form for registering for the service. When the user enters and submits the required registration information (username, email address, password, etc.), the server encrypts the information using encryption technology such as AES and stores it in a database. The server periodically scans the database to check the expiration date of the registration information and the strength of the password. As an emotion engine, it recognizes emotions from biometric data, input speed, and operation patterns, and sends easy-to-understand feedback in JSON format to the user's device, which displays it on the screen.

[1406] For example, if a user is feeling confused or overwhelmed when signing up for a new service, providing feedback that is particularly reassuring.

[1407] Example prompt sentence:

[1408] "I signed up for a new service, but I'm worried about managing my registration information and password. I'd appreciate some clear feedback."

[1409] Cancellation procedure support function

[1410] The user's device displays an interface for selecting the service they wish to cancel. When the user selects and submits the service they wish to cancel, the server retrieves information about the cancellation procedure for that service from a database and generates a form and instructions for a simplified cancellation process. The emotion engine performs emotion recognition, simplifies the steps in the cancellation process, and provides information that gives a sense of security. The server automatically fills in the cancellation form and sends it in JSON format to the user's device. The device parses the received data to make it easy to complete the cancellation process. The progress of the cancellation process is checked, and a completion notification is sent to the user's device and displayed on the screen.

[1411] As a specific example, if a user is having trouble canceling a video streaming service, we will simplify the steps in the cancellation process and help them cancel easily.

[1412] Example prompt sentence:

[1413] "I want to cancel my video streaming service, but the process is complicated. Please provide a simplified method."

[1414] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1415] Recommended features of the service

[1416] Processing Steps

[1417] Step 1:

[1418] The user's terminal displays an interface for inputting service category information.

[1419] Input: Category selection screen for the user

[1420] Output: User category selection and input

[1421] Specific behavior: A user interface built with HTML / CSS is launched, displaying input fields where the user can enter information and a submit button.

[1422] Step 2:

[1423] The user inputs and submits the category information of the desired service.

[1424] Input: Service category information (e.g. video streaming service)

[1425] Output: Sent to the server as an HTTP request

[1426] Specific behavior: When a user enters category information into the text field and clicks the submit button, the input data is sent to the server as an HTTP POST request.

[1427] Step 3:

[1428] The server receives the input category information and extracts related service information from the database based on that information.

[1429] Input: Category information

[1430] Output: Extracted service information

[1431] Specific operation: The server executes an SQL query to extract the corresponding service information from a database (e.g. MySQL).

[1432] Step 4:

[1433] The server evaluates the extracted services based on price, features, user reviews, etc., and uses a comparison algorithm to select the most suitable service.

[1434] Input: Extracted service information

[1435] Output: The result of the comparison algorithm that was performed.

[1436] How it works: The server uses Python or Java programs to score each service's metrics (price, features, reviews) and run comparison algorithms such as weighted averages.

[1437] Step 5:

[1438] The emotion engine recognizes the user's emotions using data collected from the user's device.

[1439] Input: User operation data (typing speed, keystroke patterns, facial recognition data, etc.)

[1440] Output: Recognized emotion data

[1441] Specific operation: The emotion engine uses a machine learning model (e.g., TensorFlow) to analyze user operation data and recognize emotions (stress, relaxation, etc.).

[1442] Step 6:

[1443] The server adjusts the list of recommended services based on the user's emotions recognized by the emotion engine.

[1444] Input: Comparison results and emotion data

[1445] Output: A tailored list of recommended services

[1446] How it works: The server reevaluates the results of the comparison algorithm and optimizes the service list based on the emotional data, for example prioritizing services with a relaxing effect for a user who is feeling stressed.

[1447] Step 7:

[1448] The server sends the optimal recommended service to the user's terminal.

[1449] Input: Adjusted service list

[1450] Output: Recommendation service data sent to the user's device

[1451] Specific operation: The server generates a list of recommended services in JSON format and sends it to the user's device as an HTTP response.

[1452] Step 8:

[1453] The user's device displays the recommended services so that the user can check them.

[1454] Input: Submitted recommendation service data

[1455] Output: Displayed list of recommended services

[1456] What it does: The device parses the data it receives and displays it to the user in a visually understandable format, such as a card displaying the name, price, key features, and reviews of each service.

[1457] Membership terms summary function

[1458] Processing Steps

[1459] Step 1:

[1460] The user's terminal displays an interface for obtaining the URL of the membership terms page.

[1461] Input: Membership Terms URL input screen

[1462] Output: User input URL and submit

[1463] Specific behavior: The user interface will launch and display a text field for entering the URL of the membership agreement and a submit button.

[1464] Step 2:

[1465] The user enters the URL of the membership agreement page and submits it.

[1466] Input: Membership Terms and Conditions page URL

[1467] Output: Sent to the server as an HTTP request

[1468] Specific behavior: When a user enters a URL and clicks the submit button, the input data is sent to the server as an HTTP POST request.

[1469] Step 3:

[1470] The server retrieves the text data of the membership agreement page based on the entered URL.

[1471] Input: Membership Terms URL

[1472] Output: The retrieved text data

[1473] Specific operation: The server uses an HTTP GET request to download the HTML content of the membership agreement from the specified URL and converts it into data for text analysis.

[1474] Step 4:

[1475] The server analyzes the text data using a natural language processing engine and extracts important points.

[1476] Input: Obtained text data

[1477] Output: Extracted key points

[1478] What it does: The server uses a natural language processing engine (e.g., SpaCy, NLTK) to parse the text of the membership agreement and extract key phrases and sentences such as "auto-renewal," "how to cancel," and "price change."

[1479] Step 5:

[1480] The emotion engine recognizes the user's emotions using data collected from the user's device.

[1481] Input: User operation data (typing speed, keystroke patterns, etc.)

[1482] Output: Recognized emotion data

[1483] Specific operation: The emotion engine uses a machine learning model (e.g., IBM Watson Tone Analyzer) to analyze the user's operation data and recognize emotions (anxiety, relief, etc.).

[1484] Step 6:

[1485] The server adjusts the summarized content of the terms and conditions based on the user's emotions recognized by the emotion engine and provides it in a form suitable for the user.

[1486] Input: Extracted key points and sentiment data

[1487] Output: Adjusted summary content

[1488] What it does: The server adjusts the summary based on the emotion data, optimizing the summary by adding reassuring information especially for anxious users.

[1489] Step 7:

[1490] The server transmits the summary result to the user's terminal.

[1491] Input: Adjusted summary content

[1492] Output: Summary data sent to the user's terminal

[1493] Specific operation: The server packages the generated summary content in JSON format and sends it to the user's device as an HTTP response.

[1494] Step 8:

[1495] The user's terminal displays the summarized membership terms and conditions for the user to review.

[1496] Input: Summary data sent

[1497] Output: The displayed summary

[1498] Specific operation: The device parses the data it receives, highlights important points with colors and markers, and displays them to the user in a visually easy-to-understand format.

[1499] Membership registration status and password management function

[1500] Processing Steps

[1501] Step 1:

[1502] The user's terminal displays a form for registering for the service.

[1503] Input: Registration form screen

[1504] Output: User input and transmission

[1505] What happens: The user interface launches and displays a form for entering username, email address, password, etc.

[1506] Step 2:

[1507] The user enters the required registration information (user name, email address, password, etc.) and submits it.

[1508] Input: Registration information (username, email address, password, etc.)

[1509] Output: Sent to the server as an HTTP request

[1510] Specific behavior: When a user enters the required information into the form fields and clicks the submit button, the input data is sent to the server as an HTTP POST request.

[1511] Step 3:

[1512] The server receives the entered information, encrypts it, and stores it in a database.

[1513] Input: Registration information

[1514] Output: Encrypted registration information stored in a database

[1515] Specific operation: The server encrypts the data it receives using encryption technology such as AES and stores it in a database (e.g., MySQL).

[1516] Step 4:

[1517] The server periodically scans the database to check the status of registration information and passwords.

[1518] Input: Registration information in the database

[1519] Output: Password and registration information validity check results

[1520] What it does: The server sets up a scheduled job to periodically scan the database for password expiration and strength.

[1521] Step 5:

[1522] The emotion engine recognizes the user's emotions using data collected from the user's device.

[1523] Input: User operation data (typing speed, keystroke patterns, etc.)

[1524] Output: Recognized emotion data

[1525] Specific operation: The emotion engine analyzes biometric data and operation patterns to recognize the user's emotions (e.g., relief, anxiety).

[1526] Step 6:

[1527] The server adjusts feedback regarding password and registration information management based on the user's emotions recognized by the emotion engine.

[1528] Input: Password and registration information check results and emotional data

[1529] Output: Adjusted feedback content

[1530] What it does: The server uses the recognized emotion data to tailor the feedback and add clear explanations and hints to reduce the user's anxiety and confusion.

[1531] Step 7:

[1532] The server transmits the adjusted feedback to the user's terminal.

[1533] Input: Adjusted feedback

[1534] Output: Feedback data sent to the user's device

[1535] Specific operation: The server packages the generated feedback content in JSON format and sends it to the user's device as an HTTP response.

[1536] Step 8:

[1537] The user's terminal displays the feedback for the user to review.

[1538] Input: Submitted feedback data

[1539] Output: The displayed feedback

[1540] What it does: Parses the data the device receives and displays it visually as alerts and tips.

[1541] Cancellation procedure support function

[1542] Processing Steps

[1543] Step 1:

[1544] The user's terminal displays an interface for selecting the service that the user wishes to cancel.

[1545] Input: Cancellation service selection screen

[1546] Output: User service selection and transmission

[1547] Specific behavior: A user interface will launch, displaying a list and checkboxes for selecting the services you wish to cancel.

[1548] Step 2:

[1549] The user selects the service for which they wish to cancel and submits the selection.

[1550] Input: Service information you wish to cancel

[1551] Output: Sent to the server as an HTTP request

[1552] Specific operation: When the user selects a service and clicks the submit button, the selected data is sent to the server as an HTTP POST request.

[1553] Step 3:

[1554] The server retrieves information regarding the cancellation procedure for the relevant service from the database.

[1555] Input: Service information you wish to cancel

[1556] Output: Cancellation procedure information

[1557] Specific operation: The server retrieves information about the cancellation procedure for the relevant service from the database and extracts the necessary procedure information.

[1558] Step 4:

[1559] The server generates forms and procedures that simplify the cancellation process.

[1560] Input: Cancellation procedure information

[1561] Output: Simplified cancellation form and instructions

[1562] Specific operation: Using the cancellation procedure information obtained by the server, generate a form and instructions that allow the user to easily cancel.

[1563] Step 5:

[1564] The emotion engine recognizes the user's emotions using data collected from the user's device.

[1565] Input: User operation data (typing speed, keystroke patterns, etc.)

[1566] Output: Recognized emotion data

[1567] Specific operation: The emotion engine analyzes the user's operation data and recognizes the user's emotions (annoyance, relief, etc.).

[1568] Step 6:

[1569] The server provides support appropriate for the cancellation procedure based on the user's emotions recognized by the emotion engine.

[1570] Input: Tailored cancellation form and sentiment data

[1571] Output: Adjusted cancellation support details

[1572] Specific operation: The server adjusts the procedures and explanations based on the emotion data to make the cancellation process easy and safe.

[1573] Step 7:

[1574] The server automatically fills in the cancellation form and sends it to the user's terminal.

[1575] Input: Adjusted cancellation support details

[1576] Output: Cancellation form data sent to the user's device

[1577] Specific operation: The cancellation form generated by the server is automatically filled in, packaged in JSON format, and sent to the user's device as an HTTP response.

[1578] Step 8:

[1579] The user's device will display an automatically filled-in cancellation form, making it easy to complete the cancellation procedure.

[1580] Input: Submitted cancellation form data

[1581] Output: Cancellation form displayed

[1582] What happens: The device parses the data it receives and displays a pre-filled cancellation form to the user.

[1583] Step 9:

[1584] The server checks the progress of the cancellation procedure and sends a completion notice to the user's terminal.

[1585] Input: Cancellation procedure progress

[1586] Output: A completion notification sent to the user's device

[1587] Specific operation: The server monitors the progress of the cancellation procedure, generates a notification when the procedure is complete, and sends it to the user's device as an HTTP response.

[1588] Step 10:

[1589] The user's terminal displays the completion status of the cancellation procedure so that the user can check it.

[1590] Input: Completion notification sent

[1591] Output: Displayed completion notification

[1592] Specific operation: The device parses the received data and displays the completion status of the cancellation procedure to the user.

[1593] (Application example 2)

[1594] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1595] Conventional service recommendation systems only provide similar service information based on the category of service desired by the user, but they are unable to take the user's emotional state into account when making recommendations, making it difficult to provide an optimal user experience. It is also difficult for users to understand the membership terms and conditions and information provided related to the service they desire, which increases user stress. Furthermore, there are insufficient measures to alleviate confusion and bewilderment when users sign up for a new service.

[1596] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes an input means for inputting a category of a service desired by the user, an extraction means for extracting similar service information from a database based on the category information input via the input means, a comparison means for comparing the similar services extracted by the extraction means using an evaluation algorithm, a presentation means for presenting recommended services based on the comparison results by the comparison means, an emotion recognition means for recognizing the user's emotion, and an adjustment means for adjusting the presentation results of recommended services based on the user's emotion recognized by the emotion recognition means. This enables optimal service recommendation taking the user's emotion into consideration.

[1597] The server also includes an acquisition means for acquiring text data of the membership terms of the service designated by the user, a natural language processing means for analyzing the text data acquired by the acquisition means and extracting important points, a presentation means for presenting the important points extracted by the natural language processing means as a summary to the user, an emotion recognition means for recognizing the user's emotion, and an adjustment means for adjusting the summary content based on the user's emotion recognized by the emotion recognition means, thereby making it possible to provide a summary of the membership terms and conditions taking the user's emotion into consideration and promote understanding.

[1598] The server further includes an input means for inputting registration information entered by the user when registering for a new service, a storage means for encrypting and storing the registration information input by the input means, a check means for periodically checking the registration information stored in the storage means and providing feedback to the user, an emotion recognition means for recognizing the user's emotion, and an adjustment means for adjusting the feedback content based on the user's emotion recognized by the emotion recognition means. This makes it possible to manage the registration information and provide feedback taking the user's emotion into consideration, thereby reducing user confusion and bewilderment.

[1599] The "input means" is a device or interface for a user to input service category information and registration information.

[1600] The "extraction means" is a device or algorithm that extracts relevant information from the database based on information input through the input means.

[1601] The "comparison means" is a device or algorithm that uses an evaluation algorithm to perform a comparative analysis using the information extracted by the extraction means.

[1602] The "presentation means" is a device or interface that presents the most suitable service or information to the user based on the analysis results by the comparison means.

[1603] An "emotion recognition means" is a device or algorithm for recognizing a user's emotions, and analyzes audio and video using a camera or microphone.

[1604] The "adjustment means" is a device or algorithm that adjusts the presented service information or recommendation results based on the user's emotions recognized by the emotion recognition means.

[1605] The "acquisition means" is a device or interface for acquiring text data and membership terms and conditions specified by the user.

[1606] A "natural language processing means" is a device or algorithm for analyzing acquired text data and extracting important points.

[1607] "Storage means" refers to a device or database for encrypting and safely storing user registration information.

[1608] The "checking means" is a device or algorithm that periodically checks the registration information stored in the storage means and provides feedback to the user.

[1609] The present invention is a system for recognizing a user's emotions and recommending optimal services and products based on the emotions. Hereinafter, an embodiment of the present invention will be described in detail.

[1610] System Configuration

[1611] This system consists of an "input means" for users to input desired services and product categories, an "extraction means" for extracting relevant information from a database based on the user's input, a "comparison means" for evaluating and comparing the extracted information, an "emotion recognition means" for recognizing the user's emotions, an "adjustment means" for adjusting recommendations based on the emotion recognition results, and a "presentation means" for presenting the final recommendation results to the user.

[1612] Hardware and Software

[1613] 1. Hardware

[1614] Smartphone: User input, emotion recognition using camera and microphone

[1615] Server: Database management, high-performance CPU, GPU

[1616] 2. Software

[1617] Smartphone app: Developed with React Native

[1618] Server side: Developed in Python (Django)

[1619] Database: PostgreSQL

[1620] Emotion recognition engine: Google Cloud Vision API, IBM Watson Tone Analyzer

[1621] Processing flow

[1622] The system operates as follows:

[1623] 1. Input method (within smartphone app)

[1624] The user enters the desired service or product category, for example, "home coffee maker."

[1625] 2. Extraction method (server)

[1626] It receives information entered by the user and extracts relevant product information from a database.

[1627] 3. Comparison Method (Server)

[1628] The extracted product information is compared based on price, ratings, features, etc.

[1629] 4. Emotion Recognition Methods (Smartphone App and Cloud API)

[1630] Analyzes emotions using the user's camera footage and voice using Google Cloud Vision API and IBM Watson Tone Analyzer.

[1631] 5. Coordination mechanism (server)

[1632] Based on the emotion recognition results, product information suitable for the user's emotional state is adjusted.

[1633] 6. Presentation method (within smartphone app)

[1634] The final recommendation results are presented to the user.

[1635] Specific examples

[1636] For example, if a user requests a "home coffee maker" and the emotion recognition means recognizes that the user is feeling stressed, the server can prioritize and recommend products that are easy to operate and effective in reducing stress.

[1637] Prompt Sentence Examples

[1638] "Product category: Home coffee maker"

[1639] "User Emotions: Stress"

[1640] "Emotion Engine Recommendations: Easy Operation, Low Price, Relaxing Features"

[1641] This system configuration and processing procedure makes it possible to recommend optimal services and products that take into account the user's emotions.

[1642] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1643] Step 1:

[1644] A user opens a smartphone app and inputs the desired service or product category. The input is done through a user interface such as a text box. For example, the user inputs "home coffee maker."

[1645] Step 2:

[1646] The terminal sends the entered category information to the server. At this time, the information entered by the user, "home coffee maker," is sent as data.

[1647] Step 3:

[1648] Based on the category information received by the server, related product information is extracted from the database. Specifically, multiple product data (price, ratings, features, etc.) related to "home coffee makers" are retrieved from the PostgreSQL database.

[1649] Step 4:

[1650] The server compares the extracted product information using a rating algorithm, scoring the products based on multiple criteria such as price, rating, and features, generating a ranking. This ranking data is then input to the next processing step.

[1651] Step 5:

[1652] The device uses a built-in camera and microphone to collect the user's facial expressions and voice, and sends them to an emotion recognition engine (Google Cloud Vision API or IBM Watson Tone Analyzer). The emotion recognition engine uses this data to analyze the user's emotional state and output the results.

[1653] Step 6:

[1654] The server adjusts the ranking of recommended products based on the emotional state data received from the emotion recognition engine. For example, if the user is feeling stressed, the ranking will be reevaluated to prioritize products that are easy to operate, inexpensive, and have a high relaxation effect.

[1655] Step 7:

[1656] The server sends the final adjusted ranking data to the smartphone app, which outputs the optimal product list based on the adjusted ranking.

[1657] Step 8:

[1658] The device displays the received ranking data on the user interface. For example, a list of recommended "home coffee makers" is presented to the user. The user can instantly check the best products based on their emotions.

[1659] This series of processes makes it possible to recommend optimal services and products in real time, taking into account the user's emotions.

[1660] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1661] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1662] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1663] [Third embodiment]

[1664] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1665] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1666] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1667] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1668] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1669] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1670] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1671] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1672] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1673] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1674] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1675] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1676] MODE FOR CARRYING OUT THE INVENTION

[1677] Recommended features of the service

[1678] overview

[1679] In this invention, a system is constructed in which a user inputs the category of a desired service, and the server compares and evaluates similar services and presents recommended services.

[1680] Program processing

[1681] 1. The user's terminal displays an interface for inputting service category information.

[1682] 2. The user enters the category information of the desired service and submits it.

[1683] 3. The server receives the input category information and extracts related service information from the database based on that information.

[1684] 4. The server evaluates the extracted services based on price, features, user reviews, etc., and selects the most suitable service using a comparison algorithm.

[1685] 5. The server sends the selected recommended services to the user's device.

[1686] 6. The user's device will display the recommended services for the user to review.

[1687] Specific examples

[1688] For example, if a user requests a "video streaming service," the server extracts service information from Netflix, Hulu, Amazon Prime Video, etc., and compares them based on their prices, features, and user reviews. Using a comparison algorithm, the server selects Netflix as the optimal service and presents that information to the user.

[1689] Membership terms summary function

[1690] overview

[1691] To provide a system in which a server extracts important points of a membership agreement and presents them in a summary form so that a user can efficiently understand the membership agreement of a service.

[1692] Program processing

[1693] 1. The user's device displays an interface for obtaining the URL of the service's membership terms page.

[1694] 2. The user enters the URL of the membership terms page and submits it.

[1695] 3. The server retrieves the text data of the membership terms page based on the entered URL.

[1696] 4. The server analyzes the text data using a natural language processing engine and extracts important points.

[1697] 5. The server generates a summary of the extracted points and sends it to the user's device.

[1698] 6. The user's device displays a summary of the membership terms and conditions for the user to review.

[1699] Specific examples

[1700] For example, if a user is trying to sign up for a new video streaming service, they can submit the URL of the membership terms and conditions, and the server will extract important points such as "automatic renewal," "how to cancel," and "price changes" and provide a summary to the user.

[1701] Membership registration status and password management function

[1702] overview

[1703] The system aims to securely manage users' membership registration information and passwords and provide regular feedback.

[1704] Program processing

[1705] 1. The user's device displays a form for registering for the service.

[1706] 2. The user enters the required registration information (username, email address, password, etc.) and submits it.

[1707] 3. The server receives the entered information, encrypts it, and stores it in a database.

[1708] 4. The server periodically scans the database to check the status of registration information and passwords.

[1709] 5. The server sends the user a password change alert and a registration status list as needed.

[1710] 6. The user's device displays the feedback for the user to review.

[1711] Specific examples

[1712] For example, if a user registers for service A and then later registers for service B, the server will encrypt and store both registration information and passwords, and periodically send the user alerts about their registration status and password management.

[1713] Cancellation procedure support function

[1714] overview

[1715] To provide a system that simplifies the procedure for a user to cancel a service and prevents the user from missing the cancellation deadline.

[1716] Program processing

[1717] 1. The user's device displays an interface for selecting the service they wish to cancel.

[1718] 2. The user selects the service they wish to cancel and submits it.

[1719] 3. The server retrieves information about the cancellation procedure from the database.

[1720] 4. The server generates forms and instructions to simplify the cancellation process.

[1721] 5. The server automatically fills in the cancellation form and sends it to the user's device.

[1722] 6. The user's device will display an automatically filled-in cancellation form, making the cancellation process easy.

[1723] 7. The server checks the progress of the cancellation procedure and sends a completion notification to the user's device.

[1724] 8. The user's device will display the completion status of the cancellation procedure so that the user can check it.

[1725] Specific examples

[1726] For example, if a user wants to cancel a video streaming service, the server retrieves the necessary cancellation procedures from the database and automatically generates a form to provide to the user. The user can complete the cancellation procedure with just a few clicks, and a notification is sent before the cancellation deadline to prevent the user from forgetting to cancel.

[1727] As described above, the system of the present invention provides a wide range of functions to improve user convenience.

[1728] The processing flow will be explained below.

[1729] Recommended features of the service

[1730] overview

[1731] In this invention, a system is constructed in which a user inputs the category of a desired service, and the server compares and evaluates similar services and presents recommended services.

[1732] Program processing

[1733] Step 1:

[1734] The user's terminal displays a form interface to allow the user to input the service category information.

[1735] Step 2:

[1736] The user inputs the category information of the desired service and presses the send button.

[1737] Step 3:

[1738] The server analyzes the category information received from the user.

[1739] Step 4:

[1740] The server extracts the service information for the relevant category from the database.

[1741] Step 5:

[1742] The server rates the extracted services based on criteria such as price, features, and user reviews.

[1743] Step 6:

[1744] The server compares the services using a rating algorithm and generates a list of the best services.

[1745] Step 7:

[1746] The server transmits recommended service information to the user's terminal.

[1747] Step 8:

[1748] The user's device will display a list of recommended services for the user to review.

[1749] Membership terms summary function

[1750] overview

[1751] To provide a system in which a server extracts important points of a membership agreement and presents them in a summary form so that a user can efficiently understand the membership agreement of a service.

[1752] Program processing

[1753] Step 1:

[1754] The user's terminal displays an interface for entering the URL of the membership agreement.

[1755] Step 2:

[1756] The user enters the URL for the membership agreement and submits it.

[1757] Step 3:

[1758] The server retrieves the text data of the membership agreement page based on the entered URL.

[1759] Step 4:

[1760] The server analyzes the acquired text data using a natural language processing engine.

[1761] Step 5:

[1762] The server extracts important points from the text data.

[1763] Step 6:

[1764] The server generates a summary of the extracted points.

[1765] Step 7:

[1766] The server transmits the generated summary to the user's terminal.

[1767] Step 8:

[1768] The user's terminal displays the summarized membership terms and conditions for the user to review.

[1769] Membership registration status and password management function

[1770] overview

[1771] The system aims to securely manage users' membership registration information and passwords and provide regular feedback.

[1772] Program processing

[1773] Step 1:

[1774] The user's device displays a form for registering for the service.

[1775] Step 2:

[1776] The user enters the required registration information (user name, email address, password, etc.) and submits it.

[1777] Step 3:

[1778] The server receives the entered registration information, encrypts it, and stores it in a database.

[1779] Step 4:

[1780] The server periodically scans the database to check the status of registration information and passwords.

[1781] Step 5:

[1782] The server sends the user password change alerts and registration status lists as needed.

[1783] Step 6:

[1784] The user's terminal displays the feedback for the user to review.

[1785] Cancellation procedure support function

[1786] overview

[1787] To provide a system that simplifies the procedure for a user to cancel a service and prevents the user from missing the cancellation deadline.

[1788] Program processing

[1789] Step 1:

[1790] The user's terminal displays an interface for selecting the service the user wishes to cancel.

[1791] Step 2:

[1792] The user selects the service they wish to cancel and submits it.

[1793] Step 3:

[1794] The server retrieves information about the cancellation procedure for the relevant service from the database.

[1795] Step 4:

[1796] The server generates forms and instructions to simplify the cancellation process.

[1797] Step 5:

[1798] The server sends a cancellation form with auto-filled information to the user's device.

[1799] Step 6:

[1800] The user's device will display a simplified cancellation form, which the user will fill out and submit.

[1801] Step 7:

[1802] The server checks the progress of the cancellation procedure and sends a completion notice to the user's terminal.

[1803] Step 8:

[1804] The user's terminal displays the completion status of the cancellation procedure so that the user can check it.

[1805] Example 1

[1806] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1807] Today's service users must choose the most suitable service from a wide variety of options, but this selection process often requires time and effort. Understanding service membership terms and conditions can be difficult, putting users at risk of overlooking important information. Furthermore, managing registration information and canceling service subscriptions can be complicated, placing a burden on users. A system that can solve these problems and improve user convenience is needed.

[1808] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1809] In this invention, the server includes an input means for inputting a category of a service desired by a user, an extraction means for extracting similar service information from a database based on the category information input via the input means, a comparison means for evaluating the similar services extracted by the extraction means based on price, function, user reviews, etc., and selecting the most suitable service using a comparison algorithm, a presentation means for presenting recommended services based on the selection result by the comparison means, an acquisition means for acquiring a URL of the membership terms of the service designated by the user, a natural language processing means for extracting and analyzing text data from the URL acquired by the acquisition means, and a weighting factor analysis means for analyzing the weighting factor extracted by the natural language processing means. The system includes a presentation means for presenting a summary of key points to the user, an input means for inputting registration information to be input when the user registers for a new service, a storage means for encrypting and storing the registration information input by the input means, a check means for periodically checking the registration information stored in the storage means and providing feedback to the user, an input means for selecting a service the user wishes to cancel, an acquisition means for acquiring information on cancellation procedures for the service selected via the input means from a database, a generation means for generating a form and procedure for the cancellation procedure based on the information acquired by the acquisition means, and a presentation means for providing the user with the cancellation procedure information generated by the generation means. This enables the user to easily select the most suitable service, efficiently understand the service's membership terms and conditions, safely manage registration information, and quickly complete the cancellation procedure.

[1810] The "input means" is a means for providing an interface for the user to input desired information and categories.

[1811] The "extraction means" is a means for searching and acquiring related data from a database based on information input via the input means.

[1812] The "comparison means" is a means for comparing the data obtained by the extraction means based on multiple evaluation criteria such as price, functionality, and user reviews, and using an algorithm to select the optimal option.

[1813] The "presentation means" is a means for displaying the information and results obtained by the comparison means, analysis means, and generation means in an easy-to-understand manner for the user.

[1814] "Means of acquisition" refers to the means for acquiring the necessary information from a specified URL or data source.

[1815] "Natural language processing means" refers to means that uses natural language processing techniques to analyze acquired text data and extract important information.

[1816] "Storage means" refers to a means for securely encrypting and storing input information.

[1817] The "checking means" is a means for periodically checking the information stored by the storage means and providing necessary feedback to the user.

[1818] "Generation means" refers to a means for automatically generating forms and procedures based on acquired data and information.

[1819] MODE FOR CARRYING OUT THE INVENTION

[1820] Recommended features of the service

[1821] In this system, a user inputs category information of a desired service, and a process is executed to recommend the most suitable service.

[1822] Hardware and software configuration:

[1823] User devices: PCs, smartphones, tablets, etc. Using a web browser or dedicated application.

[1824] Server: A powerful server machine with web server software (Apache, Nginx, etc.) and database management system (MySQL, PostgreSQL, etc.).

[1825] Natural language processing engines: Scikit-learn, TensorFlow, NLTK, SpaCy, etc.

[1826] Interface: Web forms using HTML, CSS and JavaScript.

[1827] Examples:

[1828] For example, if a user wishes to search for a "video streaming service," the user enters category information and clicks the submit button. The user's device sends the information to the server, which extracts similar services from a database, evaluates them based on price, features, user reviews, etc., and uses a comparison algorithm to select the most suitable service. If Netflix is ​​recommended as a result of the selection, that information is displayed on the user's device. Example prompt: "Please recommend a video streaming service."

[1829] Membership terms summary function

[1830] This system provides a summary of the important points of the membership terms of the service specified by the user so that the user can efficiently understand the terms.

[1831] Hardware and software configuration:

[1832] User devices: PCs, smartphones, tablets, etc. Using a web browser or dedicated application.

[1833] Server: A high-performance server machine with web server software (Apache, Nginx, etc.).

[1834] Natural language processing engines: BeautifulSoup, Requests, NLTK, SpaCy, etc.

[1835] Examples:

[1836] For example, if a user is trying to sign up for a new video streaming service, they enter the URL of the membership terms and conditions page into the input form and click the submit button. The server retrieves the text data from the specified URL and analyzes it using a natural language processing engine. Important points such as "automatic renewal," "how to cancel," and "price changes" are extracted and presented to the user as a summary. An example of a prompt sentence: "Please tell me a summary of the membership terms and conditions for this video streaming service."

[1837] Membership registration status and password management function

[1838] This system has the function of safely managing users' membership registration information and passwords and providing feedback.

[1839] Hardware and software configuration:

[1840] User devices: PCs, smartphones, tablets, etc. Using a web browser or dedicated application.

[1841] Server: A high-performance server machine, including web server software (Apache, Nginx, etc.) and database management system (MongoDB, etc.).

[1842] Cryptography library: OpenSSL, bcrypt, etc.

[1843] Examples:

[1844] For example, if a user registers for service A and then later registers for service B, both registration information and passwords are encrypted and stored on the server. The database is periodically scanned to check the status of registration information and passwords, and an alert is sent to the user. An example prompt is: "Please check the services that manage my membership status and password."

[1845] Cancellation procedure support function

[1846] This system simplifies the process for users to cancel their service and helps them avoid missing the cancellation deadline.

[1847] Hardware and software configuration:

[1848] User devices: PCs, smartphones, tablets, etc. Using a web browser or dedicated application.

[1849] Server: A high-performance server machine, web server software (Apache, Nginx, etc.), and database management system.

[1850] RPA tools: UiPath, etc.

[1851] Examples:

[1852] For example, if a user wants to cancel a video streaming service, they select the service they wish to cancel and click the submit button. The server collects the information necessary for cancellation and generates a form and procedure for the cancellation procedure. The automatically filled-in cancellation form is displayed on the user's device, and after confirming it, the user can quickly complete the cancellation procedure. A notification is sent before the cancellation deadline to prevent users from forgetting to cancel. Example prompt: "Please help me with the procedure to cancel this video streaming service."

[1853] The above is a specific embodiment of the present invention. By using this system, users can efficiently use various services, avoid missing important information, safely manage data, and easily complete cancellation procedures.

[1854] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1855] Recommended features of the service

[1856] Processing Steps

[1857] Step 1:

[1858] The user's terminal displays a GUI (Graphical User Interface) for inputting service category information. Specifically, the HTML form has text boxes and drop-down menus, and the user inputs the desired service category.

[1859] Input: The user inputs the service category and clicks the submit button.

[1860] Output: The entered service category information is sent to the server.

[1861] Step 2:

[1862] The server analyzes the HTTP request received from the user's device and extracts the category information, which is included in the request.

[1863] Input: The server receives an HTTP request and parses the JSON data.

[1864] Output: Category information is extracted and used to perform database queries.

[1865] Step 3:

[1866] The server connects to a database (MySQL or PostgreSQL) based on the category information and executes a query to search for similar service information.

[1867] Input: Category information to use in database queries.

[1868] Output: Information about similar services (price, features, user reviews, etc.).

[1869] Step 4:

[1870] The server scores the extracted service information based on multiple evaluation criteria (price, features, user reviews, etc.), evaluates each service using machine learning libraries such as Scikit-learn and TensorFlow, and ranks them using a comparison algorithm.

[1871] Input: Extracted service information.

[1872] Output: Evaluation and scoring results.

[1873] Step 5:

[1874] The server converts the recommended service information selected by the comparison algorithm into JSON format and sends it to the user's device as an HTTP response.

[1875] Input: Evaluation and scoring results.

[1876] Output: Recommendation information in JSON format.

[1877] Step 6:

[1878] The user's device analyzes the HTTP response received from the server and displays recommended service information on the screen. The services are listed in order of ranking, and detailed information is also displayed.

[1879] Input: The HTTP response from the server.

[1880] Output: Recommended service information is displayed to the user.

[1881] Membership terms summary function

[1882] Processing Steps

[1883] Step 1:

[1884] The user's device displays an interface with an input field for obtaining the URL of the membership terms page and a "Submit" button.

[1885] Input: The user enters the URL of the membership agreement page and clicks the submit button.

[1886] Output: The entered URL information is sent to the server.

[1887] Step 2:

[1888] The server analyzes the HTTP request received from the user's terminal and extracts the URL.

[1889] Input: The server receives an HTTP request and parses the JSON data.

[1890] Output: The extracted URL.

[1891] Step 3:

[1892] The server accesses the specified URL and retrieves the HTML of the membership agreement page using a web scraping library such as BeautifulSoup or Requests.

[1893] Input: The HTTP request based on the extracted URL.

[1894] Output: The retrieved HTML data.

[1895] Step 4:

[1896] The server extracts text data from the HTML data and analyzes it using a natural language processing engine (NLTK or SpaCy).

[1897] Input: The retrieved HTML data.

[1898] Output: The extracted text data.

[1899] Step 5:

[1900] The server analyzes the text data and identifies important keywords and phrases using a natural language processing engine.

[1901] Input: Extracted text data.

[1902] Output: A list of key points.

[1903] Step 6:

[1904] The server summarizes the key points it has identified, presents them in an easy-to-understand format, and sends this to the user's device as a JSON response.

[1905] Input: A list of key points.

[1906] Output: Summary information in JSON format.

[1907] Step 7:

[1908] The user's device analyzes the summary information received from the server and displays it on the screen, with important points listed in bullet points.

[1909] Input: The HTTP response from the server.

[1910] Output: A summarized membership agreement is displayed to the user.

[1911] Membership registration status and password management function

[1912] Processing Steps

[1913] Step 1:

[1914] The user's device displays a form to sign up for a new service, which includes fields for entering a username, email address, and password.

[1915] Enter: The user enters the required registration information and clicks the submit button.

[1916] Output: The entered registration information is sent to the server.

[1917] Step 2:

[1918] The server analyzes the HTTP request received from the user's terminal and obtains the registration information.

[1919] Input: The server receives an HTTP request and parses the JSON data.

[1920] Output: The extracted registration information.

[1921] Step 3:

[1922] The server encrypts the registration information it receives using libraries such as OpenSSL and bcrypt.

[1923] Input: Extracted registration information.

[1924] Output: Encrypted registration information.

[1925] Step 4:

[1926] The server stores the encrypted registration information in a database (such as MongoDB).

[1927] Input: Encrypted registration information.

[1928] Output: Saved data.

[1929] Step 5:

[1930] The server periodically scans the database to check the validity of registration information and passwords, and can also use an external security API to check if passwords have been leaked.

[1931] Input: Database registration information and password.

[1932] Output: Check results and alert information.

[1933] Step 6:

[1934] The server will send the user a password change alert or a list of registration status via email or in-app notification as needed.

[1935] Input: Check results and alert information.

[1936] Output: Notification as feedback.

[1937] Step 7:

[1938] The user's device displays the notification and alert information received from the server, allowing the user to take the necessary action.

[1939] Input: Notifications and alerts from the server.

[1940] Output: Display of alerts and feedback information.

[1941] Cancellation procedure support function

[1942] Processing Steps

[1943] Step 1:

[1944] The user's device displays an interface for selecting the service they wish to cancel, including a list box and a search bar.

[1945] Input: The user selects the service they wish to cancel and clicks the submit button.

[1946] Output: The selected service information is sent to the server.

[1947] Step 2:

[1948] The server analyzes the HTTP request received from the user's terminal and obtains service information.

[1949] Input: The server receives an HTTP request and parses the JSON data.

[1950] Output: The extracted service information.

[1951] Step 3:

[1952] The server accesses the database and searches for and obtains the information necessary for the cancellation procedure (such as the URL for the procedure and the necessary forms).

[1953] Input: Service information.

[1954] Output: Cancellation procedure information (URL, form, etc.).

[1955] Step 4:

[1956] The server generates forms and instructions based on the acquired information to simplify the cancellation process, and uses RPA tools such as UiPath to automatically fill them in.

[1957] Input: Cancellation procedure information.

[1958] Output: The generated cancellation form.

[1959] Step 5:

[1960] The server sends the generated cancellation form to the user's terminal.

[1961] Input: Generated cancellation form.

[1962] Output: The URL of the cancellation form.

[1963] Step 6:

[1964] The user's terminal displays the cancellation form received from the server, allowing the user to confirm and submit the cancellation procedure.

[1965] Input: Cancellation form URL.

[1966] Output: The cancellation form displayed.

[1967] Step 7:

[1968] The server monitors the progress of the cancellation procedure and notifies the user's terminal of the information once the procedure is complete.

[1969] Input: Progress of cancellation procedure.

[1970] Output: Completion notification.

[1971] Step 8:

[1972] The user's terminal displays the confirmation of completion of the cancellation procedure received from the server so that the user can confirm it.

[1973] Input: Completion notification.

[1974] Output: Display of cancellation procedure completion information.

[1975] (Application example 1)

[1976] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1977] On conventional online shopping sites, when users select the product they want, it is difficult to find the best product from the wide range of information available, and in many cases, proper comparison and evaluation are not performed. It is also difficult to grasp a large amount of information at once, which makes selection laborious for users. Furthermore, there is a lack of an efficient way to grasp important information such as registration information and membership terms and conditions.

[1978] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1979] In this invention, the server

[1980] an input means for inputting a desired product category by the user;

[1981] extraction means for extracting related product information from a database based on the product category information input via the input means;

[1982] a comparison means for evaluating the products extracted by the extraction means using a comparison algorithm based on evaluation criteria such as price, function, and reviews;

[1983] a presentation means for presenting optimal products based on the evaluation results by the comparison means;

[1984] An acquisition means for acquiring text data of the membership terms and conditions of the product designated by the user;

[1985] natural language processing means for analyzing the text data acquired by the acquisition means and extracting important points;

[1986] a presentation means for presenting the important points extracted by the natural language processing means to a user as a summary;

[1987] an input means for inputting registration information to be input when a user registers for a new service;

[1988] a storage means for encrypting and storing the registration information input by the input means;

[1989] a check means for periodically checking the registration information stored in the storage means and providing feedback to the user;

[1990] Includes.

[1991] This not only allows users to easily compare and evaluate the products they want and select the most suitable product, but also allows them to efficiently understand important information such as membership terms and conditions, and allows them to safely and conveniently manage their registration information.

[1992] The "input means" is a means for the user to input desired product category information.

[1993] The "extraction means" is a means for extracting related product information from the database based on the product category information input via the input means.

[1994] The "comparison means" is a means for evaluating the products extracted by the extraction means using a comparison algorithm based on evaluation criteria such as price, function, and reviews.

[1995] The "presentation means" is a means for presenting the most suitable product to the user based on the evaluation results by the comparison means.

[1996] The "acquisition means" is a means for acquiring text data of the membership terms and conditions of the product designated by the user.

[1997] The "natural language processing means" is a means for analyzing the text data acquired by the acquisition means and extracting important points.

[1998] The "storage means" is a means for encrypting and storing the registration information input by the input means.

[1999] The "checking means" is a means for periodically checking the registration information stored in the storage means and providing feedback to the user.

[2000] The present invention provides a system that inputs desired product category information from a user and presents optimal products based on that information. This system is made up of the following main components:

[2001] First, a user inputs a product category using a smartphone or other mobile device. A mobile application is used as the input means, and an interface built using a front-end library such as React Native is provided. When category information is input through the user interface in this application, the information is sent to the server.

[2002] The server extracts related product information from a database based on the input information. Databases such as SQLite and MongoDB are often used. The extraction method is implemented using a Python backend that uses the Flask framework. This backend retrieves product data from the database that corresponds to the product category information entered by the user.

[2003] Next, the extracted product information is compared based on evaluation criteria such as price, features, and reviews. An evaluation algorithm is used as the comparison method, using libraries such as Python's scikit-learn or TensorFlow. The evaluation algorithm compares the characteristic values ​​of each product and selects the most suitable product.

[2004] The information about the selected products is presented to the user by a presentation means, again using a mobile application, and the selection results are displayed on a user interface, allowing the user to easily check the optimal products that have been selected.

[2005] It also has a means to retrieve and analyze the text data of the membership terms and conditions for the product specified by the user. The retrieval method is a backend using Flask that sends a request to the URL to retrieve the text data. For natural language processing, it uses Python natural language processing libraries NLTK and SpaCy to analyze and extract important points from the text and present them to the user as a summary.

[2006] In addition, there is also a means for users to input registration information when registering for a new service, and for this information to be encrypted and stored. The aforementioned mobile application is used as the input means. The input registration information is securely stored in encrypted form in the storage means. For example, an encryption algorithm such as AES (Advanced Encryption Standard) is used. The registration information stored in the storage means is checked periodically, and feedback is provided to the user regarding password changes and registration status. A Flask-based backend manages this periodic job.

[2007] Here's a specific example: When a user accesses a smartphone application and types in "smartphone," the server selects the product with the highest review rating from candidates such as "iPhone 14" and "latest smartphone models" and displays it to the user.

[2008] Examples of prompts using generative AI models include:

[2009] "Please select a service category: [Smartphones, Home Appliances, Clothing, ...]"

[2010] -> Smartphone

[2011] Looking for smartphone recommendations based on price, features, and user reviews?

[2012] -> Recommended Smartphone: Latest Smartphone Model (Price: $899, Review: 4.7)

[2013] As described above, the present invention provides a system that allows users to easily compare and evaluate desired products and select the most suitable product. In addition, it also allows users to efficiently understand important information such as membership terms and conditions, and allows for safe and convenient management of registration information.

[2014] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2015] Step 1:

[2016] The user starts the smartphone application and inputs the desired product category. This input is done through the user interface. The input data is formatted in JSON format or similar and sent to the server.

[2017] Input: Product category entered through a smartphone application (e.g., "smartphone").

[2018] Output: Product category information sent to the server.

[2019] Specific behavior:

[2020] Enter the category in the input field on the smartphone's user interface and press the "Send" button to send the data to the server.

[2021] Step 2:

[2022] The server extracts related product information from the database based on the received product category information, and executes a database query to obtain the corresponding product data.

[2023] Input: Product category information (e.g., "Smartphone").

[2024] Output: A list of relevant product data (e.g., information on multiple smartphone models).

[2025] Specific behavior:

[2026] The server executes SQL queries based on the product category information and extracts relevant product data from the database.

[2027] Step 3:

[2028] The server compares the extracted product data using a rating algorithm that calculates a rating score for the product based on criteria such as price, features, and review ratings.

[2029] Input: Extracted product data.

[2030] Output: Rating score for each product.

[2031] Specific behavior:

[2032] The server calculates the characteristics of each extracted product (price, features, review rating, etc.) and calculates a score for each product using a rating algorithm.

[2033] Step 4:

[2034] The server selects the best product based on the rating score, with the product with the highest score being chosen as the best product.

[2035] Input: Rating score for each product.

[2036] Output: The best products (e.g., smartphone models with the highest reviews).

[2037] Specific behavior:

[2038] The server compares the evaluation scores and selects the product with the highest score.

[2039] Step 5:

[2040] The server transmits the selected optimal product to the user's terminal, including detailed information about the selected product.

[2041] Input: Optimal product information.

[2042] Output: Product details sent to the user's device.

[2043] Specific behavior:

[2044] The server formats detailed information about the best products and sends it to the user's device in JSON format or similar.

[2045] Step 6:

[2046] The user's device displays the received product information, and the user can check the selected optimal product through the application interface.

[2047] Input: Product details sent from the server.

[2048] Output: Product information displayed on the user interface.

[2049] Specific behavior:

[2050] The smartphone application reflects the received data on the user interface and displays it to the user.

[2051] The above processing steps realize a system that allows a user to simply input a desired product category and select the most suitable product.

[2052] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2053] MODE FOR CARRYING OUT THE INVENTION

[2054] Recommended features of the service

[2055] overview

[2056] In this invention, we build a system in which a user inputs the category of service they want, and the server compares and evaluates similar services and presents recommended services. Furthermore, we combine it with an emotion engine that recognizes the user's emotions to improve the user experience.

[2057] Program processing

[2058] 1. The user's terminal displays an interface for inputting service category information.

[2059] 2. The user enters the category information of the desired service and submits it.

[2060] 3. The server receives the input category information and extracts related service information from the database based on that information.

[2061] 4. The server evaluates the extracted services based on price, features, user reviews, etc., and selects the most suitable service using a comparison algorithm.

[2062] 5. The emotion engine recognizes the user's emotions using data collected from the user's device.

[2063] 6. The server adjusts the list of recommended services based on the user's emotions recognized by the emotion engine.

[2064] 7. The server sends the optimal recommended service to the user's device.

[2065] 8. The user's device will display recommended services for the user to review.

[2066] Specific examples

[2067] For example, if a user desires a "video streaming service" and is feeling stressed, the server will extract service information from Netflix, Hulu, Amazon Prime Video, etc., and compare them based on their prices, features, and user reviews. If the emotion engine recognizes that the user is feeling stressed, the server will prioritize recommending services with an abundance of content that has a relaxing effect to reduce stress.

[2068] Membership terms summary function

[2069] overview

[2070] To help users understand the membership terms of a service efficiently, we provide a system in which the server extracts and summarizes the important points of the membership terms. Furthermore, by combining it with an emotion engine, we provide explanations that correspond to the user's emotions.

[2071] Program processing

[2072] 1. The user's device displays an interface for obtaining the URL of the membership terms page.

[2073] 2. The user enters the URL of the membership terms page and submits it.

[2074] 3. The server retrieves the text data of the membership terms page based on the entered URL.

[2075] 4. The server analyzes the text data using a natural language processing engine and extracts important points.

[2076] 5. The emotion engine recognizes the user's emotions using data collected from the user's device.

[2077] 6. The server adjusts the summarized content of the terms and conditions based on the user's emotions recognized by the emotion engine and provides it in a form appropriate for the user.

[2078] 7. The server sends the summary results to the user's terminal.

[2079] 8. The user's device will display a summary of the membership terms and conditions for the user to review.

[2080] Specific examples

[2081] For example, if a user is feeling anxious about signing up for a new video streaming service, the server can analyze the URL of the membership terms and conditions, extract important points such as "automatic renewal," "how to cancel," and "price changes," and provide a summary highlighting particularly reassuring information to alleviate the anxiety recognized by the emotion engine.

[2082] Membership registration status and password management function

[2083] overview

[2084] The system aims to securely manage users' membership registration information and passwords, and provide regular feedback. Furthermore, by combining it with an emotion engine, it provides feedback according to the user's emotions.

[2085] Program processing

[2086] 1. The user's device displays a form for registering for the service.

[2087] 2. The user enters the required registration information (username, email address, password, etc.) and submits it.

[2088] 3. The server receives the entered information, encrypts it, and stores it in a database.

[2089] 4. The server periodically scans the database to check the status of registration information and passwords.

[2090] 5. The emotion engine recognizes the user's emotions using data collected from the user's device.

[2091] 6. The server adjusts feedback regarding password and registration information management based on the user's emotions recognized by the emotion engine.

[2092] 7. The server sends the adjusted feedback to the user's device.

[2093] 8. The user's device displays the feedback for the user to review.

[2094] Specific examples

[2095] For example, if a user feels confused or hesitant when signing up for a new service, the server can encrypt and store the registration information and password, and provide clear and reassuring feedback based on the user's emotions as recognized by the emotion engine.

[2096] Cancellation procedure support function

[2097] overview

[2098] We provide a system that simplifies the process for users to cancel their service and prevents them from missing the cancellation deadline. Furthermore, by combining it with an emotion engine, we provide support that responds to the user's emotions.

[2099] Program processing

[2100] 1. The user's device displays an interface for selecting the service they wish to cancel.

[2101] 2. The user selects the service they wish to cancel and submits it.

[2102] 3. The server retrieves information regarding the cancellation procedure for the relevant service from the database.

[2103] 4. The server generates forms and instructions to simplify the cancellation process.

[2104] 5. The emotion engine recognizes the user's emotions using data collected from the user's device.

[2105] 6. The server provides appropriate support for the cancellation procedure based on the user's emotions recognized by the emotion engine.

[2106] 7. The server automatically fills in the cancellation form and sends it to the user's device.

[2107] 8. The user's device will display an automatically filled-in cancellation form to facilitate the cancellation process.

[2108] 9. The server checks the progress of the cancellation procedure and sends a completion notification to the user's device.

[2109] 10. The user's device will display the completion status of the cancellation procedure so that the user can check it.

[2110] Specific examples

[2111] For example, if a user is trying to cancel a video streaming service but is finding it troublesome, the server obtains information about the cancellation procedure, and in order to reduce the hassle recognized by the emotion engine, simplifies the steps of the cancellation procedure and provides support that allows the user to cancel with peace of mind.

[2112] As described above, the system of the present invention provides a wide range of functions to improve user convenience, and by combining it with an emotion engine, it significantly improves the user experience.

[2113] The processing flow will be explained below.

[2114] Recommended features of the service

[2115] Program processing

[2116] Step 1:

[2117] The user's terminal displays an interface for inputting service category information, allowing the user to input the information.

[2118] Step 2:

[2119] The user inputs the category information of the desired service and presses the send button.

[2120] Step 3:

[2121] The server receives the category information sent by the user.

[2122] Step 4:

[2123] The server extracts the corresponding service information from the database based on the received category information.

[2124] Step 5:

[2125] The server evaluates the extracted service information based on price, features, user reviews, etc.

[2126] Step 6:

[2127] The emotion engine analyzes the user's emotions based on data collected from the user's device.

[2128] Step 7:

[2129] The server receives the analyzed emotion data and reflects it in the evaluation algorithm to compare services.

[2130] Step 8:

[2131] The server generates a list of optimal recommended services and sends it to the user's terminal.

[2132] Step 9:

[2133] The user's device displays a list of recommended services and asks the user to confirm them.

[2134] Membership terms summary function

[2135] Program processing

[2136] Step 1:

[2137] The user's device displays an interface for entering the URL of the membership agreement page.

[2138] Step 2:

[2139] The user enters the URL for the membership agreement and submits it.

[2140] Step 3:

[2141] The server retrieves the text data of the membership terms page based on the sent URL.

[2142] Step 4:

[2143] The server analyzes the acquired text data using a natural language processing engine.

[2144] Step 5:

[2145] The server extracts important points from the text data.

[2146] Step 6:

[2147] The emotion engine analyzes the user's emotions based on data collected from the user's device.

[2148] Step 7:

[2149] The server adjusts the summarized membership agreement based on the analyzed emotion data.

[2150] Step 8:

[2151] The server transmits the adjusted summary result to the user's terminal.

[2152] Step 9:

[2153] The user's terminal displays the summarized membership terms and conditions and asks the user to confirm them.

[2154] Membership registration status and password management function

[2155] Program processing

[2156] Step 1:

[2157] The user's device displays a form for registering for the service.

[2158] Step 2:

[2159] The user enters the required registration information (user name, email address, password, etc.) and submits it.

[2160] Step 3:

[2161] The server receives the entered information, encrypts it, and stores it in a database.

[2162] Step 4:

[2163] The server periodically scans the database to check the status of registration information and passwords.

[2164] Step 5:

[2165] The emotion engine analyzes the user's emotions based on data collected from the user's device.

[2166] Step 6:

[2167] The server adjusts feedback regarding password and registration information management based on the analyzed emotional data.

[2168] Step 7:

[2169] The server transmits the adjusted feedback to the user's terminal.

[2170] Step 8:

[2171] The user's terminal displays the feedback for the user to confirm.

[2172] Cancellation procedure support function

[2173] Program processing

[2174] Step 1:

[2175] The user's terminal displays an interface for selecting the service the user wishes to cancel.

[2176] Step 2:

[2177] The user selects the service they wish to cancel and submits it.

[2178] Step 3:

[2179] The server retrieves information about the cancellation procedure for the relevant service from the database.

[2180] Step 4:

[2181] The server generates forms and instructions to simplify the cancellation process.

[2182] Step 5:

[2183] The emotion engine analyzes the user's emotions based on data collected from the user's device.

[2184] Step 6:

[2185] The server provides optimal support for cancellation procedures based on the analyzed emotion data.

[2186] Step 7:

[2187] The server sends the automatically filled-out cancellation form to the user's terminal.

[2188] Step 8:

[2189] The user's device will display a cancellation form that the user can easily fill out and submit.

[2190] Step 9:

[2191] The server checks the progress of the cancellation procedure and sends a completion notice to the user's terminal.

[2192] Step 10:

[2193] The user's terminal displays the completion status of the cancellation procedure and asks the user to confirm it.

[2194] Example 2

[2195] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2196] Previous service proposal systems and membership agreement summary systems failed to adequately address user needs and emotions, making it difficult to improve the user experience. Furthermore, when registering for a new service, there were insufficient measures to alleviate user anxiety and confusion regarding the management of registration information and feedback, resulting in a poor user experience. The service cancellation process was also complicated, and there was a risk of missing deadlines.

[2197] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2198] In this invention, the server includes: input means for inputting a category of service desired by the user; extraction means for extracting similar service information from a database based on category information input via the input means; comparison means for evaluating and comparing the similar services extracted by the extraction means using a plurality of indicators such as price, functionality, and user reviews; presentation means for presenting recommended services based on the comparison results by the comparison means; emotion recognition means for recognizing a user's emotion; adjustment means for adjusting a list of recommended services based on the user's emotion recognized by the emotion recognition means; means for presenting to the user the optimal recommended service adjusted by the adjustment means; acquisition means for acquiring text data of membership terms and conditions specified by the user; analysis means for analyzing the text data acquired by the acquisition means using a natural language processing engine and extracting important points; presentation means for presenting to the user the important points extracted by the analysis means as a summary; input means for inputting registration information entered by the user when registering for a new service; storage means for encrypting and storing the registration information input by the input means; and check means for periodically checking the registration information stored in the storage means and providing feedback to the user. This enables the recommendation of optimal services based on the user's needs and emotions, easy-to-understand summaries of membership terms and conditions, secure management of registration information, and prompt feedback.

[2199] The "input means" is a device or function that provides an interface for the user to input the category of service desired and registration information.

[2200] The "extraction means" is a device or function that extracts related service information from the database based on the input category information.

[2201] A "comparison means" is a device or function that evaluates and compares extracted services based on multiple indicators such as price, functionality, and user reviews.

[2202] The "presentation means" is a device or function that presents the user with recommended content or summary information based on the results of the comparison means and analysis means.

[2203] The "emotion recognition means" is a device or function that analyzes the user's input speed, keystroke patterns, facial recognition data, etc., and recognizes the user's emotions.

[2204] The "adjustment means" is a device or function that adjusts the recommendation content and summary information based on the user's emotion recognized by the emotion recognition means.

[2205] The "acquisition means" is a device or function for acquiring the text data of the membership terms and conditions specified by the user from the Internet.

[2206] The "analysis means" is a device or function that analyzes the text data acquired by the acquisition means using a natural language processing engine and extracts important points.

[2207] The "storage means" is a device or function that encrypts the registration information entered by the input means and stores it in a database.

[2208] The "checking means" is a device or function that periodically scans the registration information stored in the storage means and provides feedback to the user.

[2209] This invention provides a system that allows users to input the category of services they desire, a system that recommends them, a system that summarizes the membership terms of the services specified by the user, and a system that manages users' registration information and passwords. Furthermore, it combines this with a system that supports cancellation procedures and utilizes an emotion recognition engine to improve the user experience.

[2210] Recommended features of the service

[2211] The user's device displays an interface for entering service category information. When the user enters and submits the category information for the service they desire, the server receives that information and uses an SQL query to extract related service information from a database. The extracted services are then evaluated and compared using multiple indicators, such as price, features, and user reviews, using a Python or Java program. TensorFlow is also used as an emotion engine to analyze data collected from the user's device (such as input speed, keystroke patterns, and facial recognition data) to recognize the user's emotions. The server adjusts the list of recommended services based on the emotion recognition results and sends the optimal service recommendation information in JSON format to the user's device. The device then parses the received data and displays it in a visually easy-to-understand format.

[2212] As a specific example, if a user requests a "video streaming service" and is feeling stressed, the server will evaluate services such as Netflix, Hulu, and Amazon Prime Video and prioritize recommending content that has a high relaxing effect.

[2213] Example prompt sentence:

[2214] "Can you recommend a video streaming service? I've been feeling stressed at work lately, so I'm looking for content that helps me relax."

[2215] Membership terms summary function

[2216] The user's device displays an interface for entering the URL of the membership terms page. When the user enters the URL and submits it, the server retrieves the text data of the membership terms from that URL. The server analyzes the retrieved text data using SpaCy and NLTK to extract important points such as "automatic renewal," "cancellation method," and "price changes." The IBM Watson Tone Analyzer is used as an emotion engine to recognize emotions from the user's input and operation patterns, and adjusts the summary by adding information that alleviates anxiety and confusion. The adjusted summary is sent to the user's device in JSON format and displayed in an easy-to-understand manner.

[2217] As a concrete example, if a user is feeling anxious about signing up for a new video streaming service, a summary highlighting the key points that will reassure them is provided.

[2218] Example prompt sentence:

[2219] "I would like to check the membership terms of a new video streaming service, so I am entering its URL. I am feeling uneasy, so please summarize the important points in an easy-to-understand way."

[2220] Membership registration status and password management function

[2221] The user's device displays a form for registering for the service. When the user enters and submits the required registration information (username, email address, password, etc.), the server encrypts the information using encryption technology such as AES and stores it in a database. The server periodically scans the database to check the expiration date of the registration information and the strength of the password. As an emotion engine, it recognizes emotions from biometric data, input speed, and operation patterns, and sends easy-to-understand feedback in JSON format to the user's device, which displays it on the screen.

[2222] For example, if a user is feeling confused or overwhelmed when signing up for a new service, providing feedback that is particularly reassuring.

[2223] Example prompt sentence:

[2224] "I signed up for a new service, but I'm worried about managing my registration information and password. I'd appreciate some clear feedback."

[2225] Cancellation procedure support function

[2226] The user's device displays an interface for selecting the service they wish to cancel. When the user selects and submits the service they wish to cancel, the server retrieves information about the cancellation procedure for that service from a database and generates a form and instructions for a simplified cancellation process. The emotion engine performs emotion recognition, simplifies the steps in the cancellation process, and provides information that gives a sense of security. The server automatically fills in the cancellation form and sends it in JSON format to the user's device. The device parses the received data to make it easy to complete the cancellation process. The progress of the cancellation process is checked, and a completion notification is sent to the user's device and displayed on the screen.

[2227] As a specific example, if a user is having trouble canceling a video streaming service, we will simplify the steps in the cancellation process and help them cancel easily.

[2228] Example prompt sentence:

[2229] "I want to cancel my video streaming service, but the process is complicated. Please provide a simplified method."

[2230] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2231] Recommended features of the service

[2232] Processing Steps

[2233] Step 1:

[2234] The user's terminal displays an interface for inputting service category information.

[2235] Input: Category selection screen for the user

[2236] Output: User category selection and input

[2237] Specific behavior: A user interface built with HTML / CSS is launched, displaying input fields where the user can enter information and a submit button.

[2238] Step 2:

[2239] The user inputs and submits the category information of the desired service.

[2240] Input: Service category information (e.g. video streaming service)

[2241] Output: Sent to the server as an HTTP request

[2242] Specific behavior: When a user enters category information into the text field and clicks the submit button, the input data is sent to the server as an HTTP POST request.

[2243] Step 3:

[2244] The server receives the input category information and extracts related service information from the database based on that information.

[2245] Input: Category information

[2246] Output: Extracted service information

[2247] Specific operation: The server executes an SQL query to extract the corresponding service information from a database (e.g. MySQL).

[2248] Step 4:

[2249] The server evaluates the extracted services based on price, features, user reviews, etc., and uses a comparison algorithm to select the most suitable service.

[2250] Input: Extracted service information

[2251] Output: The result of the comparison algorithm that was performed.

[2252] How it works: The server uses Python or Java programs to score each service's metrics (price, features, reviews) and run comparison algorithms such as weighted averages.

[2253] Step 5:

[2254] The emotion engine recognizes the user's emotions using data collected from the user's device.

[2255] Input: User operation data (typing speed, keystroke patterns, facial recognition data, etc.)

[2256] Output: Recognized emotion data

[2257] Specific operation: The emotion engine uses a machine learning model (e.g., TensorFlow) to analyze user operation data and recognize emotions (stress, relaxation, etc.).

[2258] Step 6:

[2259] The server adjusts the list of recommended services based on the user's emotions recognized by the emotion engine.

[2260] Input: Comparison results and emotion data

[2261] Output: A tailored list of recommended services

[2262] How it works: The server reevaluates the results of the comparison algorithm and optimizes the service list based on the emotional data, for example prioritizing services with a relaxing effect for a user who is feeling stressed.

[2263] Step 7:

[2264] The server sends the optimal recommended service to the user's terminal.

[2265] Input: Adjusted service list

[2266] Output: Recommendation service data sent to the user's device

[2267] Specific operation: The server generates a list of recommended services in JSON format and sends it to the user's device as an HTTP response.

[2268] Step 8:

[2269] The user's device displays the recommended services so that the user can check them.

[2270] Input: Submitted recommendation service data

[2271] Output: Displayed list of recommended services

[2272] What it does: The device parses the data it receives and displays it to the user in a visually understandable format, such as a card displaying the name, price, key features, and reviews of each service.

[2273] Membership terms summary function

[2274] Processing Steps

[2275] Step 1:

[2276] The user's terminal displays an interface for obtaining the URL of the membership terms page.

[2277] Input: Membership Terms URL input screen

[2278] Output: User input URL and submit

[2279] Specific behavior: The user interface will launch and display a text field for entering the URL of the membership agreement and a submit button.

[2280] Step 2:

[2281] The user enters the URL of the membership agreement page and submits it.

[2282] Input: Membership Terms and Conditions page URL

[2283] Output: Sent to the server as an HTTP request

[2284] Specific behavior: When a user enters a URL and clicks the submit button, the input data is sent to the server as an HTTP POST request.

[2285] Step 3:

[2286] The server retrieves the text data of the membership agreement page based on the entered URL.

[2287] Input: Membership Terms URL

[2288] Output: The retrieved text data

[2289] Specific operation: The server uses an HTTP GET request to download the HTML content of the membership agreement from the specified URL and converts it into data for text analysis.

[2290] Step 4:

[2291] The server analyzes the text data using a natural language processing engine and extracts important points.

[2292] Input: Obtained text data

[2293] Output: Extracted key points

[2294] What it does: The server uses a natural language processing engine (e.g., SpaCy, NLTK) to parse the text of the membership agreement and extract key phrases and sentences such as "auto-renewal," "how to cancel," and "price change."

[2295] Step 5:

[2296] The emotion engine recognizes the user's emotions using data collected from the user's device.

[2297] Input: User operation data (typing speed, keystroke patterns, etc.)

[2298] Output: Recognized emotion data

[2299] Specific operation: The emotion engine uses a machine learning model (e.g., IBM Watson Tone Analyzer) to analyze the user's operation data and recognize emotions (anxiety, relief, etc.).

[2300] Step 6:

[2301] The server adjusts the summarized content of the terms and conditions based on the user's emotions recognized by the emotion engine and provides it in a form suitable for the user.

[2302] Input: Extracted key points and sentiment data

[2303] Output: Adjusted summary content

[2304] What it does: The server adjusts the summary based on the emotion data, optimizing the summary by adding reassuring information especially for anxious users.

[2305] Step 7:

[2306] The server transmits the summary result to the user's terminal.

[2307] Input: Adjusted summary content

[2308] Output: Summary data sent to the user's terminal

[2309] Specific operation: The server packages the generated summary content in JSON format and sends it to the user's device as an HTTP response.

[2310] Step 8:

[2311] The user's terminal displays the summarized membership terms and conditions for the user to review.

[2312] Input: Summary data sent

[2313] Output: The displayed summary

[2314] Specific operation: The device parses the data it receives, highlights important points with colors and markers, and displays them to the user in a visually easy-to-understand format.

[2315] Membership registration status and password management function

[2316] Processing Steps

[2317] Step 1:

[2318] The user's terminal displays a form for registering for the service.

[2319] Input: Registration form screen

[2320] Output: User input and transmission

[2321] What happens: The user interface launches and displays a form for entering username, email address, password, etc.

[2322] Step 2:

[2323] The user enters the required registration information (user name, email address, password, etc.) and submits it.

[2324] Input: Registration information (username, email address, password, etc.)

[2325] Output: Sent to the server as an HTTP request

[2326] Specific behavior: When a user enters the required information into the form fields and clicks the submit button, the input data is sent to the server as an HTTP POST request.

[2327] Step 3:

[2328] The server receives the entered information, encrypts it, and stores it in a database.

[2329] Input: Registration information

[2330] Output: Encrypted registration information stored in a database

[2331] Specific operation: The server encrypts the data it receives using encryption technology such as AES and stores it in a database (e.g., MySQL).

[2332] Step 4:

[2333] The server periodically scans the database to check the status of registration information and passwords.

[2334] Input: Registration information in the database

[2335] Output: Password and registration information validity check results

[2336] What it does: The server sets up a scheduled job to periodically scan the database for password expiration and strength.

[2337] Step 5:

[2338] The emotion engine recognizes the user's emotions using data collected from the user's device.

[2339] Input: User operation data (typing speed, keystroke patterns, etc.)

[2340] Output: Recognized emotion data

[2341] Specific operation: The emotion engine analyzes biometric data and operation patterns to recognize the user's emotions (e.g., relief, anxiety).

[2342] Step 6:

[2343] The server adjusts feedback regarding password and registration information management based on the user's emotions recognized by the emotion engine.

[2344] Input: Password and registration information check results and emotional data

[2345] Output: Adjusted feedback content

[2346] What it does: The server uses the recognized emotion data to tailor the feedback and add clear explanations and hints to reduce the user's anxiety and confusion.

[2347] Step 7:

[2348] The server transmits the adjusted feedback to the user's terminal.

[2349] Input: Adjusted feedback

[2350] Output: Feedback data sent to the user's device

[2351] Specific operation: The server packages the generated feedback content in JSON format and sends it to the user's device as an HTTP response.

[2352] Step 8:

[2353] The user's terminal displays the feedback for the user to review.

[2354] Input: Submitted feedback data

[2355] Output: The displayed feedback

[2356] What it does: Parses the data the device receives and displays it visually as alerts and tips.

[2357] Cancellation procedure support function

[2358] Processing Steps

[2359] Step 1:

[2360] The user's terminal displays an interface for selecting the service that the user wishes to cancel.

[2361] Input: Cancellation service selection screen

[2362] Output: User service selection and transmission

[2363] Specific behavior: A user interface will launch, displaying a list and checkboxes for selecting the services you wish to cancel.

[2364] Step 2:

[2365] The user selects the service for which they wish to cancel and submits the selection.

[2366] Input: Service information you wish to cancel

[2367] Output: Sent to the server as an HTTP request

[2368] Specific operation: When the user selects a service and clicks the submit button, the selected data is sent to the server as an HTTP POST request.

[2369] Step 3:

[2370] The server retrieves information regarding the cancellation procedure for the relevant service from the database.

[2371] Input: Service information you wish to cancel

[2372] Output: Cancellation procedure information

[2373] Specific operation: The server retrieves information about the cancellation procedure for the relevant service from the database and extracts the necessary procedure information.

[2374] Step 4:

[2375] The server generates forms and procedures that simplify the cancellation process.

[2376] Input: Cancellation procedure information

[2377] Output: Simplified cancellation form and instructions

[2378] Specific operation: Using the cancellation procedure information obtained by the server, generate a form and instructions that allow the user to easily cancel.

[2379] Step 5:

[2380] The emotion engine recognizes the user's emotions using data collected from the user's device.

[2381] Input: User operation data (typing speed, keystroke patterns, etc.)

[2382] Output: Recognized emotion data

[2383] Specific operation: The emotion engine analyzes the user's operation data and recognizes the user's emotions (annoyance, relief, etc.).

[2384] Step 6:

[2385] The server provides support appropriate for the cancellation procedure based on the user's emotions recognized by the emotion engine.

[2386] Input: Tailored cancellation form and sentiment data

[2387] Output: Adjusted cancellation support details

[2388] Specific operation: The server adjusts the procedures and explanations based on the emotion data to make the cancellation process easy and safe.

[2389] Step 7:

[2390] The server automatically fills in the cancellation form and sends it to the user's terminal.

[2391] Input: Adjusted cancellation support details

[2392] Output: Cancellation form data sent to the user's device

[2393] Specific operation: The cancellation form generated by the server is automatically filled in, packaged in JSON format, and sent to the user's device as an HTTP response.

[2394] Step 8:

[2395] The user's device will display an automatically filled-in cancellation form, making it easy to complete the cancellation procedure.

[2396] Input: Submitted cancellation form data

[2397] Output: Cancellation form displayed

[2398] What happens: The device parses the data it receives and displays a pre-filled cancellation form to the user.

[2399] Step 9:

[2400] The server checks the progress of the cancellation procedure and sends a completion notice to the user's terminal.

[2401] Input: Cancellation procedure progress

[2402] Output: A completion notification sent to the user's device

[2403] Specific operation: The server monitors the progress of the cancellation procedure, generates a notification when the procedure is complete, and sends it to the user's device as an HTTP response.

[2404] Step 10:

[2405] The user's terminal displays the completion status of the cancellation procedure so that the user can check it.

[2406] Input: Completion notification sent

[2407] Output: Displayed completion notification

[2408] Specific operation: The device parses the received data and displays the completion status of the cancellation procedure to the user.

[2409] (Application example 2)

[2410] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2411] Conventional service recommendation systems only provide similar service information based on the category of service desired by the user, but they are unable to take the user's emotional state into account when making recommendations, making it difficult to provide an optimal user experience. It is also difficult for users to understand the membership terms and conditions and information provided related to the service they desire, which increases user stress. Furthermore, there are insufficient measures to alleviate confusion and bewilderment when users sign up for a new service.

[2412] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes an input means for inputting a category of a service desired by the user, an extraction means for extracting similar service information from a database based on the category information input via the input means, a comparison means for comparing the similar services extracted by the extraction means using an evaluation algorithm, a presentation means for presenting recommended services based on the comparison results by the comparison means, an emotion recognition means for recognizing the user's emotion, and an adjustment means for adjusting the presentation results of recommended services based on the user's emotion recognized by the emotion recognition means. This enables optimal service recommendation taking the user's emotion into consideration.

[2413] The server also includes an acquisition means for acquiring text data of the membership terms of the service designated by the user, a natural language processing means for analyzing the text data acquired by the acquisition means and extracting important points, a presentation means for presenting the important points extracted by the natural language processing means as a summary to the user, an emotion recognition means for recognizing the user's emotion, and an adjustment means for adjusting the summary content based on the user's emotion recognized by the emotion recognition means, thereby making it possible to provide a summary of the membership terms and conditions taking the user's emotion into consideration and promote understanding.

[2414] The server further includes an input means for inputting registration information entered by the user when registering for a new service, a storage means for encrypting and storing the registration information input by the input means, a check means for periodically checking the registration information stored in the storage means and providing feedback to the user, an emotion recognition means for recognizing the user's emotion, and an adjustment means for adjusting the feedback content based on the user's emotion recognized by the emotion recognition means. This makes it possible to manage the registration information and provide feedback taking the user's emotion into consideration, thereby reducing user confusion and bewilderment.

[2415] The "input means" is a device or interface for a user to input service category information and registration information.

[2416] The "extraction means" is a device or algorithm that extracts relevant information from the database based on information input through the input means.

[2417] The "comparison means" is a device or algorithm that uses an evaluation algorithm to perform a comparative analysis using the information extracted by the extraction means.

[2418] The "presentation means" is a device or interface that presents the most suitable service or information to the user based on the analysis results by the comparison means.

[2419] An "emotion recognition means" is a device or algorithm for recognizing a user's emotions, and analyzes audio and video using a camera or microphone.

[2420] The "adjustment means" is a device or algorithm that adjusts the presented service information or recommendation results based on the user's emotions recognized by the emotion recognition means.

[2421] The "acquisition means" is a device or interface for acquiring text data and membership terms and conditions specified by the user.

[2422] A "natural language processing means" is a device or algorithm for analyzing acquired text data and extracting important points.

[2423] "Storage means" refers to a device or database for encrypting and safely storing user registration information.

[2424] The "checking means" is a device or algorithm that periodically checks the registration information stored in the storage means and provides feedback to the user.

[2425] The present invention is a system for recognizing a user's emotions and recommending optimal services and products based on the emotions. Hereinafter, an embodiment of the present invention will be described in detail.

[2426] System Configuration

[2427] This system consists of an "input means" for users to input desired services and product categories, an "extraction means" for extracting relevant information from a database based on the user's input, a "comparison means" for evaluating and comparing the extracted information, an "emotion recognition means" for recognizing the user's emotions, an "adjustment means" for adjusting recommendations based on the emotion recognition results, and a "presentation means" for presenting the final recommendation results to the user.

[2428] Hardware and Software

[2429] 1. Hardware

[2430] Smartphone: User input, emotion recognition using camera and microphone

[2431] Server: Database management, high-performance CPU, GPU

[2432] 2. Software

[2433] Smartphone app: Developed with React Native

[2434] Server side: Developed in Python (Django)

[2435] Database: PostgreSQL

[2436] Emotion recognition engine: Google Cloud Vision API, IBM Watson Tone Analyzer

[2437] Processing flow

[2438] The system operates as follows:

[2439] 1. Input method (within smartphone app)

[2440] The user enters the desired service or product category, for example, "home coffee maker."

[2441] 2. Extraction method (server)

[2442] It receives information entered by the user and extracts relevant product information from a database.

[2443] 3. Comparison Method (Server)

[2444] The extracted product information is compared based on price, ratings, features, etc.

[2445] 4. Emotion Recognition Methods (Smartphone App and Cloud API)

[2446] Analyzes emotions using the user's camera footage and voice using Google Cloud Vision API and IBM Watson Tone Analyzer.

[2447] 5. Coordination mechanism (server)

[2448] Based on the emotion recognition results, product information suitable for the user's emotional state is adjusted.

[2449] 6. Presentation method (within smartphone app)

[2450] The final recommendation results are presented to the user.

[2451] Specific examples

[2452] For example, if a user requests a "home coffee maker" and the emotion recognition means recognizes that the user is feeling stressed, the server can prioritize and recommend products that are easy to operate and effective in reducing stress.

[2453] Prompt Sentence Examples

[2454] "Product category: Home coffee maker"

[2455] "User Emotions: Stress"

[2456] "Emotion Engine Recommendations: Easy Operation, Low Price, Relaxing Features"

[2457] This system configuration and processing procedure makes it possible to recommend optimal services and products that take into account the user's emotions.

[2458] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2459] Step 1:

[2460] A user opens a smartphone app and inputs the desired service or product category. The input is done through a user interface such as a text box. For example, the user inputs "home coffee maker."

[2461] Step 2:

[2462] The terminal sends the entered category information to the server. At this time, the information entered by the user, "home coffee maker," is sent as data.

[2463] Step 3:

[2464] Based on the category information received by the server, related product information is extracted from the database. Specifically, multiple product data (price, ratings, features, etc.) related to "home coffee makers" are retrieved from the PostgreSQL database.

[2465] Step 4:

[2466] The server compares the extracted product information using a rating algorithm, scoring the products based on multiple criteria such as price, rating, and features, generating a ranking. This ranking data is then input to the next processing step.

[2467] Step 5:

[2468] The device uses a built-in camera and microphone to collect the user's facial expressions and voice, and sends them to an emotion recognition engine (Google Cloud Vision API or IBM Watson Tone Analyzer). The emotion recognition engine uses this data to analyze the user's emotional state and output the results.

[2469] Step 6:

[2470] The server adjusts the ranking of recommended products based on the emotional state data received from the emotion recognition engine. For example, if the user is feeling stressed, the ranking will be reevaluated to prioritize products that are easy to operate, inexpensive, and have a high relaxation effect.

[2471] Step 7:

[2472] The server sends the final adjusted ranking data to the smartphone app, which outputs the optimal product list based on the adjusted ranking.

[2473] Step 8:

[2474] The device displays the received ranking data on the user interface. For example, a list of recommended "home coffee makers" is presented to the user. The user can instantly check the best products based on their emotions.

[2475] This series of processes makes it possible to recommend optimal services and products in real time, taking into account the user's emotions.

[2476] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[2477] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2478] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[2479] [Fourth embodiment]

[2480] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[2481] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[2482] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2483] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[2484] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[2485] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[2486] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[2487] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[2488] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[2489] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2490] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2491] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2492] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2493] MODE FOR CARRYING OUT THE INVENTION

[2494] Recommended features of the service

[2495] overview

[2496] In this invention, a system is constructed in which a user inputs the category of a desired service, and the server compares and evaluates similar services and presents recommended services.

[2497] Program processing

[2498] 1. The user's terminal displays an interface for inputting service category information.

[2499] 2. The user enters the category information of the desired service and submits it.

[2500] 3. The server receives the input category information and extracts related service information from the database based on that information.

[2501] 4. The server evaluates the extracted services based on price, features, user reviews, etc., and selects the most suitable service using a comparison algorithm.

[2502] 5. The server sends the selected recommended services to the user's device.

[2503] 6. The user's device will display the recommended services for the user to review.

[2504] Specific examples

[2505] For example, if a user requests a "video streaming service," the server extracts service information from Netflix, Hulu, Amazon Prime Video, etc., and compares them based on their prices, features, and user reviews. Using a comparison algorithm, the server selects Netflix as the optimal service and presents that information to the user.

[2506] Membership terms summary function

[2507] overview

[2508] To provide a system in which a server extracts important points of a membership agreement and presents them in a summary form so that a user can efficiently understand the membership agreement of a service.

[2509] Program processing

[2510] 1. The user's device displays an interface for obtaining the URL of the service's membership terms page.

[2511] 2. The user enters the URL of the membership terms page and submits it.

[2512] 3. The server retrieves the text data of the membership terms page based on the entered URL.

[2513] 4. The server analyzes the text data using a natural language processing engine and extracts important points.

[2514] 5. The server generates a summary of the extracted points and sends it to the user's device.

[2515] 6. The user's device displays a summary of the membership terms and conditions for the user to review.

[2516] Specific examples

[2517] For example, if a user is trying to sign up for a new video streaming service, they can submit the URL of the membership terms and conditions, and the server will extract important points such as "automatic renewal," "how to cancel," and "price changes" and provide a summary to the user.

[2518] Membership registration status and password management function

[2519] overview

[2520] The system aims to securely manage users' membership registration information and passwords and provide regular feedback.

[2521] Program processing

[2522] 1. The user's device displays a form for registering fo...

Claims

1. an input means for inputting a category of service desired by the user; an extraction means for extracting similar service information from a database based on the category information input via the input means; a comparison means for comparing the similar services extracted by the extraction means using an evaluation algorithm; The system further includes a presentation means for presenting recommended services based on the comparison results by the comparison means.

2. An acquisition means for acquiring text data of the membership terms of the service designated by the user; natural language processing means for analyzing the text data acquired by the acquisition means and extracting important points; 2. The system according to claim 1, further comprising: a presentation unit that presents the important points extracted by said natural language processing unit to a user as a summary.

3. an input means for inputting registration information to be input when a user registers for a new service; a storage means for encrypting and storing the registration information input by the input means; 2. The system according to claim 1, further comprising checking means for periodically checking the registration information stored in said storage means and providing feedback to the user.

Citation Information

Patent Citations

  • Persona chatbot control method and system

    JP2022180282A