System

Abstract

A system is provided.SOLUTION: The system includes a means for receiving an input from a user, a means for analyzing the received input, a means for retrieving an appropriate resource or information based on the analysis result, a means for generating a reply to the user based on the retrieval result, and a means for providing the generated reply to the user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Employees have opinions and requests about their work and organizations, but they often have limited opportunities to share them appropriately. Furthermore, a lack of efficient ways to access necessary information and resources can lead to a decline in career advancement and motivation at work. Furthermore, a lack of concrete advice and tools regarding work-life balance and stress management can increase employee stress and reduce productivity. [Means for solving the problem]

[0005] The present invention solves the above problems by providing a system that accepts input from a user, analyzes the input, searches for appropriate resources and information based on the analysis results, generates answers to the user based on the search results, and provides the answers to the user. Specifically, a system is constructed that passes input data to a natural language processing engine for analysis, searches for appropriate resources and information based on the analysis results, generates answers to user feedback and requests, and also provides advice on work-life balance and stress management.

[0006] "Means for accepting input from the user" refers to the interface through which the user provides information such as feedback, questions, and requests to the system.

[0007] "Means for analyzing received input" refers to technology that uses natural language processing, machine learning, and other technologies to understand the content of input data received from a user and process it appropriately.

[0008] "Means for searching for appropriate resources or information based on the analysis results" refers to technology for searching for information corresponding to the analyzed input data from databases or external sources.

[0009] "Means for generating a response to a user based on search results" refers to a technology that constructs an appropriate response to a user based on the searched information.

[0010] "Means for providing the generated answer to the user" refers to a function for displaying the answer generated by the system to the user.

[0011] "Means for passing input data to a natural language processing engine for analysis" refers to a technology in which text data received from a user is sent to a natural language processing engine (e.g., ChatGPT (registered trademark)) and its contents are analyzed.

[0012] "Means for searching for appropriate resources and information based on analysis results" refers to technology that searches for related information and resources from databases, external APIs, etc. based on the analysis results of a natural language processing engine.

[0013] "Means for generating responses to user feedback and requests" refers to technology that generates specific responses and proposals based on feedback and requests from users.

[0014] "Means for providing advice on work-life balance and stress management" refers to technology for providing advice and tools on work-life balance and stress management that users desire. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10]1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0016] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0019] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0020] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0021] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0023] [First embodiment]

[0024] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0025] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0028] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0031] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0035] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0036] The present invention relates to a system that uses a natural language processing engine such as ChatGPT to accept feedback, requests, questions, etc. from users and provides appropriate answers and resources in response.

[0037] Accepting feedback and requests

[0038] User:

[0039] Users enter their feedback and requests through the device interface, for example, "I need a new project management tool."

[0040] Device:

[0041] The terminal sends the user's input in text format to the server. Specifically, the input data is converted to JSON format as needed and sent to the server as an HTTP request.

[0042] server:

[0043] The server passes the input data received from the device to a natural language processing engine (e.g., ChatGPT) for analysis. Based on the analysis results, it searches for appropriate resources and information from a database or external API. For example, it searches for information about a new project management tool.

[0044] The server generates an answer based on the search results and sends the answer to the device. For example, it generates an answer in the form of "We recommend XX as a new project management tool."

[0045] Device:

[0046] The terminal displays the answer received from the server to the user, who can then confirm the proposed content.

[0047] Providing necessary information and resources

[0048] User:

[0049] The user inputs a question about career paths and training materials into the terminal, for example, "I would like information about career paths."

[0050] Device:

[0051] The terminal transmits the user's question in text format to the server.

[0052] server:

[0053] The server analyzes the questions received from the device and searches a database for relevant resources and information related to the career path, such as career development programs and training materials within the organization.

[0054] Based on the search results, the server generates a response such as "For information about career paths, please refer to the link below" and sends it to the terminal.

[0055] Device:

[0056] The terminal displays the response received from the server to the user, who can then view the provided information.

[0057] Work-life balance and stress management advice

[0058] User:

[0059] The user inputs a question about work-life balance or stress management into the terminal, for example, "Please tell me effective time management methods."

[0060] Device:

[0061] The terminal transmits the user's question in text format to the server.

[0062] server:

[0063] The server analyzes the questions received from the device and searches a database for materials and tools related to time management and stress management, such as information on effective time management tools and relaxation techniques.

[0064] Based on the search results, the server generates a response such as "Please use XX as a tool for effective time management" and sends it to the device.

[0065] Device:

[0066] The device displays the answers received from the server to the user, who can then use the advice and tools provided to improve their work-life balance and manage stress.

[0067] Specific examples

[0068] Examples of feedback and requests:

[0069] The user types "I want a new project management tool" into the terminal. The terminal sends this input to the server. The server analyzes the input and recognizes that it means "to introduce a new tool." The server searches its database for information on an appropriate project management tool. The server generates a response saying "We propose introducing XX as a new project management tool" and sends it to the terminal. The terminal displays the response to the user.

[0070] Examples of providing information and resources include:

[0071] The user types "Tell me about career paths" into the terminal. The terminal sends this input to the server. The server analyzes the data and recognizes that "information about career paths" is being requested. The server searches the database for information about career development programs. The server generates a response saying "You can find information about career paths by clicking the link below" and sends it to the terminal. The terminal displays the response to the user.

[0072] Examples of work-life balance and stress management:

[0073] The user types "Please tell me effective time management methods" into the device. The device sends this input to the server. The server analyzes the data and recognizes that it is a "question about time management methods." The server searches a database for information and tools related to time management. The server generates an answer such as "I recommend ____ as a tool for effective time management," and sends it to the device. The device displays the answer to the user.

[0074] As described above, the system of the present invention can respond quickly and appropriately to feedback, requests, and questions from users, thereby improving employee satisfaction and engagement.

[0075] The processing flow will be explained below.

[0076] Accepting feedback and requests

[0077] Step 1:

[0078] User: The user uses the device interface to enter feedback and requests, for example, "I need a new project management tool."

[0079] Step 2:

[0080] Terminal: The terminal sends the feedback and requests entered by the user in text format to the server. If necessary, the input data is converted to JSON format.

[0081] Step 3:

[0082] Server: The server passes the data received from the device to a natural language processing engine (e.g., ChatGPT) for analysis. For example, it may interpret the data as a request for a new tool.

[0083] Step 4:

[0084] Server: Based on the analysis results, the server searches for relevant resources and information from databases or external APIs, for example, searching for information about available project management tools.

[0085] Step 5:

[0086] Server: The server generates specific suggestions and answers for the user based on the search results. For example, it generates an answer such as "We recommend XX as a new project management tool."

[0087] Step 6:

[0088] Server: The server generates a response and sends it to the device.

[0089] Step 7:

[0090] Terminal: The terminal displays the answer received from the server to the user, who then confirms the proposal.

[0091] Providing necessary information and resources

[0092] Step 1:

[0093] User: The user uses the device interface to input a question or concern, for example, "I would like information about career paths."

[0094] Step 2:

[0095] Terminal: The terminal sends user questions and concerns in text format to the server. If necessary, the input data is converted to JSON format.

[0096] Step 3:

[0097] Server: The server passes the data received from the device to a natural language processing engine (e.g., ChatGPT) and analyzes the question or inquiry. For example, it may analyze it as a question asking for information about career paths.

[0098] Step 4:

[0099] Server: Based on the analysis results, the server searches for appropriate resources and information from databases or external APIs, for example, career development programs or training materials.

[0100] Step 5:

[0101] Server: The server generates a specific answer for the user based on the search results, for example, "You can find information about career paths by clicking on the link below."

[0102] Step 6:

[0103] Server: The server generates a response and sends it to the device.

[0104] Step 7:

[0105] Terminal: The terminal displays the answer received from the server to the user, who then views the provided information.

[0106] Work-life balance and stress management advice

[0107] Step 1:

[0108] User: The user uses the device interface to input a question about work-life balance or stress management, for example, "What are some effective time management techniques?"

[0109] Step 2:

[0110] Terminal: The terminal sends the user's question in text format to the server. If necessary, the input data is converted to JSON format.

[0111] Step 3:

[0112] Server: The server passes the data received from the device to a natural language processing engine (e.g., ChatGPT) and analyzes the question. For example, it may analyze it as a question about "time management methods."

[0113] Step 4:

[0114] Server: Based on the analysis results, the server searches for resources and information related to work-life balance and stress management from databases and external APIs, such as time management tools and relaxation techniques.

[0115] Step 5:

[0116] Server: The server generates specific advice for the user based on the search results, for example, "We recommend ____ as a tool for effective time management."

[0117] Step 6:

[0118] Server: The server sends the generated advice to the terminal.

[0119] Step 7:

[0120] Terminal: The terminal displays the advice received from the server to the user, who can then put the suggested tools and methods into practice.

[0121] Through these processing steps, the system provides appropriate resources and advice in response to feedback and questions from users. In this way, the system of the present invention can improve employee satisfaction and engagement.

[0122] Example 1

[0123] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0124] With the previous system, it was difficult to respond quickly and appropriately to feedback, requests, and questions from users, and it was not flexible enough to accommodate individual consultations on career paths, stress management, etc. This created challenges in improving employee satisfaction and engagement.

[0125] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0126] In this invention, the server includes means for generating responses to user feedback and requests, means for providing information and resources for questions about career paths and training materials, and means for providing advice on work-life balance and stress management, thereby enabling a rapid and appropriate response to a variety of user inputs.

[0127] "User" refers to a person who uses the system to input feedback, requests, questions, etc.

[0128] "Terminal" refers to the device or software through which the user enters input and displays responses from the server.

[0129] "Server" refers to a device or software that analyzes data received from a terminal, searches for and generates appropriate resources and information, and sends them to the terminal.

[0130] A "natural language processing engine" refers to a computer model or algorithm that analyzes a user's text input, understands its meaning, and derives appropriate results.

[0131] "JSON format" is an abbreviation for JavaScript (registered trademark) Object Notation, and refers to a data format for structuring and expressing text data.

[0132] An "HTTP request" refers to a request message based on a network protocol for transmitting data from a client to a server.

[0133] "Database" refers to a system for storing and managing structured data.

[0134] An "external API" refers to an interface for communicating with external applications and services to access data and functions.

[0135] "Answer" refers to information or resources generated by the server in response to input from the user.

[0136] "Feedback" refers to the opinions and thoughts that users give to the system.

[0137] A "request" refers to a user's request for a desired function or service from the system.

[0138] "Career path" refers to the plan or path of the job or role that the user aims to take on in the future.

[0139] "Training Materials" refers to educational content and documents used by Users to improve their skills and gain knowledge.

[0140] "Work-life balance" refers to the appropriate allocation of work and private time and activities.

[0141] "Stress management" refers to methods and approaches for reducing mental strain and tension.

[0142] This invention relates to a system that accepts feedback, requests, and questions from users and provides appropriate answers and resources accordingly. This system consists of three main components: a server, a terminal, and a user.

[0143] Hardware and Software Configuration

[0144] server:

[0145] The server receives data sent by users and analyzes the data using a natural language processing engine (e.g., ChatGPT). It then searches for appropriate information and resources using databases and external APIs and provides the generated answers to users. The server's main software components include an API server and a database server (e.g., MySQL (registered trademark), PostgreSQL).

[0146] Device:

[0147] The device is responsible for receiving user input and sending it to the server. It converts the user input into JSON format and sends it to the server using an HTTP request. The device can be a web browser or a mobile application that uses HTML, CSS, JavaScript, etc.

[0148] User:

[0149] A user is a person who enters feedback, requests, and questions through the system.

[0150] Program processing

[0151] On the device:

[0152] The user uses the device's interface to input feedback or requests, such as "I need a new project management tool." The device receives this input in text format and converts it to JSON, which is then sent to the server as an HTTP request.

[0153] Server side:

[0154] The server analyzes the user's input received from the device by passing it to a natural language processing engine (e.g., ChatGPT). Based on the analysis results, it searches for appropriate resources and information. For example, it searches a database or external API for information about a new project management tool. Based on the search results, it generates a response such as "We recommend XX as your new project management tool," and sends this to the device.

[0155] Terminal side (redisplay):

[0156] The device displays the response received from the server to the user, who can then review the suggestions and take action based on them, such as trying out the proposed project management tool.

[0157] Specific examples

[0158] Examples of feedback and requests:

[0159] The user types "I want a new project management tool" into the device. The device sends this input to the server. The server analyzes the input and recognizes that it means "introducing a new tool." The server searches its database for information on an appropriate project management tool, generates a response saying "We propose introducing XX as your new project management tool," and sends it to the device. The device then displays the response to the user.

[0160] Example prompt sentence:

[0161] If the user's input is a request for a new project management tool, the corresponding prompt statement would be "This user wants a new project management tool."

[0162] This allows for quick and appropriate responses to a variety of user input. The system can improve employee satisfaction and engagement through flexible provision of information and advice.

[0163] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0164] Step 1:

[0165] User input

[0166] The user enters their feedback or request into the terminal interface, for example, "I need a new project management tool." This is the starting point of the process, and the user's input triggers the behavior of the entire system.

[0167] Specific behavior:

[0168] The user enters a request into the form on the browser and clicks the "Submit" button.

[0169] Input: Text data entered by the user

[0170] Output: Data entered by the user

[0171] Step 2:

[0172] Terminal prepares to send data

[0173] The terminal receives the user's input data in text format and converts it into JSON format.

[0174] Specific behavior:

[0175] The device converts the text "I need a new project management tool" received from the user into the JSON format {"request": "I need a new project management tool"}.

[0176] Input: User's text data

[0177] Output: Data converted to JSON format

[0178] Step 3:

[0179] Sending from the device to the server

[0180] The terminal sends the data converted into JSON format to the server as an HTTP request.

[0181] Specific behavior:

[0182] The JSON data generated by the terminal is sent to the server as a POST request. The URL used is https: / / example.com / api as an example.

[0183] Input: JSON format data

[0184] Output: Data sent to the server as an HTTP request

[0185] Step 4:

[0186] Data reception by the server and preparation for analysis

[0187] The server receives the data sent from the device and prepares it to be passed to a natural language processing engine such as ChatGPT.

[0188] Specific behavior:

[0189] The server receives the HTTP request and checks the header information and metadata.

[0190] Input: Data sent by the HTTP request

[0191] Output: Analysis-ready data

[0192] Step 5:

[0193] Analysis using a natural language processing engine

[0194] The server passes the received data to a natural language processing engine for analysis, and searches for appropriate resources and information based on the analysis results.

[0195] Specific behavior:

[0196] The server sends a prompt to the ChatGPT API saying "This user wants a new project management tool" and retrieves the analysis results.

[0197] Input: Data ready for analysis

[0198] Output: Analysis results

[0199] Step 6:

[0200] Finding resources and information

[0201] The server searches for appropriate resources or information from a database or external API based on the analysis results.

[0202] Specific behavior:

[0203] The server queries the database to get information about the "new project management tool," for example using a SQL query such as SELECT FROM tools WHERE category='project_management';

[0204] Input: Analysis results

[0205] Output: Resources and information as search results

[0206] Step 7:

[0207] Generate answers

[0208] The server generates an answer for the user based on the search results.

[0209] Specific behavior:

[0210] The server generates a response based on the search results using a template, such as "We recommend XX as a new project management tool."

[0211] Input: Resources and information as search results

[0212] Output: The generated answer

[0213] Step 8:

[0214] Transmission from the server to the device

[0215] The server sends the generated response to the terminal.

[0216] Specific behavior:

[0217] The server returns the generated answer to the terminal as an HTTP response. The URL used as an example is https: / / example.com / api.

[0218] Input: Generated answer

[0219] Output: Data sent to the device as an HTTP response

[0220] Step 9:

[0221] Displaying answers on the device

[0222] The terminal displays the response received from the server to the user.

[0223] Specific behavior:

[0224] The terminal displays the received response on the browser, and the user confirms it. For example, the response message is displayed in a modal window.

[0225] Input: Data sent as an HTTP response

[0226] Output: The answer displayed to the user

[0227] (Application example 1)

[0228] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0229] Security information evolves daily, making it difficult for users to instantly access the latest security information and countermeasures. There is also a need to provide prompt and appropriate responses to security-related questions and feedback. However, current systems make it difficult to respond in real time, potentially increasing security risks.

[0230] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0231] In this invention, the server includes a means for accepting input from a user, a means for analyzing the accepted input, and a means for searching for appropriate resources and information based on the analysis results. This makes it possible to provide quick and optimal answers to security-related questions and feedback using a natural language processing engine. Furthermore, by using a generative AI model, it is possible to provide advice based on the latest security information, thereby reducing the security risks for users.

[0232] The "means for accepting input from the user" is an interface through which the user can enter security questions and feedback.

[0233] The "means for analyzing received input" is a system that analyzes input received from a user using a natural language processing engine or the like.

[0234] "Means for searching for appropriate resources and information based on the analysis results" refers to a function that searches for appropriate security information and countermeasures from a database or external system based on the analyzed input.

[0235] The "means for generating a response to the user based on the search results" is a function for generating a response to be provided to the user based on the searched information.

[0236] The "means for providing the generated answer to the user" is an interface for displaying or notifying the generated answer to the user.

[0237] The "means for accepting security-related questions and feedback" is an interface for accepting security-related questions and feedback from users.

[0238] The "means for analyzing received security-related input and generating optimal answers" is a system that analyzes security-related input using a natural language processing engine and generates optimal answers based on the analysis results.

[0239] "Means for generating optimal answers using a generative AI model" is a function that uses a generated AI model (e.g., ChatGPT) to generate optimal answers to user questions.

[0240] The "means for providing advice regarding work-life balance and stress management" is a function that provides appropriate advice in response to questions about work-life balance and stress management from the user.

[0241] The "means for providing security advice" is a function that provides specific advice and countermeasures in response to security-related questions from users.

[0242] MODE FOR CARRYING OUT THE INVENTION

[0243] This invention provides a system that provides prompt and optimal answers to security-related questions and feedback. This system consists of three main elements: a user, a terminal, and a server. The specific roles and processing procedures of each element are described below.

[0244] User

[0245] Users input security questions and feedback using devices such as smartphones, which are generally entered in text format.

[0246] Examples:

[0247] The user uses their smartphone to type, "What are some signs of unauthorized logins recently?"

[0248] Terminal

[0249] The terminal is equipped with an interface that accepts text data entered by the user and sends it to the server. The text data is converted into JSON format and sent to the server as an HTTP request.

[0250] server

[0251] The server analyzes the received data using a natural language processing engine. This invention uses OpenAI (registered trademark) generative AI models (e.g., ChatGPT). Based on the analysis results, the server searches a database or external system for appropriate security information and countermeasures, and generates the optimal answer. The generated answer is then sent to the device.

[0252] Examples:

[0253] Example prompt sentence:

[0254] User Question: What are the signs of unauthorized logins recently?

[0255] Please provide the best security answer.

[0256] The server parses this prompt and generates an appropriate response: "Signs of unauthorized logins include a sudden password change or frequent logins from unusual locations. Other signs include an increase in security alerts from your device."

[0257] Terminal

[0258] The terminal that receives the generated answer displays it to the user, allowing the user to instantly obtain appropriate security information and advice.

[0259] This system allows users to receive fast and accurate answers to their real-time security questions and feedback, significantly reducing security risks and improving user peace of mind.

[0260] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0261] Step 1:

[0262] Users use their smartphones to enter security questions and feedback, and the entered text data is sent to the user's device.

[0263] Input: Security-related text entered by the user (e.g., "What are some signs of recent unauthorized login attempts?").

[0264] Output: Text data is captured to the terminal.

[0265] Step 2:

[0266] The device converts the received text data into JSON format and sends it to the server using an HTTP POST request. The conversion process and request transmission are performed within the device.

[0267] Input: Text data entered by the user.

[0268] Data processing: Convert text data into JSON format.

[0269] Output: JSON formatted data is sent to the server.

[0270] Step 3:

[0271] The server parses the received JSON data and converts it to text format, which is then passed as input to a generative AI model (e.g., ChatGPT) for analysis.

[0272] Input: JSON formatted data.

[0273] Data processing: Convert JSON format data into text format.

[0274] Data computation: Perform analysis using generative AI models.

[0275] Output: Analysis results from the generative AI model.

[0276] Step 4:

[0277] Based on the analysis results obtained from the generative AI model, the server searches a database for appropriate security information and countermeasures, and generates the optimal answer.

[0278] Input: Analysis results from the generative AI model.

[0279] Data calculation: Based on the analysis results, appropriate information is searched for in the database and an answer is generated.

[0280] Output: The generated textual answer.

[0281] Step 5:

[0282] The server converts the generated response into JSON format and sends it back to the terminal as an HTTP response. The conversion process and response transmission are performed within the server.

[0283] Input: A textual answer.

[0284] Data processing: Convert text responses into JSON format.

[0285] Output: JSON formatted data is sent to the terminal.

[0286] Step 6:

[0287] The device parses the JSON data received from the server and displays it to the user as a text response. The parsing and display are performed within the device.

[0288] Input: JSON format data received from the server.

[0289] Data processing: Convert JSON format data into text format.

[0290] Output: The textual response is displayed.

[0291] In this way, users can get fast and relevant answers to their security questions and feedback.

[0292] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0293] This invention relates to a system that uses a natural language processing engine such as ChatGPT and an emotion engine to accept feedback, requests, questions, etc. from users and provide appropriate answers and resources accordingly. In particular, it has the function of recognizing the user's emotions and optimizing responses based on those emotions.

[0294] Accepting feedback and requests

[0295] User:

[0296] Users use the device interface to enter their feedback and requests, for example, "I need a new project management tool."

[0297] Device:

[0298] The terminal sends the user's input in text format to the server, which converts the input data to JSON format if necessary.

[0299] server:

[0300] The server first passes the input data received from the device to an emotion engine to recognize the user's emotions. For example, it recognizes that the user is expressing anger along with the request "I need a new tool." It then passes the data to a natural language processing engine (e.g., ChatGPT) to analyze the content.

[0301] Based on the analysis and emotion recognition results, the server searches for relevant resources and information from databases and external APIs, for example, searching for information about available project management tools.

[0302] server:

[0303] The server generates specific suggestions and answers for the user based on the search results, such as "We recommend XX as a new project management tool. Also, please let us know if you have any complaints."

[0304] Device:

[0305] The terminal displays the answer received from the server to the user, who then confirms the proposal.

[0306] Providing necessary information and resources

[0307] User:

[0308] Users enter questions about career paths and training materials into the terminal, for example, "I would like information about career paths."

[0309] Device:

[0310] The terminal transmits the user's question in text format to the server.

[0311] server:

[0312] The server passes the question received from the device to the emotion engine, which recognizes the user's emotion. For example, it recognizes that the user is expressing anxiety. It then passes the question to the natural language processing engine, which analyzes the content of the question.

[0313] Based on the analysis results, search for appropriate resources and information from databases or external APIs, for example, search for information on career development programs and training materials.

[0314] server:

[0315] The server generates a specific response to the user based on the search results, such as "You can find information about career paths by clicking the link below. If you have any concerns, please feel free to contact us."

[0316] Device:

[0317] The terminal displays the response received from the server to the user, who then views the provided information.

[0318] Work-life balance and stress management advice

[0319] User:

[0320] Users input questions about work-life balance and stress management into the device, for example, "Please tell me effective time management methods."

[0321] Device:

[0322] The terminal transmits the user's question in text format to the server.

[0323] server:

[0324] The server passes the question received from the device to the emotion engine, which recognizes the user's emotions. For example, it recognizes that the user is feeling stressed. The server then passes the data to the natural language processing engine, which analyzes the content.

[0325] Based on the analysis results, resources and information related to work-life balance and stress management are searched from databases and external APIs, for example, information on time management tools and relaxation techniques.

[0326] server:

[0327] The server generates specific advice for the user based on the search results, such as "We recommend ____ as a tool for effective time management. Please also use techniques to reduce stress."

[0328] Device:

[0329] The device displays the advice received from the server to the user, who can then put the suggested tools and methods into practice.

[0330] Through these processing steps, the system provides appropriate resources and advice in response to user feedback and questions, and responds in accordance with the user's emotions, thereby improving employee satisfaction and engagement. In this way, the system of the present invention can also contribute to improving employee stress management and work-life balance.

[0331] The processing flow will be explained below.

[0332] Accepting feedback and requests

[0333] Step 1:

[0334] User: The user uses the device interface to enter feedback and requests, for example, "I need a new project management tool."

[0335] Step 2:

[0336] Terminal: The terminal sends the feedback and requests entered by the user in text format to the server. If necessary, the input data is converted to JSON format.

[0337] Step 3:

[0338] Server: The server passes the data received from the device to the emotion engine and recognizes the user's emotion. For example, it recognizes that the user is expressing anger along with the request "I need a new tool."

[0339] Step 4:

[0340] Server: The server passes the recognized emotion data to a natural language processing engine (e.g., ChatGPT) for content analysis. The analysis determines that the user wants to "introduce a new tool."

[0341] Step 5:

[0342] Server: Based on the analysis and emotion recognition results, the server searches for relevant resources and information from databases and external APIs, for example, searching for information about available project management tools.

[0343] Step 6:

[0344] Server: The server generates specific suggestions and answers for the user based on the search results. For example, it generates an answer such as, "We recommend XX as a new project management tool. Also, please let us know if you have any complaints."

[0345] Step 7:

[0346] Server: The server generates a response and sends it to the device.

[0347] Step 8:

[0348] Terminal: The terminal displays the answer received from the server to the user, who then confirms the proposal.

[0349] Providing necessary information and resources

[0350] Step 1:

[0351] User: The user uses the device interface to input a question or concern, for example, "I would like information about career paths."

[0352] Step 2:

[0353] Terminal: The terminal sends user questions and concerns in text format to the server. If necessary, the input data is converted to JSON format.

[0354] Step 3:

[0355] Server: The server passes the data received from the device to the emotion engine and recognizes the user's emotion. For example, it recognizes that the user is expressing anxiety.

[0356] Step 4:

[0357] Server: The server passes the recognized emotion data to a natural language processing engine, which analyzes the question. Through this analysis, it determines that the user is looking for information about career paths.

[0358] Step 5:

[0359] Server: Based on the analysis results, the server searches for appropriate resources and information from databases or external APIs, for example, career development programs or training materials.

[0360] Step 6:

[0361] Server: The server generates a specific answer to the user based on the search results. For example, it generates an answer such as, "You can find information about career paths by clicking the link below. If you have any concerns, please feel free to contact us."

[0362] Step 7:

[0363] Server: The server generates a response and sends it to the device.

[0364] Step 8:

[0365] Terminal: The terminal displays the answer received from the server to the user, who then views the provided information.

[0366] Work-life balance and stress management advice

[0367] Step 1:

[0368] User: The user uses the device interface to input a question about work-life balance or stress management, for example, "What are some effective time management techniques?"

[0369] Step 2:

[0370] Terminal: The terminal sends the user's question in text format to the server. If necessary, the input data is converted to JSON format.

[0371] Step 3:

[0372] Server: The server passes the data received from the device to the emotion engine and recognizes the user's emotion. For example, it recognizes that the user is feeling stressed.

[0373] Step 4:

[0374] Server: The server passes the recognized emotion data to a natural language processing engine, which analyzes the question. Through the analysis, it determines that the user is asking about "time management methods."

[0375] Step 5:

[0376] Server: Based on the analysis results, the server searches for resources and information related to work-life balance and stress management from databases and external APIs, such as time management tools and relaxation techniques.

[0377] Step 6:

[0378] Server: The server generates specific advice for the user based on the search results. For example, it generates an answer such as, "We recommend ____ as a tool for effective time management. Please also use techniques to reduce stress."

[0379] Step 7:

[0380] Server: The server sends the generated advice to the terminal.

[0381] Step 8:

[0382] Terminal: The terminal displays the advice received from the server to the user, who can then put the suggested tools and methods into practice.

[0383] Through these processing steps, the system provides appropriate resources and advice in response to user feedback and questions, and responds in accordance with the user's emotions, thereby improving employee satisfaction and engagement. In this way, the system of the present invention can also contribute to improving employee stress management and work-life balance.

[0384] Example 2

[0385] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0386] Conventional systems lacked the processing power to provide appropriate resources and information in response to user input, and were particularly unable to respond in a way that took the user's emotions into consideration. Furthermore, responses to user feedback and questions were uniform, making it difficult to respond flexibly to improve user satisfaction. Advice and support regarding work-life balance and stress management were also limited, preventing them from contributing to overall improvements in employee satisfaction and engagement.

[0387] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for accepting user input, means for recognizing the user's emotion, means for optimizing a response using the emotion recognition result, means for passing the input data to a natural language processing engine for analysis, means for searching for appropriate resources and information based on the analysis result and the emotion recognition result, means for generating a response to the user based on the search result, and means for providing the generated response to the user. This enables flexible and optimal responses that take the user's emotion into consideration, thereby significantly improving user satisfaction and engagement.

[0388] A "user" is an individual or organization that utilizes the system to enter feedback and questions and obtain answers and information.

[0389] "Means for accepting input" refers to an interface or module for inputting text data or questions from the user into the system.

[0390] "Means of analysis" refers to the processes and modules used to process received text data and understand and comprehend its contents.

[0391] An "emotion recognition means" is an engine or algorithm that analyzes input text data and identifies the emotion being expressed by the user.

[0392] The "means for optimizing responses" refers to a process or module that generates appropriate answers or suggestions based on the recognized emotions and provides optimal information to the user.

[0393] A "natural language processing engine" is a technology or algorithm that analyzes input text data and understands its meaning.

[0394] "Means for retrieving resources and information" refers to processes or modules for locating relevant information and resources from databases or external sources based on the analysis results.

[0395] "Means for generating answers" refers to processes or modules for creating specific answers or suggestions to provide to users based on search results and analysis content.

[0396] The "means for providing" refers to an interface or function for displaying the generated answers or suggestions to the user and enabling the user to use them.

[0397] "Flexible response" is the ability to individually tailor and provide the optimal response based on the user's individual needs and emotions.

[0398] This invention is a system that accepts feedback, requests, questions, etc. from users and provides appropriate answers and resources using a natural language processing engine and an emotion recognition engine. In particular, it has the function of recognizing the user's emotions and optimizing responses based on those emotions.

[0399] The system mainly uses the following hardware and software:

[0400] 1. User device: A device used by a user to input text data, such as a PC, smartphone, or tablet.

[0401] 2. Server: A computer system that receives, analyzes, and processes data.

[0402] 3. Natural language processing engine (e.g. ChatGPT): Software that analyzes text data entered by users and understands its meaning.

[0403] 4. Emotion recognition engine (e.g., Affectiva): Software that recognizes user emotions from text data.

[0404] 5. Database: An information system for storing relevant resources and information for user feedback, requests and questions.

[0405] The invention is implemented in the following steps:

[0406] 1. User provides text input: The user uses the device interface to enter feedback, requests, or questions in text format, for example, "I need a new project management tool."

[0407] 2. Sending input data: The terminal converts the input data into JSON format and sends it to the server.

[0408] 3. Emotion Recognition: The server receives the input data and first passes it to the emotion recognition engine, which analyzes the emotions in the text and recognizes emotions such as anger, anxiety, and joy.

[0409] 4. Natural Language Analysis: The server then sends the data to a natural language processing engine for content analysis. The engine understands the intent of the input and prepares an appropriate response.

[0410] 5. Search for related information: Based on the analysis results, the server searches for related resources and information from databases and external APIs, for example, gathering information about a new project management tool.

[0411] 6. Answer Generation: The server generates the best answer for the user based on the search results. For example, it generates a sentence like, "We recommend XX as a new project management tool. Also, please let us know if you have any other complaints."

[0412] 7. Displaying the Answer: The terminal displays the answer received from the server to the user, who can view it and provide feedback.

[0413] A distinctive feature of this system is its emotion recognition function. By understanding the user's emotions, it can provide more appropriate and empathetic responses. For example, if a user writes "I'd like information about career paths" with a sense of anxiety, the server will recognize that anxiety and generate a response with an empathetic comment such as "If you have any concerns, please feel free to contact us."

[0414] As a concrete example, if a user types "Please tell me effective time management methods," this data is sent from the device to the server. The server uses an emotion recognition engine to recognize the user's sense of stress, and then analyzes the content using a natural language processing engine. As a result, it generates a response such as "We recommend ____ as a tool for effective time management. Please also use techniques for stress reduction," and displays it on the device.

[0415] Example prompt sentence:

[0416] User: What are some effective time management techniques?

[0417] In this way, the invention can provide flexible and optimal responses according to the user's emotions, significantly improving user satisfaction and engagement.

[0418] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0419] Step 1:

[0420] User: Through a terminal interface, users input feedback, requests, and questions. This input is typically in text format and includes prompts such as "I need a new project management tool."

[0421] Input: Text data

[0422] Output: Text data captured on the user's terminal

[0423] Step 2:

[0424] Terminal: The terminal receives the text data entered by the user and sends it to the server, where it is converted to JSON format and sent to the server as an HTTPS request.

[0425] Specific behavior: Converts text data into JSON format and constructs and sends an HTTPS request.

[0426] Input: Text data entered by the user

[0427] Output: JSON format data is sent to the server

[0428] Step 3:

[0429] Server: The server passes the JSON data received from the device to the emotion recognition engine. In this process, the text data is analyzed to recognize the user's emotions (e.g., anger, joy, anxiety, etc.).

[0430] Specific operation: Pass the data to the emotion recognition engine and perform emotion analysis.

[0431] Input: JSON format text data

[0432] Output: User emotion data (e.g. anger, anxiety, joy)

[0433] Step 4:

[0434] Server: The server sends the text data along with the recognized emotion data to a natural language processing engine, which analyzes the text data and understands the intent of the specific request or question.

[0435] Specific operation: Pass the data to a natural language processing engine and analyze the content.

[0436] Input: Emotion data and text data

[0437] Output: The parsed request or question intent

[0438] Step 5:

[0439] Server: Based on the analysis results, it searches for relevant information from databases and external APIs, for example, finding information and links about new project management tools.

[0440] Specific Actions: Execute SQL queries to perform database searches or send REST API requests to external services.

[0441] Input: Parsed request or question intent

[0442] Output: Search results (related resources and information)

[0443] Step 6:

[0444] Server: Generates the best answer for the user based on the search results. The generated answer is built using a template engine, etc. For example, it might create an answer like, "We recommend XX as a new project management tool. Also, please let us know if you have any other complaints."

[0445] What it does: Uses a template engine to build answers based on search results.

[0446] Input: Search result data

[0447] Output: Text of the reply to the user

[0448] Step 7:

[0449] Terminal: The terminal displays the answers received from the server to the user, allowing the user to review suggestions and information and take useful actions.

[0450] Specific behavior: Receives text data from the server and displays it in the user interface.

[0451] Input: Response text from the server

[0452] Output: Answer displayed on the user's terminal

[0453] (Application example 2)

[0454] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0455] Conventional customer support systems in brick-and-mortar stores have struggled to respond quickly and appropriately to feedback and requests. They also lack the ability to respond in a way that takes into account customer emotions, recommend optimal products according to the situation, or provide special offers. This has created challenges in improving customer satisfaction and the in-store shopping experience.

[0456] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for accepting input from a user, means for analyzing the accepted input, means for searching for appropriate resources or information based on the analysis results, means for generating a response to the user based on the search results, means for performing emotion analysis and optimizing the response based on the user's emotions, and means for providing the generated response to the user. This enables faster and more optimized customer service in physical stores, flexible responses according to customer emotions, and the provision of recommended information and special offers.

[0457] "Means for accepting user input" refers to an interface through which user-provided information or feedback can be entered into the system.

[0458] The "means for analyzing accepted input" refers to a function for analyzing input data from a user and performing processing to understand its contents.

[0459] "Means for searching for appropriate resources and information based on the analysis results" refers to the function of identifying related information and resources from the analyzed content and searching them from databases or external systems.

[0460] "Means for generating a response to the user based on the search results" refers to a function that generates a specific response to the user based on the searched resources or information.

[0461] "Means for performing sentiment analysis and optimizing responses based on the user's emotions" refers to a function that analyzes emotions from the user's words and expressions and constructs an optimal response based on those emotions.

[0462] "Means for providing the generated answer to the user" refers to means for notifying the user of the answer generated by the system.

[0463] A "natural language processing engine" refers to technology for understanding text data and analyzing its meaning and intent.

[0464] "Means for searching for information on specific products and generating suggestions" refers to a function for searching for information on specific products based on the analysis results and making suggestions to the user.

[0465] "Means for generating and providing specific discount information and coupons in physical stores based on user feedback and requests" refers to the function of creating discount information and coupons in physical stores based on feedback and requests from online users and providing them to users.

[0466] In the system realizing this invention, the user, the terminal, and the server work in cooperation with each other. Specific implementation means are shown below.

[0467] First, the user uses the smartphone application "Smart Shop Assistant." This application provides an interface for inputting feedback and requests from the user. For example, the user inputs a request such as "Do you have this product in other colors?" This input is sent to the server in text format by the device.

[0468] The server then analyzes the received input using an emotion analysis engine (e.g., Microsoft® Azure® Emotion API) to recognize the user's emotions. For example, it determines whether the user's request is positive or negative. The analysis results are then passed to a natural language processing engine (e.g., OpenAI's ChatGPT), which analyzes the specific content of the request. Based on these results, related product information and resources are searched for in a database or external API.

[0469] Based on the search results, the server generates a response to the user. It also takes into account the results of sentiment analysis, and if the user is dissatisfied, for example, it generates a response that includes an apology. Specifically, it generates a response such as, "This product is available in blue and red. Please let us know if you have any complaints."

[0470] It can also provide in-store rewards: for example, if a user shows a high interest in a particular product, the system can generate special coupons or discount information and provide it to the user.

[0471] Finally, the generated answers and suggestions are sent to the user via a smartphone application, allowing the user to receive relevant information and suggestions and improve their shopping experience in physical stores.

[0472] For example, the following prompt is sent to the generative AI model:

[0473] "The user is asking if you have a dress in size medium. The sentiment is neutral. Please generate an answer with product recommendations."

[0474] In this way, the system will enable faster and more optimized customer service in physical stores, flexible responses based on customer sentiment, and the provision of recommended information and special offers.

[0475] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0476] Step 1:

[0477] Users use a smartphone application to input feedback and requests. For example, they might input a request such as, "Do you have this product in other colors?" The input data is sent to the device in text format.

[0478] Step 2:

[0479] The terminal converts the input data from the user into JSON format and sends it to the server. For example, the input text "Do you have this product in other colors?" is converted into JSON format.

[0480] Step 3:

[0481] The server first passes the received input data to a sentiment analysis engine to recognize the user's sentiment. For example, it analyzes text data and recognizes that the user is expressing a neutral sentiment.

[0482] Step 4:

[0483] Based on the results of the sentiment analysis, the server passes the data to a natural language processing engine (e.g., ChatGPT) for analysis. For example, the question "Do you have this product in other colors?" is analyzed and it is determined that product information needs to be searched.

[0484] Step 5:

[0485] The server searches for related product information from a database or external API based on the analysis results of the natural language processing engine. For example, it searches the product database for "Whether or not there are products in different colors" and finds that there are blue and red colors.

[0486] Step 6:

[0487] The server generates a response to the user based on the search results, taking into account the results of sentiment analysis. For example, it generates a response such as, "This product is available in blue and red. Please let us know if you have any complaints."

[0488] Step 7:

[0489] The device displays the answer received from the server to the user. The user can check the generated answer through the smartphone application. For example, information such as "This product is available in blue and red" may be displayed.

[0490] Step 8:

[0491] In the case of specific rewards, specific discount information and coupons can be generated and provided based on user feedback and requests. For example, special coupons can be generated for products that users show a high interest in and provided through the application.

[0492] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0493] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0494] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0495] [Second embodiment]

[0496] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0497] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0498] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0499] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0500] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0501] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0502] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0503] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0504] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0505] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0506] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0507] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0508] The present invention relates to a system that uses a natural language processing engine such as ChatGPT to accept feedback, requests, questions, etc. from users and provides appropriate answers and resources in response.

[0509] Accepting feedback and requests

[0510] User:

[0511] Users enter their feedback and requests through the device interface, for example, "I need a new project management tool."

[0512] Device:

[0513] The terminal sends the user's input in text format to the server. Specifically, the input data is converted to JSON format as needed and sent to the server as an HTTP request.

[0514] server:

[0515] The server passes the input data received from the device to a natural language processing engine (e.g., ChatGPT) for analysis. Based on the analysis results, it searches for appropriate resources and information from a database or external API. For example, it searches for information about a new project management tool.

[0516] The server generates an answer based on the search results and sends the answer to the device. For example, it generates an answer in the form of "We recommend XX as a new project management tool."

[0517] Device:

[0518] The terminal displays the answer received from the server to the user, who can then confirm the proposed content.

[0519] Providing necessary information and resources

[0520] User:

[0521] The user inputs a question about career paths and training materials into the terminal, for example, "I would like information about career paths."

[0522] Device:

[0523] The terminal transmits the user's question in text format to the server.

[0524] server:

[0525] The server analyzes the questions received from the device and searches a database for relevant resources and information related to the career path, such as career development programs and training materials within the organization.

[0526] Based on the search results, the server generates a response such as "For information about career paths, please refer to the link below" and sends it to the terminal.

[0527] Device:

[0528] The terminal displays the response received from the server to the user, who can then view the provided information.

[0529] Work-life balance and stress management advice

[0530] User:

[0531] The user inputs a question about work-life balance or stress management into the terminal, for example, "Please tell me effective time management methods."

[0532] Device:

[0533] The terminal transmits the user's question in text format to the server.

[0534] server:

[0535] The server analyzes the questions received from the device and searches a database for materials and tools related to time management and stress management, such as information on effective time management tools and relaxation techniques.

[0536] Based on the search results, the server generates a response such as "Please use XX as a tool for effective time management" and sends it to the device.

[0537] Device:

[0538] The device displays the answers received from the server to the user, who can then use the advice and tools provided to improve their work-life balance and manage stress.

[0539] Specific examples

[0540] Examples of feedback and requests:

[0541] The user types "I want a new project management tool" into the terminal. The terminal sends this input to the server. The server analyzes the input and recognizes that it means "to introduce a new tool." The server searches its database for information on an appropriate project management tool. The server generates a response saying "We propose introducing XX as a new project management tool" and sends it to the terminal. The terminal displays the response to the user.

[0542] Examples of providing information and resources include:

[0543] The user types "Tell me about career paths" into the terminal. The terminal sends this input to the server. The server analyzes the data and recognizes that "information about career paths" is being requested. The server searches the database for information about career development programs. The server generates a response saying "You can find information about career paths by clicking the link below" and sends it to the terminal. The terminal displays the response to the user.

[0544] Examples of work-life balance and stress management:

[0545] The user types "Please tell me effective time management methods" into the device. The device sends this input to the server. The server analyzes the data and recognizes that it is a "question about time management methods." The server searches a database for information and tools related to time management. The server generates an answer such as "I recommend ____ as a tool for effective time management," and sends it to the device. The device displays the answer to the user.

[0546] As described above, the system of the present invention can respond quickly and appropriately to feedback, requests, and questions from users, thereby improving employee satisfaction and engagement.

[0547] The processing flow will be explained below.

[0548] Accepting feedback and requests

[0549] Step 1:

[0550] User: The user uses the device interface to enter feedback and requests, for example, "I need a new project management tool."

[0551] Step 2:

[0552] Terminal: The terminal sends the feedback and requests entered by the user in text format to the server. If necessary, the input data is converted to JSON format.

[0553] Step 3:

[0554] Server: The server passes the data received from the device to a natural language processing engine (e.g., ChatGPT) for analysis. For example, it may interpret the data as a request for a new tool.

[0555] Step 4:

[0556] Server: Based on the analysis results, the server searches for relevant resources and information from databases or external APIs, for example, searching for information about available project management tools.

[0557] Step 5:

[0558] Server: The server generates specific suggestions and answers for the user based on the search results. For example, it generates an answer such as "We recommend XX as a new project management tool."

[0559] Step 6:

[0560] Server: The server generates a response and sends it to the device.

[0561] Step 7:

[0562] Terminal: The terminal displays the answer received from the server to the user, who then confirms the proposal.

[0563] Providing necessary information and resources

[0564] Step 1:

[0565] User: The user uses the device interface to input a question or concern, for example, "I would like information about career paths."

[0566] Step 2:

[0567] Terminal: The terminal sends user questions and concerns in text format to the server. If necessary, the input data is converted to JSON format.

[0568] Step 3:

[0569] Server: The server passes the data received from the device to a natural language processing engine (e.g., ChatGPT) and analyzes the question or inquiry. For example, it may analyze it as a question asking for information about career paths.

[0570] Step 4:

[0571] Server: Based on the analysis results, the server searches for appropriate resources and information from databases or external APIs, for example, career development programs or training materials.

[0572] Step 5:

[0573] Server: The server generates a specific answer for the user based on the search results, for example, "You can find information about career paths by clicking on the link below."

[0574] Step 6:

[0575] Server: The server generates a response and sends it to the device.

[0576] Step 7:

[0577] Terminal: The terminal displays the answer received from the server to the user, who then views the provided information.

[0578] Work-life balance and stress management advice

[0579] Step 1:

[0580] User: The user uses the device interface to input a question about work-life balance or stress management, for example, "What are some effective time management techniques?"

[0581] Step 2:

[0582] Terminal: The terminal sends the user's question in text format to the server. If necessary, the input data is converted to JSON format.

[0583] Step 3:

[0584] Server: The server passes the data received from the device to a natural language processing engine (e.g., ChatGPT) and analyzes the question. For example, it may analyze it as a question about "time management methods."

[0585] Step 4:

[0586] Server: Based on the analysis results, the server searches for resources and information related to work-life balance and stress management from databases and external APIs, such as time management tools and relaxation techniques.

[0587] Step 5:

[0588] Server: The server generates specific advice for the user based on the search results, for example, "We recommend ____ as a tool for effective time management."

[0589] Step 6:

[0590] Server: The server sends the generated advice to the terminal.

[0591] Step 7:

[0592] Terminal: The terminal displays the advice received from the server to the user, who can then put the suggested tools and methods into practice.

[0593] Through these processing steps, the system provides appropriate resources and advice in response to feedback and questions from users. In this way, the system of the present invention can improve employee satisfaction and engagement.

[0594] Example 1

[0595] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0596] With the previous system, it was difficult to respond quickly and appropriately to feedback, requests, and questions from users, and it was not flexible enough to accommodate individual consultations on career paths, stress management, etc. This created challenges in improving employee satisfaction and engagement.

[0597] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0598] In this invention, the server includes means for generating responses to user feedback and requests, means for providing information and resources for questions about career paths and training materials, and means for providing advice on work-life balance and stress management, thereby enabling a rapid and appropriate response to a variety of user inputs.

[0599] "User" refers to a person who uses the system to input feedback, requests, questions, etc.

[0600] "Terminal" refers to the device or software through which the user enters input and displays responses from the server.

[0601] "Server" refers to a device or software that analyzes data received from a terminal, searches for and generates appropriate resources and information, and sends them to the terminal.

[0602] A "natural language processing engine" refers to a computer model or algorithm that analyzes a user's text input, understands its meaning, and derives appropriate results.

[0603] "JSON format" is an abbreviation for JavaScript Object Notation, and refers to a data format for structuring and representing text data.

[0604] An "HTTP request" refers to a request message based on a network protocol for transmitting data from a client to a server.

[0605] "Database" refers to a system for storing and managing structured data.

[0606] An "external API" refers to an interface for communicating with external applications and services to access data and functions.

[0607] "Answer" refers to information or resources generated by the server in response to input from the user.

[0608] "Feedback" refers to the opinions and thoughts that users give to the system.

[0609] A "request" refers to a user's request for a desired function or service from the system.

[0610] "Career path" refers to the plan or path of the job or role that the user aims to take on in the future.

[0611] "Training Materials" refers to educational content and documents used by Users to improve their skills and gain knowledge.

[0612] "Work-life balance" refers to the appropriate allocation of work and private time and activities.

[0613] "Stress management" refers to methods and approaches for reducing mental strain and tension.

[0614] This invention relates to a system that accepts feedback, requests, and questions from users and provides appropriate answers and resources accordingly. This system consists of three main components: a server, a terminal, and a user.

[0615] Hardware and Software Configuration

[0616] server:

[0617] The server receives data sent by users, analyzes the data using a natural language processing engine (e.g., ChatGPT), searches for appropriate information and resources using databases and external APIs, and provides the generated answers to users. The server's main software components include an API server and a database server (e.g., MySQL, PostgreSQL).

[0618] Device:

[0619] The device is responsible for receiving user input and sending it to the server. It converts the user input into JSON format and sends it to the server using an HTTP request. The device can be a web browser or a mobile application that uses HTML, CSS, JavaScript, etc.

[0620] User:

[0621] A user is a person who enters feedback, requests, and questions through the system.

[0622] Program processing

[0623] On the device:

[0624] The user uses the device's interface to input feedback or requests, such as "I need a new project management tool." The device receives this input in text format and converts it to JSON, which is then sent to the server as an HTTP request.

[0625] Server side:

[0626] The server analyzes the user's input received from the device by passing it to a natural language processing engine (e.g., ChatGPT). Based on the analysis results, it searches for appropriate resources and information. For example, it searches a database or external API for information about a new project management tool. Based on the search results, it generates a response such as "We recommend XX as your new project management tool," and sends this to the device.

[0627] Terminal side (redisplay):

[0628] The device displays the response received from the server to the user, who can then review the suggestions and take action based on them, such as trying out the proposed project management tool.

[0629] Specific examples

[0630] Examples of feedback and requests:

[0631] The user types "I want a new project management tool" into the device. The device sends this input to the server. The server analyzes the input and recognizes that it means "introducing a new tool." The server searches its database for information on an appropriate project management tool, generates a response saying "We propose introducing XX as your new project management tool," and sends it to the device. The device then displays the response to the user.

[0632] Example prompt sentence:

[0633] If the user's input is a request for a new project management tool, the corresponding prompt statement would be "This user wants a new project management tool."

[0634] This allows for quick and appropriate responses to a variety of user input. The system can improve employee satisfaction and engagement through flexible provision of information and advice.

[0635] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0636] Step 1:

[0637] User input

[0638] The user enters their feedback or request into the terminal interface, for example, "I need a new project management tool." This is the starting point of the process, and the user's input triggers the behavior of the entire system.

[0639] Specific behavior:

[0640] The user enters a request into the form on the browser and clicks the "Submit" button.

[0641] Input: Text data entered by the user

[0642] Output: Data entered by the user

[0643] Step 2:

[0644] Terminal prepares to send data

[0645] The terminal receives the user's input data in text format and converts it into JSON format.

[0646] Specific behavior:

[0647] The device converts the text "I need a new project management tool" received from the user into the JSON format {"request": "I need a new project management tool"}.

[0648] Input: User's text data

[0649] Output: Data converted to JSON format

[0650] Step 3:

[0651] Sending from the device to the server

[0652] The terminal sends the data converted into JSON format to the server as an HTTP request.

[0653] Specific behavior:

[0654] The JSON data generated by the terminal is sent to the server as a POST request. The URL used is https: / / example.com / api as an example.

[0655] Input: JSON format data

[0656] Output: Data sent to the server as an HTTP request

[0657] Step 4:

[0658] Data reception by the server and preparation for analysis

[0659] The server receives the data sent from the device and prepares it to be passed to a natural language processing engine such as ChatGPT.

[0660] Specific behavior:

[0661] The server receives the HTTP request and checks the header information and metadata.

[0662] Input: Data sent by the HTTP request

[0663] Output: Analysis-ready data

[0664] Step 5:

[0665] Analysis using a natural language processing engine

[0666] The server passes the received data to a natural language processing engine for analysis, and searches for appropriate resources and information based on the analysis results.

[0667] Specific behavior:

[0668] The server sends a prompt to the ChatGPT API saying "This user wants a new project management tool" and retrieves the analysis results.

[0669] Input: Data ready for analysis

[0670] Output: Analysis results

[0671] Step 6:

[0672] Finding resources and information

[0673] The server searches for appropriate resources or information from a database or external API based on the analysis results.

[0674] Specific behavior:

[0675] The server queries the database to get information about the "new project management tool," for example using a SQL query such as SELECT FROM tools WHERE category='project_management';

[0676] Input: Analysis results

[0677] Output: Resources and information as search results

[0678] Step 7:

[0679] Generate answers

[0680] The server generates an answer for the user based on the search results.

[0681] Specific behavior:

[0682] The server generates a response based on the search results using a template, such as "We recommend XX as a new project management tool."

[0683] Input: Resources and information as search results

[0684] Output: The generated answer

[0685] Step 8:

[0686] Transmission from the server to the device

[0687] The server sends the generated response to the terminal.

[0688] Specific behavior:

[0689] The server returns the generated answer to the terminal as an HTTP response. The URL used as an example is https: / / example.com / api.

[0690] Input: Generated answer

[0691] Output: Data sent to the device as an HTTP response

[0692] Step 9:

[0693] Displaying answers on the device

[0694] The terminal displays the response received from the server to the user.

[0695] Specific behavior:

[0696] The terminal displays the received response on the browser, and the user confirms it. For example, the response message is displayed in a modal window.

[0697] Input: Data sent as an HTTP response

[0698] Output: The answer displayed to the user

[0699] (Application example 1)

[0700] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0701] Security information evolves daily, making it difficult for users to instantly access the latest security information and countermeasures. There is also a need to provide prompt and appropriate responses to security-related questions and feedback. However, current systems make it difficult to respond in real time, potentially increasing security risks.

[0702] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0703] In this invention, the server includes a means for accepting input from a user, a means for analyzing the accepted input, and a means for searching for appropriate resources and information based on the analysis results. This makes it possible to provide quick and optimal answers to security-related questions and feedback using a natural language processing engine. Furthermore, by using a generative AI model, it is possible to provide advice based on the latest security information, thereby reducing the security risks for users.

[0704] The "means for accepting input from the user" is an interface through which the user can enter security questions and feedback.

[0705] The "means for analyzing received input" is a system that analyzes input received from a user using a natural language processing engine or the like.

[0706] "Means for searching for appropriate resources and information based on the analysis results" refers to a function that searches for appropriate security information and countermeasures from a database or external system based on the analyzed input.

[0707] The "means for generating a response to the user based on the search results" is a function for generating a response to be provided to the user based on the searched information.

[0708] The "means for providing the generated answer to the user" is an interface for displaying or notifying the generated answer to the user.

[0709] The "means for accepting security-related questions and feedback" is an interface for accepting security-related questions and feedback from users.

[0710] The "means for analyzing received security-related input and generating optimal answers" is a system that analyzes security-related input using a natural language processing engine and generates optimal answers based on the analysis results.

[0711] "Means for generating optimal answers using a generative AI model" is a function that uses a generated AI model (e.g., ChatGPT) to generate optimal answers to user questions.

[0712] The "means for providing advice regarding work-life balance and stress management" is a function that provides appropriate advice in response to questions about work-life balance and stress management from the user.

[0713] The "means for providing security advice" is a function that provides specific advice and countermeasures in response to security-related questions from users.

[0714] MODE FOR CARRYING OUT THE INVENTION

[0715] This invention provides a system that provides prompt and optimal answers to security-related questions and feedback. This system consists of three main elements: a user, a terminal, and a server. The specific roles and processing procedures of each element are described below.

[0716] User

[0717] Users input security questions and feedback using devices such as smartphones, which are generally entered in text format.

[0718] Examples:

[0719] The user uses their smartphone to type, "What are some signs of unauthorized logins recently?"

[0720] Terminal

[0721] The terminal is equipped with an interface that accepts text data entered by the user and sends it to the server. The text data is converted into JSON format and sent to the server as an HTTP request.

[0722] server

[0723] The server analyzes the received data using a natural language processing engine. This invention uses OpenAI's generative AI model (e.g., ChatGPT). Based on the analysis results, it searches a database or external system for appropriate security information and countermeasures, and generates the optimal answer. The generated answer is then sent to the device.

[0724] Examples:

[0725] Example prompt sentence:

[0726] User Question: What are the signs of unauthorized logins recently?

[0727] Please provide the best security answer.

[0728] The server parses this prompt and generates an appropriate response: "Signs of unauthorized logins include a sudden password change or frequent logins from unusual locations. Other signs include an increase in security alerts from your device."

[0729] Terminal

[0730] The terminal that receives the generated answer displays it to the user, allowing the user to instantly obtain appropriate security information and advice.

[0731] This system allows users to receive fast and accurate answers to their real-time security questions and feedback, significantly reducing security risks and improving user peace of mind.

[0732] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0733] Step 1:

[0734] Users use their smartphones to enter security questions and feedback, and the entered text data is sent to the user's device.

[0735] Input: Security-related text entered by the user (e.g., "What are some signs of recent unauthorized login attempts?").

[0736] Output: Text data is captured to the terminal.

[0737] Step 2:

[0738] The device converts the received text data into JSON format and sends it to the server using an HTTP POST request. The conversion process and request transmission are performed within the device.

[0739] Input: Text data entered by the user.

[0740] Data processing: Convert text data into JSON format.

[0741] Output: JSON formatted data is sent to the server.

[0742] Step 3:

[0743] The server parses the received JSON data and converts it to text format, which is then passed as input to a generative AI model (e.g., ChatGPT) for analysis.

[0744] Input: JSON formatted data.

[0745] Data processing: Convert JSON format data into text format.

[0746] Data computation: Perform analysis using generative AI models.

[0747] Output: Analysis results from the generative AI model.

[0748] Step 4:

[0749] Based on the analysis results obtained from the generative AI model, the server searches a database for appropriate security information and countermeasures, and generates the optimal answer.

[0750] Input: Analysis results from the generative AI model.

[0751] Data calculation: Based on the analysis results, appropriate information is searched for in the database and an answer is generated.

[0752] Output: The generated textual answer.

[0753] Step 5:

[0754] The server converts the generated response into JSON format and sends it back to the terminal as an HTTP response. The conversion process and response transmission are performed within the server.

[0755] Input: A textual answer.

[0756] Data processing: Convert text responses into JSON format.

[0757] Output: JSON formatted data is sent to the terminal.

[0758] Step 6:

[0759] The device parses the JSON data received from the server and displays it to the user as a text response. The parsing and display are performed within the device.

[0760] Input: JSON format data received from the server.

[0761] Data processing: Convert JSON format data into text format.

[0762] Output: The textual response is displayed.

[0763] In this way, users can get fast and relevant answers to their security questions and feedback.

[0764] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0765] This invention relates to a system that uses a natural language processing engine such as ChatGPT and an emotion engine to accept feedback, requests, questions, etc. from users and provide appropriate answers and resources accordingly. In particular, it has the function of recognizing the user's emotions and optimizing responses based on those emotions.

[0766] Accepting feedback and requests

[0767] User:

[0768] Users use the device interface to enter their feedback and requests, for example, "I need a new project management tool."

[0769] Device:

[0770] The terminal sends the user's input in text format to the server, which converts the input data to JSON format if necessary.

[0771] server:

[0772] The server first passes the input data received from the device to an emotion engine to recognize the user's emotions. For example, it recognizes that the user is expressing anger along with the request "I need a new tool." It then passes the data to a natural language processing engine (e.g., ChatGPT) to analyze the content.

[0773] Based on the analysis and emotion recognition results, the server searches for relevant resources and information from databases and external APIs, for example, searching for information about available project management tools.

[0774] server:

[0775] The server generates specific suggestions and answers for the user based on the search results, such as "We recommend XX as a new project management tool. Also, please let us know if you have any complaints."

[0776] Device:

[0777] The terminal displays the answer received from the server to the user, who then confirms the proposal.

[0778] Providing necessary information and resources

[0779] User:

[0780] Users enter questions about career paths and training materials into the terminal, for example, "I would like information about career paths."

[0781] Device:

[0782] The terminal transmits the user's question in text format to the server.

[0783] server:

[0784] The server passes the question received from the device to the emotion engine, which recognizes the user's emotion. For example, it recognizes that the user is expressing anxiety. It then passes the question to the natural language processing engine, which analyzes the content of the question.

[0785] Based on the analysis results, search for appropriate resources and information from databases or external APIs, for example, search for information on career development programs and training materials.

[0786] server:

[0787] The server generates a specific response to the user based on the search results, such as "You can find information about career paths by clicking the link below. If you have any concerns, please feel free to contact us."

[0788] Device:

[0789] The terminal displays the response received from the server to the user, who then views the provided information.

[0790] Work-life balance and stress management advice

[0791] User:

[0792] Users input questions about work-life balance and stress management into the device, for example, "Please tell me effective time management methods."

[0793] Device:

[0794] The terminal transmits the user's question in text format to the server.

[0795] server:

[0796] The server passes the question received from the device to the emotion engine, which recognizes the user's emotions. For example, it recognizes that the user is feeling stressed. The server then passes the data to the natural language processing engine, which analyzes the content.

[0797] Based on the analysis results, resources and information related to work-life balance and stress management are searched from databases and external APIs, for example, information on time management tools and relaxation techniques.

[0798] server:

[0799] The server generates specific advice for the user based on the search results, such as "We recommend ____ as a tool for effective time management. Please also use techniques to reduce stress."

[0800] Device:

[0801] The device displays the advice received from the server to the user, who can then put the suggested tools and methods into practice.

[0802] Through these processing steps, the system provides appropriate resources and advice in response to user feedback and questions, and responds in accordance with the user's emotions, thereby improving employee satisfaction and engagement. In this way, the system of the present invention can also contribute to improving employee stress management and work-life balance.

[0803] The processing flow will be explained below.

[0804] Accepting feedback and requests

[0805] Step 1:

[0806] User: The user uses the device interface to enter feedback and requests, for example, "I need a new project management tool."

[0807] Step 2:

[0808] Terminal: The terminal sends the feedback and requests entered by the user in text format to the server. If necessary, the input data is converted to JSON format.

[0809] Step 3:

[0810] Server: The server passes the data received from the device to the emotion engine and recognizes the user's emotion. For example, it recognizes that the user is expressing anger along with the request "I need a new tool."

[0811] Step 4:

[0812] Server: The server passes the recognized emotion data to a natural language processing engine (e.g., ChatGPT) for content analysis. The analysis determines that the user wants to "introduce a new tool."

[0813] Step 5:

[0814] Server: Based on the analysis and emotion recognition results, the server searches for relevant resources and information from databases and external APIs, for example, searching for information about available project management tools.

[0815] Step 6:

[0816] Server: The server generates specific suggestions and answers for the user based on the search results. For example, it generates an answer such as, "We recommend XX as a new project management tool. Also, please let us know if you have any complaints."

[0817] Step 7:

[0818] Server: The server generates a response and sends it to the device.

[0819] Step 8:

[0820] Terminal: The terminal displays the answer received from the server to the user, who then confirms the proposal.

[0821] Providing necessary information and resources

[0822] Step 1:

[0823] User: The user uses the device interface to input a question or concern, for example, "I would like information about career paths."

[0824] Step 2:

[0825] Terminal: The terminal sends user questions and concerns in text format to the server. If necessary, the input data is converted to JSON format.

[0826] Step 3:

[0827] Server: The server passes the data received from the device to the emotion engine and recognizes the user's emotion. For example, it recognizes that the user is expressing anxiety.

[0828] Step 4:

[0829] Server: The server passes the recognized emotion data to a natural language processing engine, which analyzes the question. Through this analysis, it determines that the user is looking for information about career paths.

[0830] Step 5:

[0831] Server: Based on the analysis results, the server searches for appropriate resources and information from databases or external APIs, for example, career development programs or training materials.

[0832] Step 6:

[0833] Server: The server generates a specific answer to the user based on the search results. For example, it generates an answer such as, "You can find information about career paths by clicking the link below. If you have any concerns, please feel free to contact us."

[0834] Step 7:

[0835] Server: The server generates a response and sends it to the device.

[0836] Step 8:

[0837] Terminal: The terminal displays the answer received from the server to the user, who then views the provided information.

[0838] Work-life balance and stress management advice

[0839] Step 1:

[0840] User: The user uses the device interface to input a question about work-life balance or stress management, for example, "What are some effective time management techniques?"

[0841] Step 2:

[0842] Terminal: The terminal sends the user's question in text format to the server. If necessary, the input data is converted to JSON format.

[0843] Step 3:

[0844] Server: The server passes the data received from the device to the emotion engine and recognizes the user's emotion. For example, it recognizes that the user is feeling stressed.

[0845] Step 4:

[0846] Server: The server passes the recognized emotion data to a natural language processing engine, which analyzes the question. Through the analysis, it determines that the user is asking about "time management methods."

[0847] Step 5:

[0848] Server: Based on the analysis results, the server searches for resources and information related to work-life balance and stress management from databases and external APIs, such as time management tools and relaxation techniques.

[0849] Step 6:

[0850] Server: The server generates specific advice for the user based on the search results. For example, it generates an answer such as, "We recommend ____ as a tool for effective time management. Please also use techniques to reduce stress."

[0851] Step 7:

[0852] Server: The server sends the generated advice to the terminal.

[0853] Step 8:

[0854] Terminal: The terminal displays the advice received from the server to the user, who can then put the suggested tools and methods into practice.

[0855] Through these processing steps, the system provides appropriate resources and advice in response to user feedback and questions, and responds in accordance with the user's emotions, thereby improving employee satisfaction and engagement. In this way, the system of the present invention can also contribute to improving employee stress management and work-life balance.

[0856] Example 2

[0857] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0858] Conventional systems lacked the processing power to provide appropriate resources and information in response to user input, and were particularly unable to respond in a way that took the user's emotions into consideration. Furthermore, responses to user feedback and questions were uniform, making it difficult to respond flexibly to improve user satisfaction. Advice and support regarding work-life balance and stress management were also limited, preventing them from contributing to overall improvements in employee satisfaction and engagement.

[0859] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for accepting user input, means for recognizing the user's emotion, means for optimizing a response using the emotion recognition result, means for passing the input data to a natural language processing engine for analysis, means for searching for appropriate resources and information based on the analysis result and the emotion recognition result, means for generating a response to the user based on the search result, and means for providing the generated response to the user. This enables flexible and optimal responses that take the user's emotion into consideration, thereby significantly improving user satisfaction and engagement.

[0860] A "user" is an individual or organization that utilizes the system to enter feedback and questions and obtain answers and information.

[0861] "Means for accepting input" refers to an interface or module for inputting text data or questions from the user into the system.

[0862] "Means of analysis" refers to the processes and modules used to process received text data and understand and comprehend its contents.

[0863] An "emotion recognition means" is an engine or algorithm that analyzes input text data and identifies the emotion being expressed by the user.

[0864] The "means for optimizing responses" refers to a process or module that generates appropriate answers or suggestions based on the recognized emotions and provides optimal information to the user.

[0865] A "natural language processing engine" is a technology or algorithm that analyzes input text data and understands its meaning.

[0866] "Means for retrieving resources and information" refers to processes or modules for locating relevant information and resources from databases or external sources based on the analysis results.

[0867] "Means for generating answers" refers to processes or modules for creating specific answers or suggestions to provide to users based on search results and analysis content.

[0868] The "means for providing" refers to an interface or function for displaying the generated answers or suggestions to the user and enabling the user to use them.

[0869] "Flexible response" is the ability to individually tailor and provide the optimal response based on the user's individual needs and emotions.

[0870] This invention is a system that accepts feedback, requests, questions, etc. from users and provides appropriate answers and resources using a natural language processing engine and an emotion recognition engine. In particular, it has the function of recognizing the user's emotions and optimizing responses based on those emotions.

[0871] The system mainly uses the following hardware and software:

[0872] 1. User device: A device used by a user to input text data, such as a PC, smartphone, or tablet.

[0873] 2. Server: A computer system that receives, analyzes, and processes data.

[0874] 3. Natural language processing engine (e.g. ChatGPT): Software that analyzes text data entered by users and understands its meaning.

[0875] 4. Emotion recognition engine (e.g., Affectiva): Software that recognizes user emotions from text data.

[0876] 5. Database: An information system for storing relevant resources and information for user feedback, requests and questions.

[0877] The invention is implemented in the following steps:

[0878] 1. User provides text input: The user uses the device interface to enter feedback, requests, or questions in text format, for example, "I need a new project management tool."

[0879] 2. Sending input data: The terminal converts the input data into JSON format and sends it to the server.

[0880] 3. Emotion Recognition: The server receives the input data and first passes it to the emotion recognition engine, which analyzes the emotions in the text and recognizes emotions such as anger, anxiety, and joy.

[0881] 4. Natural Language Analysis: The server then sends the data to a natural language processing engine for content analysis. The engine understands the intent of the input and prepares an appropriate response.

[0882] 5. Search for related information: Based on the analysis results, the server searches for related resources and information from databases and external APIs, for example, gathering information about a new project management tool.

[0883] 6. Answer Generation: The server generates the best answer for the user based on the search results. For example, it generates a sentence like, "We recommend XX as a new project management tool. Also, please let us know if you have any other complaints."

[0884] 7. Displaying the Answer: The terminal displays the answer received from the server to the user, who can view it and provide feedback.

[0885] A distinctive feature of this system is its emotion recognition function. By understanding the user's emotions, it can provide more appropriate and empathetic responses. For example, if a user writes "I'd like information about career paths" with a sense of anxiety, the server will recognize that anxiety and generate a response with an empathetic comment such as "If you have any concerns, please feel free to contact us."

[0886] As a concrete example, if a user types "Please tell me effective time management methods," this data is sent from the device to the server. The server uses an emotion recognition engine to recognize the user's sense of stress, and then analyzes the content using a natural language processing engine. As a result, it generates a response such as "We recommend ____ as a tool for effective time management. Please also use techniques for stress reduction," and displays it on the device.

[0887] Example prompt sentence:

[0888] User: What are some effective time management techniques?

[0889] In this way, the invention can provide flexible and optimal responses according to the user's emotions, significantly improving user satisfaction and engagement.

[0890] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0891] Step 1:

[0892] User: Through a terminal interface, users input feedback, requests, and questions. This input is typically in text format and includes prompts such as "I need a new project management tool."

[0893] Input: Text data

[0894] Output: Text data captured on the user's terminal

[0895] Step 2:

[0896] Terminal: The terminal receives the text data entered by the user and sends it to the server, where it is converted to JSON format and sent to the server as an HTTPS request.

[0897] Specific behavior: Converts text data into JSON format and constructs and sends an HTTPS request.

[0898] Input: Text data entered by the user

[0899] Output: JSON format data is sent to the server

[0900] Step 3:

[0901] Server: The server passes the JSON data received from the device to the emotion recognition engine. In this process, the text data is analyzed to recognize the user's emotions (e.g., anger, joy, anxiety, etc.).

[0902] Specific operation: Pass the data to the emotion recognition engine and perform emotion analysis.

[0903] Input: JSON format text data

[0904] Output: User emotion data (e.g. anger, anxiety, joy)

[0905] Step 4:

[0906] Server: The server sends the text data along with the recognized emotion data to a natural language processing engine, which analyzes the text data and understands the intent of the specific request or question.

[0907] Specific operation: Pass the data to a natural language processing engine and analyze the content.

[0908] Input: Emotion data and text data

[0909] Output: The parsed request or question intent

[0910] Step 5:

[0911] Server: Based on the analysis results, it searches for relevant information from databases and external APIs, for example, finding information and links about new project management tools.

[0912] Specific Actions: Execute SQL queries to perform database searches or send REST API requests to external services.

[0913] Input: Parsed request or question intent

[0914] Output: Search results (related resources and information)

[0915] Step 6:

[0916] Server: Generates the best answer for the user based on the search results. The generated answer is built using a template engine, etc. For example, it might create an answer like, "We recommend XX as a new project management tool. Also, please let us know if you have any other complaints."

[0917] What it does: Uses a template engine to build answers based on search results.

[0918] Input: Search result data

[0919] Output: Text of the reply to the user

[0920] Step 7:

[0921] Terminal: The terminal displays the answers received from the server to the user, allowing the user to review suggestions and information and take useful actions.

[0922] Specific behavior: Receives text data from the server and displays it in the user interface.

[0923] Input: Response text from the server

[0924] Output: Answer displayed on the user's terminal

[0925] (Application example 2)

[0926] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0927] Conventional customer support systems in brick-and-mortar stores have struggled to respond quickly and appropriately to feedback and requests. They also lack the ability to respond in a way that takes into account customer emotions, recommend optimal products according to the situation, or provide special offers. This has created challenges in improving customer satisfaction and the in-store shopping experience.

[0928] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for accepting input from a user, means for analyzing the accepted input, means for searching for appropriate resources or information based on the analysis results, means for generating a response to the user based on the search results, means for performing emotion analysis and optimizing the response based on the user's emotions, and means for providing the generated response to the user. This enables faster and more optimized customer service in physical stores, flexible responses according to customer emotions, and the provision of recommended information and special offers.

[0929] "Means for accepting user input" refers to an interface through which user-provided information or feedback can be entered into the system.

[0930] The "means for analyzing accepted input" refers to a function for analyzing input data from a user and performing processing to understand its contents.

[0931] "Means for searching for appropriate resources and information based on the analysis results" refers to the function of identifying related information and resources from the analyzed content and searching them from databases or external systems.

[0932] "Means for generating a response to the user based on the search results" refers to a function that generates a specific response to the user based on the searched resources or information.

[0933] "Means for performing sentiment analysis and optimizing responses based on the user's emotions" refers to a function that analyzes emotions from the user's words and expressions and constructs an optimal response based on those emotions.

[0934] "Means for providing the generated answer to the user" refers to means for notifying the user of the answer generated by the system.

[0935] A "natural language processing engine" refers to technology for understanding text data and analyzing its meaning and intent.

[0936] "Means for searching for information on specific products and generating suggestions" refers to a function for searching for information on specific products based on the analysis results and making suggestions to the user.

[0937] "Means for generating and providing specific discount information and coupons in physical stores based on user feedback and requests" refers to the function of creating discount information and coupons in physical stores based on feedback and requests from online users and providing them to users.

[0938] In the system realizing this invention, the user, the terminal, and the server work in cooperation with each other. Specific implementation means are shown below.

[0939] First, the user uses the smartphone application "Smart Shop Assistant." This application provides an interface for inputting feedback and requests from the user. For example, the user inputs a request such as "Do you have this product in other colors?" This input is sent to the server in text format by the device.

[0940] The server then analyzes the received input using an emotion analysis engine (e.g., Microsoft Azure Emotion API) to recognize the user's emotions. For example, it determines whether the user's request is positive or negative. The analysis results are then passed to a natural language processing engine (e.g., OpenAI's ChatGPT), which analyzes the specific content of the request. Based on these results, related product information and resources are searched for in a database or external API.

[0941] Based on the search results, the server generates a response to the user. It also takes into account the results of sentiment analysis, and if the user is dissatisfied, for example, it generates a response that includes an apology. Specifically, it generates a response such as, "This product is available in blue and red. Please let us know if you have any complaints."

[0942] It can also provide in-store rewards: for example, if a user shows a high interest in a particular product, the system can generate special coupons or discount information and provide it to the user.

[0943] Finally, the generated answers and suggestions are sent to the user via a smartphone application, allowing the user to receive relevant information and suggestions and improve their shopping experience in physical stores.

[0944] For example, the following prompt is sent to the generative AI model:

[0945] "The user is asking if you have a dress in size medium. The sentiment is neutral. Please generate an answer with product recommendations."

[0946] In this way, the system will enable faster and more optimized customer service in physical stores, flexible responses based on customer sentiment, and the provision of recommended information and special offers.

[0947] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0948] Step 1:

[0949] Users use a smartphone application to input feedback and requests. For example, they might input a request such as, "Do you have this product in other colors?" The input data is sent to the device in text format.

[0950] Step 2:

[0951] The terminal converts the input data from the user into JSON format and sends it to the server. For example, the input text "Do you have this product in other colors?" is converted into JSON format.

[0952] Step 3:

[0953] The server first passes the received input data to a sentiment analysis engine to recognize the user's sentiment. For example, it analyzes text data and recognizes that the user is expressing a neutral sentiment.

[0954] Step 4:

[0955] Based on the results of the sentiment analysis, the server passes the data to a natural language processing engine (e.g., ChatGPT) for analysis. For example, the question "Do you have this product in other colors?" is analyzed and it is determined that product information needs to be searched.

[0956] Step 5:

[0957] The server searches for related product information from a database or external API based on the analysis results of the natural language processing engine. For example, it searches the product database for "Whether or not there are products in different colors" and finds that there are blue and red colors.

[0958] Step 6:

[0959] The server generates a response to the user based on the search results, taking into account the results of sentiment analysis. For example, it generates a response such as, "This product is available in blue and red. Please let us know if you have any complaints."

[0960] Step 7:

[0961] The device displays the answer received from the server to the user. The user can check the generated answer through the smartphone application. For example, information such as "This product is available in blue and red" may be displayed.

[0962] Step 8:

[0963] In the case of specific rewards, specific discount information and coupons can be generated and provided based on user feedback and requests. For example, special coupons can be generated for products that users show a high interest in and provided through the application.

[0964] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0965] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0966] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0967] [Third embodiment]

[0968] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0969] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0970] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0971] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0972] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0973] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0974] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0975] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0976] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0977] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0978] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0979] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0980] The present invention relates to a system that uses a natural language processing engine such as ChatGPT to accept feedback, requests, questions, etc. from users and provides appropriate answers and resources in response.

[0981] Accepting feedback and requests

[0982] User:

[0983] Users enter their feedback and requests through the device interface, for example, "I need a new project management tool."

[0984] Device:

[0985] The terminal sends the user's input in text format to the server. Specifically, the input data is converted to JSON format as needed and sent to the server as an HTTP request.

[0986] server:

[0987] The server passes the input data received from the device to a natural language processing engine (e.g., ChatGPT) for analysis. Based on the analysis results, it searches for appropriate resources and information from a database or external API. For example, it searches for information about a new project management tool.

[0988] The server generates an answer based on the search results and sends the answer to the device. For example, it generates an answer in the form of "We recommend XX as a new project management tool."

[0989] Device:

[0990] The terminal displays the answer received from the server to the user, who can then confirm the proposed content.

[0991] Providing necessary information and resources

[0992] User:

[0993] The user inputs a question about career paths and training materials into the terminal, for example, "I would like information about career paths."

[0994] Device:

[0995] The terminal transmits the user's question in text format to the server.

[0996] server:

[0997] The server analyzes the questions received from the device and searches a database for relevant resources and information related to the career path, such as career development programs and training materials within the organization.

[0998] Based on the search results, the server generates a response such as "For information about career paths, please refer to the link below" and sends it to the terminal.

[0999] Device:

[1000] The terminal displays the response received from the server to the user, who can then view the provided information.

[1001] Work-life balance and stress management advice

[1002] User:

[1003] The user inputs a question about work-life balance or stress management into the terminal, for example, "Please tell me effective time management methods."

[1004] Device:

[1005] The terminal transmits the user's question in text format to the server.

[1006] server:

[1007] The server analyzes the questions received from the device and searches a database for materials and tools related to time management and stress management, such as information on effective time management tools and relaxation techniques.

[1008] Based on the search results, the server generates a response such as "Please use XX as a tool for effective time management" and sends it to the device.

[1009] Device:

[1010] The device displays the answers received from the server to the user, who can then use the advice and tools provided to improve their work-life balance and manage stress.

[1011] Specific examples

[1012] Examples of feedback and requests:

[1013] The user types "I want a new project management tool" into the terminal. The terminal sends this input to the server. The server analyzes the input and recognizes that it means "to introduce a new tool." The server searches its database for information on an appropriate project management tool. The server generates a response saying "We propose introducing XX as a new project management tool" and sends it to the terminal. The terminal displays the response to the user.

[1014] Examples of providing information and resources include:

[1015] The user types "Tell me about career paths" into the terminal. The terminal sends this input to the server. The server analyzes the data and recognizes that "information about career paths" is being requested. The server searches the database for information about career development programs. The server generates a response saying "You can find information about career paths by clicking the link below" and sends it to the terminal. The terminal displays the response to the user.

[1016] Examples of work-life balance and stress management:

[1017] The user types "Please tell me effective time management methods" into the device. The device sends this input to the server. The server analyzes the data and recognizes that it is a "question about time management methods." The server searches a database for information and tools related to time management. The server generates an answer such as "I recommend ____ as a tool for effective time management," and sends it to the device. The device displays the answer to the user.

[1018] As described above, the system of the present invention can respond quickly and appropriately to feedback, requests, and questions from users, thereby improving employee satisfaction and engagement.

[1019] The processing flow will be explained below.

[1020] Accepting feedback and requests

[1021] Step 1:

[1022] User: The user uses the device interface to enter feedback and requests, for example, "I need a new project management tool."

[1023] Step 2:

[1024] Terminal: The terminal sends the feedback and requests entered by the user in text format to the server. If necessary, the input data is converted to JSON format.

[1025] Step 3:

[1026] Server: The server passes the data received from the device to a natural language processing engine (e.g., ChatGPT) for analysis. For example, it may interpret the data as a request for a new tool.

[1027] Step 4:

[1028] Server: Based on the analysis results, the server searches for relevant resources and information from databases or external APIs, for example, searching for information about available project management tools.

[1029] Step 5:

[1030] Server: The server generates specific suggestions and answers for the user based on the search results. For example, it generates an answer such as "We recommend XX as a new project management tool."

[1031] Step 6:

[1032] Server: The server generates a response and sends it to the device.

[1033] Step 7:

[1034] Terminal: The terminal displays the answer received from the server to the user, who then confirms the proposal.

[1035] Providing necessary information and resources

[1036] Step 1:

[1037] User: The user uses the device interface to input a question or concern, for example, "I would like information about career paths."

[1038] Step 2:

[1039] Terminal: The terminal sends user questions and concerns in text format to the server. If necessary, the input data is converted to JSON format.

[1040] Step 3:

[1041] Server: The server passes the data received from the device to a natural language processing engine (e.g., ChatGPT) and analyzes the question or inquiry. For example, it may analyze it as a question asking for information about career paths.

[1042] Step 4:

[1043] Server: Based on the analysis results, the server searches for appropriate resources and information from databases or external APIs, for example, career development programs or training materials.

[1044] Step 5:

[1045] Server: The server generates a specific answer for the user based on the search results, for example, "You can find information about career paths by clicking on the link below."

[1046] Step 6:

[1047] Server: The server generates a response and sends it to the device.

[1048] Step 7:

[1049] Terminal: The terminal displays the answer received from the server to the user, who then views the provided information.

[1050] Work-life balance and stress management advice

[1051] Step 1:

[1052] User: The user uses the device interface to input a question about work-life balance or stress management, for example, "What are some effective time management techniques?"

[1053] Step 2:

[1054] Terminal: The terminal sends the user's question in text format to the server. If necessary, the input data is converted to JSON format.

[1055] Step 3:

[1056] Server: The server passes the data received from the device to a natural language processing engine (e.g., ChatGPT) and analyzes the question. For example, it may analyze it as a question about "time management methods."

[1057] Step 4:

[1058] Server: Based on the analysis results, the server searches for resources and information related to work-life balance and stress management from databases and external APIs, such as time management tools and relaxation techniques.

[1059] Step 5:

[1060] Server: The server generates specific advice for the user based on the search results, for example, "We recommend ____ as a tool for effective time management."

[1061] Step 6:

[1062] Server: The server sends the generated advice to the terminal.

[1063] Step 7:

[1064] Terminal: The terminal displays the advice received from the server to the user, who can then put the suggested tools and methods into practice.

[1065] Through these processing steps, the system provides appropriate resources and advice in response to feedback and questions from users. In this way, the system of the present invention can improve employee satisfaction and engagement.

[1066] Example 1

[1067] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1068] With the previous system, it was difficult to respond quickly and appropriately to feedback, requests, and questions from users, and it was not flexible enough to accommodate individual consultations on career paths, stress management, etc. This created challenges in improving employee satisfaction and engagement.

[1069] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1070] In this invention, the server includes means for generating responses to user feedback and requests, means for providing information and resources for questions about career paths and training materials, and means for providing advice on work-life balance and stress management, thereby enabling a rapid and appropriate response to a variety of user inputs.

[1071] "User" refers to a person who uses the system to input feedback, requests, questions, etc.

[1072] "Terminal" refers to the device or software through which the user enters input and displays responses from the server.

[1073] "Server" refers to a device or software that analyzes data received from a terminal, searches for and generates appropriate resources and information, and sends them to the terminal.

[1074] A "natural language processing engine" refers to a computer model or algorithm that analyzes a user's text input, understands its meaning, and derives appropriate results.

[1075] "JSON format" is an abbreviation for JavaScript Object Notation, and refers to a data format for structuring and representing text data.

[1076] An "HTTP request" refers to a request message based on a network protocol for transmitting data from a client to a server.

[1077] "Database" refers to a system for storing and managing structured data.

[1078] An "external API" refers to an interface for communicating with external applications and services to access data and functions.

[1079] "Answer" refers to information or resources generated by the server in response to input from the user.

[1080] "Feedback" refers to the opinions and thoughts that users give to the system.

[1081] A "request" refers to a user's request for a desired function or service from the system.

[1082] "Career path" refers to the plan or path of the job or role that the user aims to take on in the future.

[1083] "Training Materials" refers to educational content and documents used by Users to improve their skills and gain knowledge.

[1084] "Work-life balance" refers to the appropriate allocation of work and private time and activities.

[1085] "Stress management" refers to methods and approaches for reducing mental strain and tension.

[1086] This invention relates to a system that accepts feedback, requests, and questions from users and provides appropriate answers and resources accordingly. This system consists of three main components: a server, a terminal, and a user.

[1087] Hardware and Software Configuration

[1088] server:

[1089] The server receives data sent by users, analyzes the data using a natural language processing engine (e.g., ChatGPT), searches for appropriate information and resources using databases and external APIs, and provides the generated answers to users. The server's main software components include an API server and a database server (e.g., MySQL, PostgreSQL).

[1090] Device:

[1091] The device is responsible for receiving user input and sending it to the server. It converts the user input into JSON format and sends it to the server using an HTTP request. The device can be a web browser or a mobile application that uses HTML, CSS, JavaScript, etc.

[1092] User:

[1093] A user is a person who enters feedback, requests, and questions through the system.

[1094] Program processing

[1095] On the device:

[1096] The user uses the device's interface to input feedback or requests, such as "I need a new project management tool." The device receives this input in text format and converts it to JSON, which is then sent to the server as an HTTP request.

[1097] Server side:

[1098] The server analyzes the user's input received from the device by passing it to a natural language processing engine (e.g., ChatGPT). Based on the analysis results, it searches for appropriate resources and information. For example, it searches a database or external API for information about a new project management tool. Based on the search results, it generates a response such as "We recommend XX as your new project management tool," and sends this to the device.

[1099] Terminal side (redisplay):

[1100] The device displays the response received from the server to the user, who can then review the suggestions and take action based on them, such as trying out the proposed project management tool.

[1101] Specific examples

[1102] Examples of feedback and requests:

[1103] The user types "I want a new project management tool" into the device. The device sends this input to the server. The server analyzes the input and recognizes that it means "introducing a new tool." The server searches its database for information on an appropriate project management tool, generates a response saying "We propose introducing XX as your new project management tool," and sends it to the device. The device then displays the response to the user.

[1104] Example prompt sentence:

[1105] If the user's input is a request for a new project management tool, the corresponding prompt statement would be "This user wants a new project management tool."

[1106] This allows for quick and appropriate responses to a variety of user input. The system can improve employee satisfaction and engagement through flexible provision of information and advice.

[1107] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1108] Step 1:

[1109] User input

[1110] The user enters their feedback or request into the terminal interface, for example, "I need a new project management tool." This is the starting point of the process, and the user's input triggers the behavior of the entire system.

[1111] Specific behavior:

[1112] The user enters a request into the form on the browser and clicks the "Submit" button.

[1113] Input: Text data entered by the user

[1114] Output: Data entered by the user

[1115] Step 2:

[1116] Terminal prepares to send data

[1117] The terminal receives the user's input data in text format and converts it into JSON format.

[1118] Specific behavior:

[1119] The device converts the text "I need a new project management tool" received from the user into the JSON format {"request": "I need a new project management tool"}.

[1120] Input: User's text data

[1121] Output: Data converted to JSON format

[1122] Step 3:

[1123] Sending from the device to the server

[1124] The terminal sends the data converted into JSON format to the server as an HTTP request.

[1125] Specific behavior:

[1126] The JSON data generated by the terminal is sent to the server as a POST request. The URL used is https: / / example.com / api as an example.

[1127] Input: JSON format data

[1128] Output: Data sent to the server as an HTTP request

[1129] Step 4:

[1130] Data reception by the server and preparation for analysis

[1131] The server receives the data sent from the device and prepares it to be passed to a natural language processing engine such as ChatGPT.

[1132] Specific behavior:

[1133] The server receives the HTTP request and checks the header information and metadata.

[1134] Input: Data sent by the HTTP request

[1135] Output: Analysis-ready data

[1136] Step 5:

[1137] Analysis using a natural language processing engine

[1138] The server passes the received data to a natural language processing engine for analysis, and searches for appropriate resources and information based on the analysis results.

[1139] Specific behavior:

[1140] The server sends a prompt to the ChatGPT API saying "This user wants a new project management tool" and retrieves the analysis results.

[1141] Input: Data ready for analysis

[1142] Output: Analysis results

[1143] Step 6:

[1144] Finding resources and information

[1145] The server searches for appropriate resources or information from a database or external API based on the analysis results.

[1146] Specific behavior:

[1147] The server queries the database to get information about the "new project management tool," for example using a SQL query such as SELECT FROM tools WHERE category='project_management';

[1148] Input: Analysis results

[1149] Output: Resources and information as search results

[1150] Step 7:

[1151] Generate answers

[1152] The server generates an answer for the user based on the search results.

[1153] Specific behavior:

[1154] The server generates a response based on the search results using a template, such as "We recommend XX as a new project management tool."

[1155] Input: Resources and information as search results

[1156] Output: The generated answer

[1157] Step 8:

[1158] Transmission from the server to the device

[1159] The server sends the generated response to the terminal.

[1160] Specific behavior:

[1161] The server returns the generated answer to the terminal as an HTTP response. The URL used as an example is https: / / example.com / api.

[1162] Input: Generated answer

[1163] Output: Data sent to the device as an HTTP response

[1164] Step 9:

[1165] Displaying answers on the device

[1166] The terminal displays the response received from the server to the user.

[1167] Specific behavior:

[1168] The terminal displays the received response on the browser, and the user confirms it. For example, the response message is displayed in a modal window.

[1169] Input: Data sent as an HTTP response

[1170] Output: The answer displayed to the user

[1171] (Application example 1)

[1172] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1173] Security information evolves daily, making it difficult for users to instantly access the latest security information and countermeasures. There is also a need to provide prompt and appropriate responses to security-related questions and feedback. However, current systems make it difficult to respond in real time, potentially increasing security risks.

[1174] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1175] In this invention, the server includes a means for accepting input from a user, a means for analyzing the accepted input, and a means for searching for appropriate resources and information based on the analysis results. This makes it possible to provide quick and optimal answers to security-related questions and feedback using a natural language processing engine. Furthermore, by using a generative AI model, it is possible to provide advice based on the latest security information, thereby reducing the security risks for users.

[1176] The "means for accepting input from the user" is an interface through which the user can enter security questions and feedback.

[1177] The "means for analyzing received input" is a system that analyzes input received from a user using a natural language processing engine or the like.

[1178] "Means for searching for appropriate resources and information based on the analysis results" refers to a function that searches for appropriate security information and countermeasures from a database or external system based on the analyzed input.

[1179] The "means for generating a response to the user based on the search results" is a function for generating a response to be provided to the user based on the searched information.

[1180] The "means for providing the generated answer to the user" is an interface for displaying or notifying the generated answer to the user.

[1181] The "means for accepting security-related questions and feedback" is an interface for accepting security-related questions and feedback from users.

[1182] The "means for analyzing received security-related input and generating optimal answers" is a system that analyzes security-related input using a natural language processing engine and generates optimal answers based on the analysis results.

[1183] "Means for generating optimal answers using a generative AI model" is a function that uses a generated AI model (e.g., ChatGPT) to generate optimal answers to user questions.

[1184] The "means for providing advice regarding work-life balance and stress management" is a function that provides appropriate advice in response to questions about work-life balance and stress management from the user.

[1185] The "means for providing security advice" is a function that provides specific advice and countermeasures in response to security-related questions from users.

[1186] MODE FOR CARRYING OUT THE INVENTION

[1187] This invention provides a system that provides prompt and optimal answers to security-related questions and feedback. This system consists of three main elements: a user, a terminal, and a server. The specific roles and processing procedures of each element are described below.

[1188] User

[1189] Users input security questions and feedback using devices such as smartphones, which are generally entered in text format.

[1190] Examples:

[1191] The user uses their smartphone to type, "What are some signs of unauthorized logins recently?"

[1192] Terminal

[1193] The terminal is equipped with an interface that accepts text data entered by the user and sends it to the server. The text data is converted into JSON format and sent to the server as an HTTP request.

[1194] server

[1195] The server analyzes the received data using a natural language processing engine. This invention uses OpenAI's generative AI model (e.g., ChatGPT). Based on the analysis results, it searches a database or external system for appropriate security information and countermeasures, and generates the optimal answer. The generated answer is then sent to the device.

[1196] Examples:

[1197] Example prompt sentence:

[1198] User Question: What are the signs of unauthorized logins recently?

[1199] Please provide the best security answer.

[1200] The server parses this prompt and generates an appropriate response: "Signs of unauthorized logins include a sudden password change or frequent logins from unusual locations. Other signs include an increase in security alerts from your device."

[1201] Terminal

[1202] The terminal that receives the generated answer displays it to the user, allowing the user to instantly obtain appropriate security information and advice.

[1203] This system allows users to receive fast and accurate answers to their real-time security questions and feedback, significantly reducing security risks and improving user peace of mind.

[1204] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1205] Step 1:

[1206] Users use their smartphones to enter security questions and feedback, and the entered text data is sent to the user's device.

[1207] Input: Security-related text entered by the user (e.g., "What are some signs of recent unauthorized login attempts?").

[1208] Output: Text data is captured to the terminal.

[1209] Step 2:

[1210] The device converts the received text data into JSON format and sends it to the server using an HTTP POST request. The conversion process and request transmission are performed within the device.

[1211] Input: Text data entered by the user.

[1212] Data processing: Convert text data into JSON format.

[1213] Output: JSON formatted data is sent to the server.

[1214] Step 3:

[1215] The server parses the received JSON data and converts it to text format, which is then passed as input to a generative AI model (e.g., ChatGPT) for analysis.

[1216] Input: JSON formatted data.

[1217] Data processing: Convert JSON format data into text format.

[1218] Data computation: Perform analysis using generative AI models.

[1219] Output: Analysis results from the generative AI model.

[1220] Step 4:

[1221] Based on the analysis results obtained from the generative AI model, the server searches a database for appropriate security information and countermeasures, and generates the optimal answer.

[1222] Input: Analysis results from the generative AI model.

[1223] Data calculation: Based on the analysis results, appropriate information is searched for in the database and an answer is generated.

[1224] Output: The generated textual answer.

[1225] Step 5:

[1226] The server converts the generated response into JSON format and sends it back to the terminal as an HTTP response. The conversion process and response transmission are performed within the server.

[1227] Input: A textual answer.

[1228] Data processing: Convert text responses into JSON format.

[1229] Output: JSON formatted data is sent to the terminal.

[1230] Step 6:

[1231] The device parses the JSON data received from the server and displays it to the user as a text response. The parsing and display are performed within the device.

[1232] Input: JSON format data received from the server.

[1233] Data processing: Convert JSON format data into text format.

[1234] Output: The textual response is displayed.

[1235] In this way, users can get fast and relevant answers to their security questions and feedback.

[1236] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1237] This invention relates to a system that uses a natural language processing engine such as ChatGPT and an emotion engine to accept feedback, requests, questions, etc. from users and provide appropriate answers and resources accordingly. In particular, it has the function of recognizing the user's emotions and optimizing responses based on those emotions.

[1238] Accepting feedback and requests

[1239] User:

[1240] Users use the device interface to enter their feedback and requests, for example, "I need a new project management tool."

[1241] Device:

[1242] The terminal sends the user's input in text format to the server, which converts the input data to JSON format if necessary.

[1243] server:

[1244] The server first passes the input data received from the device to an emotion engine to recognize the user's emotions. For example, it recognizes that the user is expressing anger along with the request "I need a new tool." It then passes the data to a natural language processing engine (e.g., ChatGPT) to analyze the content.

[1245] Based on the analysis and emotion recognition results, the server searches for relevant resources and information from databases and external APIs, for example, searching for information about available project management tools.

[1246] server:

[1247] The server generates specific suggestions and answers for the user based on the search results, such as "We recommend XX as a new project management tool. Also, please let us know if you have any complaints."

[1248] Device:

[1249] The terminal displays the answer received from the server to the user, who then confirms the proposal.

[1250] Providing necessary information and resources

[1251] User:

[1252] Users enter questions about career paths and training materials into the terminal, for example, "I would like information about career paths."

[1253] Device:

[1254] The terminal transmits the user's question in text format to the server.

[1255] server:

[1256] The server passes the question received from the device to the emotion engine, which recognizes the user's emotion. For example, it recognizes that the user is expressing anxiety. It then passes the question to the natural language processing engine, which analyzes the content of the question.

[1257] Based on the analysis results, search for appropriate resources and information from databases or external APIs, for example, search for information on career development programs and training materials.

[1258] server:

[1259] The server generates a specific response to the user based on the search results, such as "You can find information about career paths by clicking the link below. If you have any concerns, please feel free to contact us."

[1260] Device:

[1261] The terminal displays the response received from the server to the user, who then views the provided information.

[1262] Work-life balance and stress management advice

[1263] User:

[1264] Users input questions about work-life balance and stress management into the device, for example, "Please tell me effective time management methods."

[1265] Device:

[1266] The terminal transmits the user's question in text format to the server.

[1267] server:

[1268] The server passes the question received from the device to the emotion engine, which recognizes the user's emotions. For example, it recognizes that the user is feeling stressed. The server then passes the data to the natural language processing engine, which analyzes the content.

[1269] Based on the analysis results, resources and information related to work-life balance and stress management are searched from databases and external APIs, for example, information on time management tools and relaxation techniques.

[1270] server:

[1271] The server generates specific advice for the user based on the search results, such as "We recommend ____ as a tool for effective time management. Please also use techniques to reduce stress."

[1272] Device:

[1273] The device displays the advice received from the server to the user, who can then put the suggested tools and methods into practice.

[1274] Through these processing steps, the system provides appropriate resources and advice in response to user feedback and questions, and responds in accordance with the user's emotions, thereby improving employee satisfaction and engagement. In this way, the system of the present invention can also contribute to improving employee stress management and work-life balance.

[1275] The processing flow will be explained below.

[1276] Accepting feedback and requests

[1277] Step 1:

[1278] User: The user uses the device interface to enter feedback and requests, for example, "I need a new project management tool."

[1279] Step 2:

[1280] Terminal: The terminal sends the feedback and requests entered by the user in text format to the server. If necessary, the input data is converted to JSON format.

[1281] Step 3:

[1282] Server: The server passes the data received from the device to the emotion engine and recognizes the user's emotion. For example, it recognizes that the user is expressing anger along with the request "I need a new tool."

[1283] Step 4:

[1284] Server: The server passes the recognized emotion data to a natural language processing engine (e.g., ChatGPT) for content analysis. The analysis determines that the user wants to "introduce a new tool."

[1285] Step 5:

[1286] Server: Based on the analysis and emotion recognition results, the server searches for relevant resources and information from databases and external APIs, for example, searching for information about available project management tools.

[1287] Step 6:

[1288] Server: The server generates specific suggestions and answers for the user based on the search results. For example, it generates an answer such as, "We recommend XX as a new project management tool. Also, please let us know if you have any complaints."

[1289] Step 7:

[1290] Server: The server generates a response and sends it to the device.

[1291] Step 8:

[1292] Terminal: The terminal displays the answer received from the server to the user, who then confirms the proposal.

[1293] Providing necessary information and resources

[1294] Step 1:

[1295] User: The user uses the device interface to input a question or concern, for example, "I would like information about career paths."

[1296] Step 2:

[1297] Terminal: The terminal sends user questions and concerns in text format to the server. If necessary, the input data is converted to JSON format.

[1298] Step 3:

[1299] Server: The server passes the data received from the device to the emotion engine and recognizes the user's emotion. For example, it recognizes that the user is expressing anxiety.

[1300] Step 4:

[1301] Server: The server passes the recognized emotion data to a natural language processing engine, which analyzes the question. Through this analysis, it determines that the user is looking for information about career paths.

[1302] Step 5:

[1303] Server: Based on the analysis results, the server searches for appropriate resources and information from databases or external APIs, for example, career development programs or training materials.

[1304] Step 6:

[1305] Server: The server generates a specific answer to the user based on the search results. For example, it generates an answer such as, "You can find information about career paths by clicking the link below. If you have any concerns, please feel free to contact us."

[1306] Step 7:

[1307] Server: The server generates a response and sends it to the device.

[1308] Step 8:

[1309] Terminal: The terminal displays the answer received from the server to the user, who then views the provided information.

[1310] Work-life balance and stress management advice

[1311] Step 1:

[1312] User: The user uses the device interface to input a question about work-life balance or stress management, for example, "What are some effective time management techniques?"

[1313] Step 2:

[1314] Terminal: The terminal sends the user's question in text format to the server. If necessary, the input data is converted to JSON format.

[1315] Step 3:

[1316] Server: The server passes the data received from the device to the emotion engine and recognizes the user's emotion. For example, it recognizes that the user is feeling stressed.

[1317] Step 4:

[1318] Server: The server passes the recognized emotion data to a natural language processing engine, which analyzes the question. Through the analysis, it determines that the user is asking about "time management methods."

[1319] Step 5:

[1320] Server: Based on the analysis results, the server searches for resources and information related to work-life balance and stress management from databases and external APIs, such as time management tools and relaxation techniques.

[1321] Step 6:

[1322] Server: The server generates specific advice for the user based on the search results. For example, it generates an answer such as, "We recommend ____ as a tool for effective time management. Please also use techniques to reduce stress."

[1323] Step 7:

[1324] Server: The server sends the generated advice to the terminal.

[1325] Step 8:

[1326] Terminal: The terminal displays the advice received from the server to the user, who can then put the suggested tools and methods into practice.

[1327] Through these processing steps, the system provides appropriate resources and advice in response to user feedback and questions, and responds in accordance with the user's emotions, thereby improving employee satisfaction and engagement. In this way, the system of the present invention can also contribute to improving employee stress management and work-life balance.

[1328] Example 2

[1329] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1330] Conventional systems lacked the processing power to provide appropriate resources and information in response to user input, and were particularly unable to respond in a way that took the user's emotions into consideration. Furthermore, responses to user feedback and questions were uniform, making it difficult to respond flexibly to improve user satisfaction. Advice and support regarding work-life balance and stress management were also limited, preventing them from contributing to overall improvements in employee satisfaction and engagement.

[1331] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for accepting user input, means for recognizing the user's emotion, means for optimizing a response using the emotion recognition result, means for passing the input data to a natural language processing engine for analysis, means for searching for appropriate resources and information based on the analysis result and the emotion recognition result, means for generating a response to the user based on the search result, and means for providing the generated response to the user. This enables flexible and optimal responses that take the user's emotion into consideration, thereby significantly improving user satisfaction and engagement.

[1332] A "user" is an individual or organization that utilizes the system to enter feedback and questions and obtain answers and information.

[1333] "Means for accepting input" refers to an interface or module for inputting text data or questions from the user into the system.

[1334] "Means of analysis" refers to the processes and modules used to process received text data and understand and comprehend its contents.

[1335] An "emotion recognition means" is an engine or algorithm that analyzes input text data and identifies the emotion being expressed by the user.

[1336] The "means for optimizing responses" refers to a process or module that generates appropriate answers or suggestions based on the recognized emotions and provides optimal information to the user.

[1337] A "natural language processing engine" is a technology or algorithm that analyzes input text data and understands its meaning.

[1338] "Means for retrieving resources and information" refers to processes or modules for locating relevant information and resources from databases or external sources based on the analysis results.

[1339] "Means for generating answers" refers to processes or modules for creating specific answers or suggestions to provide to users based on search results and analysis content.

[1340] The "means for providing" refers to an interface or function for displaying the generated answers or suggestions to the user and enabling the user to use them.

[1341] "Flexible response" is the ability to individually tailor and provide the optimal response based on the user's individual needs and emotions.

[1342] This invention is a system that accepts feedback, requests, questions, etc. from users and provides appropriate answers and resources using a natural language processing engine and an emotion recognition engine. In particular, it has the function of recognizing the user's emotions and optimizing responses based on those emotions.

[1343] The system mainly uses the following hardware and software:

[1344] 1. User device: A device used by a user to input text data, such as a PC, smartphone, or tablet.

[1345] 2. Server: A computer system that receives, analyzes, and processes data.

[1346] 3. Natural language processing engine (e.g. ChatGPT): Software that analyzes text data entered by users and understands its meaning.

[1347] 4. Emotion recognition engine (e.g., Affectiva): Software that recognizes user emotions from text data.

[1348] 5. Database: An information system for storing relevant resources and information for user feedback, requests and questions.

[1349] The invention is implemented in the following steps:

[1350] 1. User provides text input: The user uses the device interface to enter feedback, requests, or questions in text format, for example, "I need a new project management tool."

[1351] 2. Sending input data: The terminal converts the input data into JSON format and sends it to the server.

[1352] 3. Emotion Recognition: The server receives the input data and first passes it to the emotion recognition engine, which analyzes the emotions in the text and recognizes emotions such as anger, anxiety, and joy.

[1353] 4. Natural Language Analysis: The server then sends the data to a natural language processing engine for content analysis. The engine understands the intent of the input and prepares an appropriate response.

[1354] 5. Search for related information: Based on the analysis results, the server searches for related resources and information from databases and external APIs, for example, gathering information about a new project management tool.

[1355] 6. Answer Generation: The server generates the best answer for the user based on the search results. For example, it generates a sentence like, "We recommend XX as a new project management tool. Also, please let us know if you have any other complaints."

[1356] 7. Displaying the Answer: The terminal displays the answer received from the server to the user, who can view it and provide feedback.

[1357] A distinctive feature of this system is its emotion recognition function. By understanding the user's emotions, it can provide more appropriate and empathetic responses. For example, if a user writes "I'd like information about career paths" with a sense of anxiety, the server will recognize that anxiety and generate a response with an empathetic comment such as "If you have any concerns, please feel free to contact us."

[1358] As a concrete example, if a user types "Please tell me effective time management methods," this data is sent from the device to the server. The server uses an emotion recognition engine to recognize the user's sense of stress, and then analyzes the content using a natural language processing engine. As a result, it generates a response such as "We recommend ____ as a tool for effective time management. Please also use techniques for stress reduction," and displays it on the device.

[1359] Example prompt sentence:

[1360] User: What are some effective time management techniques?

[1361] In this way, the invention can provide flexible and optimal responses according to the user's emotions, significantly improving user satisfaction and engagement.

[1362] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1363] Step 1:

[1364] User: Through a terminal interface, users input feedback, requests, and questions. This input is typically in text format and includes prompts such as "I need a new project management tool."

[1365] Input: Text data

[1366] Output: Text data captured on the user's terminal

[1367] Step 2:

[1368] Terminal: The terminal receives the text data entered by the user and sends it to the server, where it is converted to JSON format and sent to the server as an HTTPS request.

[1369] Specific behavior: Converts text data into JSON format and constructs and sends an HTTPS request.

[1370] Input: Text data entered by the user

[1371] Output: JSON format data is sent to the server

[1372] Step 3:

[1373] Server: The server passes the JSON data received from the device to the emotion recognition engine. In this process, the text data is analyzed to recognize the user's emotions (e.g., anger, joy, anxiety, etc.).

[1374] Specific operation: Pass the data to the emotion recognition engine and perform emotion analysis.

[1375] Input: JSON format text data

[1376] Output: User emotion data (e.g. anger, anxiety, joy)

[1377] Step 4:

[1378] Server: The server sends the text data along with the recognized emotion data to a natural language processing engine, which analyzes the text data and understands the intent of the specific request or question.

[1379] Specific operation: Pass the data to a natural language processing engine and analyze the content.

[1380] Input: Emotion data and text data

[1381] Output: The parsed request or question intent

[1382] Step 5:

[1383] Server: Based on the analysis results, it searches for relevant information from databases and external APIs, for example, finding information and links about new project management tools.

[1384] Specific Actions: Execute SQL queries to perform database searches or send REST API requests to external services.

[1385] Input: Parsed request or question intent

[1386] Output: Search results (related resources and information)

[1387] Step 6:

[1388] Server: Generates the best answer for the user based on the search results. The generated answer is built using a template engine, etc. For example, it might create an answer like, "We recommend XX as a new project management tool. Also, please let us know if you have any other complaints."

[1389] What it does: Uses a template engine to build answers based on search results.

[1390] Input: Search result data

[1391] Output: Text of the reply to the user

[1392] Step 7:

[1393] Terminal: The terminal displays the answers received from the server to the user, allowing the user to review suggestions and information and take useful actions.

[1394] Specific behavior: Receives text data from the server and displays it in the user interface.

[1395] Input: Response text from the server

[1396] Output: Answer displayed on the user's terminal

[1397] (Application example 2)

[1398] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1399] Conventional customer support systems in brick-and-mortar stores have struggled to respond quickly and appropriately to feedback and requests. They also lack the ability to respond in a way that takes into account customer emotions, recommend optimal products according to the situation, or provide special offers. This has created challenges in improving customer satisfaction and the in-store shopping experience.

[1400] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for accepting input from a user, means for analyzing the accepted input, means for searching for appropriate resources or information based on the analysis results, means for generating a response to the user based on the search results, means for performing emotion analysis and optimizing the response based on the user's emotions, and means for providing the generated response to the user. This enables faster and more optimized customer service in physical stores, flexible responses according to customer emotions, and the provision of recommended information and special offers.

[1401] "Means for accepting user input" refers to an interface through which user-provided information or feedback can be entered into the system.

[1402] The "means for analyzing accepted input" refers to a function for analyzing input data from a user and performing processing to understand its contents.

[1403] "Means for searching for appropriate resources and information based on the analysis results" refers to the function of identifying related information and resources from the analyzed content and searching them from databases or external systems.

[1404] "Means for generating a response to the user based on the search results" refers to a function that generates a specific response to the user based on the searched resources or information.

[1405] "Means for performing sentiment analysis and optimizing responses based on the user's emotions" refers to a function that analyzes emotions from the user's words and expressions and constructs an optimal response based on those emotions.

[1406] "Means for providing the generated answer to the user" refers to means for notifying the user of the answer generated by the system.

[1407] A "natural language processing engine" refers to technology for understanding text data and analyzing its meaning and intent.

[1408] "Means for searching for information on specific products and generating suggestions" refers to a function for searching for information on specific products based on the analysis results and making suggestions to the user.

[1409] "Means for generating and providing specific discount information and coupons in physical stores based on user feedback and requests" refers to the function of creating discount information and coupons in physical stores based on feedback and requests from online users and providing them to users.

[1410] In the system realizing this invention, the user, the terminal, and the server work in cooperation with each other. Specific implementation means are shown below.

[1411] First, the user uses the smartphone application "Smart Shop Assistant." This application provides an interface for inputting feedback and requests from the user. For example, the user inputs a request such as "Do you have this product in other colors?" This input is sent to the server in text format by the device.

[1412] The server then analyzes the received input using an emotion analysis engine (e.g., Microsoft Azure Emotion API) to recognize the user's emotions. For example, it determines whether the user's request is positive or negative. The analysis results are then passed to a natural language processing engine (e.g., OpenAI's ChatGPT), which analyzes the specific content of the request. Based on these results, related product information and resources are searched for in a database or external API.

[1413] Based on the search results, the server generates a response to the user. It also takes into account the results of sentiment analysis, and if the user is dissatisfied, for example, it generates a response that includes an apology. Specifically, it generates a response such as, "This product is available in blue and red. Please let us know if you have any complaints."

[1414] It can also provide in-store rewards: for example, if a user shows a high interest in a particular product, the system can generate special coupons or discount information and provide it to the user.

[1415] Finally, the generated answers and suggestions are sent to the user via a smartphone application, allowing the user to receive relevant information and suggestions and improve their shopping experience in physical stores.

[1416] For example, the following prompt is sent to the generative AI model:

[1417] "The user is asking if you have a dress in size medium. The sentiment is neutral. Please generate an answer with product recommendations."

[1418] In this way, the system will enable faster and more optimized customer service in physical stores, flexible responses based on customer sentiment, and the provision of recommended information and special offers.

[1419] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1420] Step 1:

[1421] Users use a smartphone application to input feedback and requests. For example, they might input a request such as, "Do you have this product in other colors?" The input data is sent to the device in text format.

[1422] Step 2:

[1423] The terminal converts the input data from the user into JSON format and sends it to the server. For example, the input text "Do you have this product in other colors?" is converted into JSON format.

[1424] Step 3:

[1425] The server first passes the received input data to a sentiment analysis engine to recognize the user's sentiment. For example, it analyzes text data and recognizes that the user is expressing a neutral sentiment.

[1426] Step 4:

[1427] Based on the results of the sentiment analysis, the server passes the data to a natural language processing engine (e.g., ChatGPT) for analysis. For example, the question "Do you have this product in other colors?" is analyzed and it is determined that product information needs to be searched.

[1428] Step 5:

[1429] The server searches for related product information from a database or external API based on the analysis results of the natural language processing engine. For example, it searches the product database for "Whether or not there are products in different colors" and finds that there are blue and red colors.

[1430] Step 6:

[1431] The server generates a response to the user based on the search results, taking into account the results of sentiment analysis. For example, it generates a response such as, "This product is available in blue and red. Please let us know if you have any complaints."

[1432] Step 7:

[1433] The device displays the answer received from the server to the user. The user can check the generated answer through the smartphone application. For example, information such as "This product is available in blue and red" may be displayed.

[1434] Step 8:

[1435] In the case of specific rewards, specific discount information and coupons can be generated and provided based on user feedback and requests. For example, special coupons can be generated for products that users show a high interest in and provided through the application.

[1436] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1437] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1438] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1439] [Fourth embodiment]

[1440] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1441] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1442] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1443] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1444] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1445] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1446] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1447] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1448] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1449] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1450] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1451] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1452] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1453] The present invention relates to a system that uses a natural language processing engine such as ChatGPT to accept feedback, requests, questions, etc. from users and provides appropriate answers and resources in response.

[1454] Accepting feedback and requests

[1455] User:

[1456] Users enter their feedback and requests through the device interface, for example, "I need a new project management tool."

[1457] Device:

[1458] The terminal sends the user's input in text format to the server. Specifically, the input data is converted to JSON format as needed and sent to the server as an HTTP request.

[1459] server:

[1460] The server passes the input data received from the device to a natural language processing engine (e.g., ChatGPT) for analysis. Based on the analysis results, it searches for appropriate resources and information from a database or external API. For example, it searches for information about a new project management tool.

[1461] The server generates an answer based on the search results and sends the answer to the device. For example, it generates an answer in the form of "We recommend XX as a new project management tool."

[1462] Device:

[1463] The terminal displays the answer received from the server to the user, who can then confirm the proposed content.

[1464] Providing necessary information and resources

[1465] User:

[1466] The user inputs a question about career paths and training materials into the terminal, for example, "I would like information about career paths."

[1467] Device:

[1468] The terminal transmits the user's question in text format to the server.

[1469] server:

[1470] The server analyzes the questions received from the device and searches a database for relevant resources and information related to the career path, such as career development programs and training materials within the organization.

[1471] Based on the search results, the server generates a response such as "For information about career paths, please refer to the link below" and sends it to the terminal.

[1472] Device:

[1473] The terminal displays the response received from the server to the user, who can then view the provided information.

[1474] Work-life balance and stress management advice

[1475] User:

[1476] The user inputs a question about work-life balance or stress management into the terminal, for example, "Please tell me effective time management methods."

[1477] Device:

[1478] The terminal transmits the user's question in text format to the server.

[1479] server:

[1480] The server analyzes the questions received from the device and searches a database for materials and tools related to time management and stress management, such as information on effective time management tools and relaxation techniques.

[1481] Based on the search results, the server generates a response such as "Please use XX as a tool for effective time management" and sends it to the device.

[1482] Device:

[1483] The device displays the answers received from the server to the user, who can then use the advice and tools provided to improve their work-life balance and manage stress.

[1484] Specific examples

[1485] Examples of feedback and requests:

[1486] The user types "I want a new project management tool" into the terminal. The terminal sends this input to the server. The server analyzes the input and recognizes that it means "to introduce a new tool." The server searches its database for information on an appropriate project management tool. The server generates a response saying "We propose introducing XX as a new project management tool" and sends it to the terminal. The terminal displays the response to the user.

[1487] Examples of providing information and resources include:

[1488] The user types "Tell me about career paths" into the terminal. The terminal sends this input to the server. The server analyzes the data and recognizes that "information about career paths" is being requested. The server searches the database for information about career development programs. The server generates a response saying "You can find information about career paths by clicking the link below" and sends it to the terminal. The terminal displays the response to the user.

[1489] Examples of work-life balance and stress management:

[1490] The user types "Please tell me effective time management methods" into the device. The device sends this input to the server. The server analyzes the data and recognizes that it is a "question about time management methods." The server searches a database for information and tools related to time management. The server generates an answer such as "I recommend ____ as a tool for effective time management," and sends it to the device. The device displays the answer to the user.

[1491] As described above, the system of the present invention can respond quickly and appropriately to feedback, requests, and questions from users, thereby improving employee satisfaction and engagement.

[1492] The processing flow will be explained below.

[1493] Accepting feedback and requests

[1494] Step 1:

[1495] User: The user uses the device interface to enter feedback and requests, for example, "I need a new project management tool."

[1496] Step 2:

[1497] Terminal: The terminal sends the feedback and requests entered by the user in text format to the server. If necessary, the input data is converted to JSON format.

[1498] Step 3:

[1499] Server: The server passes the data received from the device to a natural language processing engine (e.g., ChatGPT) for analysis. For example, it may interpret the data as a request for a new tool.

[1500] Step 4:

[1501] Server: Based on the analysis results, the server searches for relevant resources and information from databases or external APIs, for example, searching for information about available project management tools.

[1502] Step 5:

[1503] Server: The server generates specific suggestions and answers for the user based on the search results. For example, it generates an answer such as "We recommend XX as a new project management tool."

[1504] Step 6:

[1505] Server: The server generates a response and sends it to the device.

[1506] Step 7:

[1507] Terminal: The terminal displays the answer received from the server to the user, who then confirms the proposal.

[1508] Providing necessary information and resources

[1509] Step 1:

[1510] User: The user uses the device interface to input a question or concern, for example, "I would like information about career paths."

[1511] Step 2:

[1512] Terminal: The terminal sends user questions and concerns in text format to the server. If necessary, the input data is converted to JSON format.

[1513] Step 3:

[1514] Server: The server passes the data received from the device to a natural language processing engine (e.g., ChatGPT) and analyzes the question or inquiry. For example, it may analyze it as a question asking for information about career paths.

[1515] Step 4:

[1516] Server: Based on the analysis results, the server searches for appropriate resources and information from databases or external APIs, for example, career development programs or training materials.

[1517] Step 5:

[1518] Server: The server generates a specific answer for the user based on the search results, for example, "You can find information about career paths by clicking on the link below."

[1519] Step 6:

[1520] Server: The server generates a response and sends it to the device.

[1521] Step 7:

[1522] Terminal: The terminal displays the answer received from the server to the user, who then views the provided information.

[1523] Work-life balance and stress management advice

[1524] Step 1:

[1525] User: The user uses the device interface to input a question about work-life balance or stress management, for example, "What are some effective time management techniques?"

[1526] Step 2:

[1527] Terminal: The terminal sends the user's question in text format to the server. If necessary, the input data is converted to JSON format.

[1528] Step 3:

[1529] Server: The server passes the data received from the device to a natural language processing engine (e.g., ChatGPT) and analyzes the question. For example, it may analyze it as a question about "time management methods."

[1530] Step 4:

[1531] Server: Based on the analysis results, the server searches for resources and information related to work-life balance and stress management from databases and external APIs, such as time management tools and relaxation techniques.

[1532] Step 5:

[1533] Server: The server generates specific advice for the user based on the search results, for example, "We recommend ____ as a tool for effective time management."

[1534] Step 6:

[1535] Server: The server sends the generated advice to the terminal.

[1536] Step 7:

[1537] Terminal: The terminal displays the advice received from the server to the user, who can then put the suggested tools and methods into practice.

[1538] Through these processing steps, the system provides appropriate resources and advice in response to feedback and questions from users. In this way, the system of the present invention can improve employee satisfaction and engagement.

[1539] Example 1

[1540] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1541] With the previous system, it was difficult to respond quickly and appropriately to feedback, requests, and questions from users, and it was not flexible enough to accommodate individual consultations on career paths, stress management, etc. This created challenges in improving employee satisfaction and engagement.

[1542] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1543] In this invention, the server includes means for generating responses to user feedback and requests, means for providing information and resources for questions about career paths and training materials, and means for providing advice on work-life balance and stress management, thereby enabling a rapid and appropriate response to a variety of user inputs.

[1544] "User" refers to a person who uses the system to input feedback, requests, questions, etc.

[1545] "Terminal" refers to the device or software through which the user enters input and displays responses from the server.

[1546] "Server" refers to a device or software that analyzes data received from a terminal, searches for and generates appropriate resources and information, and sends them to the terminal.

[1547] A "natural language processing engine" refers to a computer model or algorithm that analyzes a user's text input, understands its meaning, and derives appropriate results.

[1548] "JSON format" is an abbreviation for JavaScript Object Notation, and refers to a data format for structuring and representing text data.

[1549] An "HTTP request" refers to a request message based on a network protocol for transmitting data from a client to a server.

[1550] "Database" refers to a system for storing and managing structured data.

[1551] An "external API" refers to an interface for communicating with external applications and services to access data and functions.

[1552] "Answer" refers to information or resources generated by the server in response to input from the user.

[1553] "Feedback" refers to the opinions and thoughts that users give to the system.

[1554] A "request" refers to a user's request for a desired function or service from the system.

[1555] "Career path" refers to the plan or path of the job or role that the user aims to take on in the future.

[1556] "Training Materials" refers to educational content and documents used by Users to improve their skills and gain knowledge.

[1557] "Work-life balance" refers to the appropriate allocation of work and private time and activities.

[1558] "Stress management" refers to methods and approaches for reducing mental strain and tension.

[1559] This invention relates to a system that accepts feedback, requests, and questions from users and provides appropriate answers and resources accordingly. This system consists of three main components: a server, a terminal, and a user.

[1560] Hardware and Software Configuration

[1561] server:

[1562] The server receives data sent by users, analyzes the data using a natural language processing engine (e.g., ChatGPT), searches for appropriate information and resources using databases and external APIs, and provides the generated answers to users. The server's main software components include an API server and a database server (e.g., MySQL, PostgreSQL).

[1563] Device:

[1564] The device is responsible for receiving user input and sending it to the server. It converts the user input into JSON format and sends it to the server using an HTTP request. The device can be a web browser or a mobile application that uses HTML, CSS, JavaScript, etc.

[1565] User:

[1566] A user is a person who enters feedback, requests, and questions through the system.

[1567] Program processing

[1568] On the device:

[1569] The user uses the device's interface to input feedback or requests, such as "I need a new project management tool." The device receives this input in text format and converts it to JSON, which is then sent to the server as an HTTP request.

[1570] Server side:

[1571] The server analyzes the user's input received from the device by passing it to a natural language processing engine (e.g., ChatGPT). Based on the analysis results, it searches for appropriate resources and information. For example, it searches a database or external API for information about a new project management tool. Based on the search results, it generates a response such as "We recommend XX as your new project management tool," and sends this to the device.

[1572] Terminal side (redisplay):

[1573] The device displays the response received from the server to the user, who can then review the suggestions and take action based on them, such as trying out the proposed project management tool.

[1574] Specific examples

[1575] Examples of feedback and requests:

[1576] The user types "I want a new project management tool" into the device. The device sends this input to the server. The server analyzes the input and recognizes that it means "introducing a new tool." The server searches its database for information on an appropriate project management tool, generates a response saying "We propose introducing XX as your new project management tool," and sends it to the device. The device then displays the response to the user.

[1577] Example prompt sentence:

[1578] If the user's input is a request for a new project management tool, the corresponding prompt statement would be "This user wants a new project management tool."

[1579] This allows for quick and appropriate responses to a variety of user input. The system can improve employee satisfaction and engagement through flexible provision of information and advice.

[1580] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1581] Step 1:

[1582] User input

[1583] The user enters their feedback or request into the terminal interface, for example, "I need a new project management tool." This is the starting point of the process, and the user's input triggers the behavior of the entire system.

[1584] Specific behavior:

[1585] The user enters a request into the form on the browser and clicks the "Submit" button.

[1586] Input: Text data entered by the user

[1587] Output: Data entered by the user

[1588] Step 2:

[1589] Terminal prepares to send data

[1590] The terminal receives the user's input data in text format and converts it into JSON format.

[1591] Specific behavior:

[1592] The device converts the text "I need a new project management tool" received from the user into the JSON format {"request": "I need a new project management tool"}.

[1593] Input: User's text data

[1594] Output: Data converted to JSON format

[1595] Step 3:

[1596] Sending from the device to the server

[1597] The terminal sends the data converted into JSON format to the server as an HTTP request.

[1598] Specific behavior:

[1599] The JSON data generated by the terminal is sent to the server as a POST request. The URL used is https: / / example.com / api as an example.

[1600] Input: JSON format data

[1601] Output: Data sent to the server as an HTTP request

[1602] Step 4:

[1603] Data reception by the server and preparation for analysis

[1604] The server receives the data sent from the device and prepares it to be passed to a natural language processing engine such as ChatGPT.

[1605] Specific behavior:

[1606] The server receives the HTTP request and checks the header information and metadata.

[1607] Input: Data sent by the HTTP request

[1608] Output: Analysis-ready data

[1609] Step 5:

[1610] Analysis using a natural language processing engine

[1611] The server passes the received data to a natural language processing engine for analysis, and searches for appropriate resources and information based on the analysis results.

[1612] Specific behavior:

[1613] The server sends a prompt to the ChatGPT API saying "This user wants a new project management tool" and retrieves the analysis results.

[1614] Input: Data ready for analysis

[1615] Output: Analysis results

[1616] Step 6:

[1617] Finding resources and information

[1618] The server searches for appropriate resources or information from a database or external API based on the analysis results.

[1619] Specific behavior:

[1620] The server queries the database to get information about the "new project management tool," for example using a SQL query such as SELECT FROM tools WHERE category='project_management';

[1621] Input: Analysis results

[1622] Output: Resources and information as search results

[1623] Step 7:

[1624] Generate answers

[1625] The server generates an answer for the user based on the search results.

[1626] Specific behavior:

[1627] The server generates a response based on the search results using a template, such as "We recommend XX as a new project management tool."

[1628] Input: Resources and information as search results

[1629] Output: The generated answer

[1630] Step 8:

[1631] Transmission from the server to the device

[1632] The server sends the generated response to the terminal.

[1633] Specific behavior:

[1634] The server returns the generated answer to the terminal as an HTTP response. The URL used as an example is https: / / example.com / api.

[1635] Input: Generated answer

[1636] Output: Data sent to the device as an HTTP response

[1637] Step 9:

[1638] Displaying answers on the device

[1639] The terminal displays the response received from the server to the user.

[1640] Specific behavior:

[1641] The terminal displays the received response on the browser, and the user confirms it. For example, the response message is displayed in a modal window.

[1642] Input: Data sent as an HTTP response

[1643] Output: The answer displayed to the user

[1644] (Application example 1)

[1645] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1646] Security information evolves daily, making it difficult for users to instantly access the latest security information and countermeasures. There is also a need to provide prompt and appropriate responses to security-related questions and feedback. However, current systems make it difficult to respond in real time, potentially increasing security risks.

[1647] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1648] In this invention, the server includes a means for accepting input from a user, a means for analyzing the accepted input, and a means for searching for appropriate resources and information based on the analysis results. This makes it possible to provide quick and optimal answers to security-related questions and feedback using a natural language processing engine. Furthermore, by using a generative AI model, it is possible to provide advice based on the latest security information, thereby reducing the security risks for users.

[1649] The "means for accepting input from the user" is an interface through which the user can enter security questions and feedback.

[1650] The "means for analyzing received input" is a system that analyzes input received from a user using a natural language processing engine or the like.

[1651] "Means for searching for appropriate resources and information based on the analysis results" refers to a function that searches for appropriate security information and countermeasures from a database or external system based on the analyzed input.

[1652] The "means for generating a response to the user based on the search results" is a function for generating a response to be provided to the user based on the searched information.

[1653] The "means for providing the generated answer to the user" is an interface for displaying or notifying the generated answer to the user.

[1654] The "means for accepting security-related questions and feedback" is an interface for accepting security-related questions and feedback from users.

[1655] The "means for analyzing received security-related input and generating optimal answers" is a system that analyzes security-related input using a natural language processing engine and generates optimal answers based on the analysis results.

[1656] "Means for generating optimal answers using a generative AI model" is a function that uses a generated AI model (e.g., ChatGPT) to generate optimal answers to user questions.

[1657] The "means for providing advice regarding work-life balance and stress management" is a function that provides appropriate advice in response to questions about work-life balance and stress management from the user.

[1658] The "means for providing security advice" is a function that provides specific advice and countermeasures in response to security-related questions from users.

[1659] MODE FOR CARRYING OUT THE INVENTION

[1660] This invention provides a system that provides prompt and optimal answers to security-related questions and feedback. This system consists of three main elements: a user, a terminal, and a server. The specific roles and processing procedures of each element are described below.

[1661] User

[1662] Users input security questions and feedback using devices such as smartphones, which are generally entered in text format.

[1663] Examples:

[1664] The user uses their smartphone to type, "What are some signs of unauthorized logins recently?"

[1665] Terminal

[1666] The terminal is equipped with an interface that accepts text data entered by the user and sends it to the server. The text data is converted into JSON format and sent to the server as an HTTP request.

[1667] server

[1668] The server analyzes the received data using a natural language processing engine. This invention uses OpenAI's generative AI model (e.g., ChatGPT). Based on the analysis results, it searches a database or external system for appropriate security information and countermeasures, and generates the optimal answer. The generated answer is then sent to the device.

[1669] Examples:

[1670] Example prompt sentence:

[1671] User Question: What are the signs of unauthorized logins recently?

[1672] Please provide the best security answer.

[1673] The server parses this prompt and generates an appropriate response: "Signs of unauthorized logins include a sudden password change or frequent logins from unusual locations. Other signs include an increase in security alerts from your device."

[1674] Terminal

[1675] The terminal that receives the generated answer displays it to the user, allowing the user to instantly obtain appropriate security information and advice.

[1676] This system allows users to receive fast and accurate answers to their real-time security questions and feedback, significantly reducing security risks and improving user peace of mind.

[1677] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1678] Step 1:

[1679] Users use their smartphones to enter security questions and feedback, and the entered text data is sent to the user's device.

[1680] Input: Security-related text entered by the user (e.g., "What are some signs of recent unauthorized login attempts?").

[1681] Output: Text data is captured to the terminal.

[1682] Step 2:

[1683] The device converts the received text data into JSON format and sends it to the server using an HTTP POST request. The conversion process and request transmission are performed within the device.

[1684] Input: Text data entered by the user.

[1685] Data processing: Convert text data into JSON format.

[1686] Output: JSON formatted data is sent to the server.

[1687] Step 3:

[1688] The server parses the received JSON data and converts it to text format, which is then passed as input to a generative AI model (e.g., ChatGPT) for analysis.

[1689] Input: JSON formatted data.

[1690] Data processing: Convert JSON format data into text format.

[1691] Data computation: Perform analysis using generative AI models.

[1692] Output: Analysis results from the generative AI model.

[1693] Step 4:

[1694] Based on the analysis results obtained from the generative AI model, the server searches a database for appropriate security information and countermeasures, and generates the optimal answer.

[1695] Input: Analysis results from the generative AI model.

[1696] Data calculation: Based on the analysis results, appropriate information is searched for in the database and an answer is generated.

[1697] Output: The generated textual answer.

[1698] Step 5:

[1699] The server converts the generated response into JSON format and sends it back to the terminal as an HTTP response. The conversion process and response transmission are performed within the server.

[1700] Input: A textual answer.

[1701] Data processing: Convert text responses into JSON format.

[1702] Output: JSON formatted data is sent to the terminal.

[1703] Step 6:

[1704] The device parses the JSON data received from the server and displays it to the user as a text response. The parsing and display are performed within the device.

[1705] Input: JSON format data received from the server.

[1706] Data processing: Convert JSON format data into text format.

[1707] Output: The textual response is displayed.

[1708] In this way, users can get fast and relevant answers to their security questions and feedback.

[1709] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1710] This invention relates to a system that uses a natural language processing engine such as ChatGPT and an emotion engine to accept feedback, requests, questions, etc. from users and provide appropriate answers and resources accordingly. In particular, it has the function of recognizing the user's emotions and optimizing responses based on those emotions.

[1711] Accepting feedback and requests

[1712] User:

[1713] Users use the device interface to enter their feedback and requests, for example, "I need a new project management tool."

[1714] Device:

[1715] The terminal sends the user's input in text format to the server, which converts the input data to JSON format if necessary.

[1716] server:

[1717] The server first passes the input data received from the device to an emotion engine to recognize the user's emotions. For example, it recognizes that the user is expressing anger along with the request "I need a new tool." It then passes the data to a natural language processing engine (e.g., ChatGPT) to analyze the content.

[1718] Based on the analysis and emotion recognition results, the server searches for relevant resources and information from databases and external APIs, for example, searching for information about available project management tools.

[1719] server:

[1720] The server generates specific suggestions and answers for the user based on the search results, such as "We recommend XX as a new project management tool. Also, please let us know if you have any complaints."

[1721] Device:

[1722] The terminal displays the answer received from the server to the user, who then confirms the proposal.

[1723] Providing necessary information and resources

[1724] User:

[1725] Users enter questions about career paths and training materials into the terminal, for example, "I would like information about career paths."

[1726] Device:

[1727] The terminal transmits the user's question in text format to the server.

[1728] server:

[1729] The server passes the question received from the device to the emotion engine, which recognizes the user's emotion. For example, it recognizes that the user is expressing anxiety. It then passes the question to the natural language processing engine, which analyzes the content of the question.

[1730] Based on the analysis results, search for appropriate resources and information from databases or external APIs, for example, search for information on career development programs and training materials.

[1731] server:

[1732] The server generates a specific response to the user based on the search results, such as "You can find information about career paths by clicking the link below. If you have any concerns, please feel free to contact us."

[1733] Device:

[1734] The terminal displays the response received from the server to the user, who then views the provided information.

[1735] Work-life balance and stress management advice

[1736] User:

[1737] Users input questions about work-life balance and stress management into the device, for example, "Please tell me effective time management methods."

[1738] Device:

[1739] The terminal transmits the user's question in text format to the server.

[1740] server:

[1741] The server passes the question received from the device to the emotion engine, which recognizes the user's emotions. For example, it recognizes that the user is feeling stressed. The server then passes the data to the natural language processing engine, which analyzes the content.

[1742] Based on the analysis results, resources and information related to work-life balance and stress management are searched from databases and external APIs, for example, information on time management tools and relaxation techniques.

[1743] server:

[1744] The server generates specific advice for the user based on the search results, such as "We recommend ____ as a tool for effective time management. Please also use techniques to reduce stress."

[1745] Device:

[1746] The device displays the advice received from the server to the user, who can then put the suggested tools and methods into practice.

[1747] Through these processing steps, the system provides appropriate resources and advice in response to user feedback and questions, and responds in accordance with the user's emotions, thereby improving employee satisfaction and engagement. In this way, the system of the present invention can also contribute to improving employee stress management and work-life balance.

[1748] The processing flow will be explained below.

[1749] Accepting feedback and requests

[1750] Step 1:

[1751] User: The user uses the device interface to enter feedback and requests, for example, "I need a new project management tool."

[1752] Step 2:

[1753] Terminal: The terminal sends the feedback and requests entered by the user in text format to the server. If necessary, the input data is converted to JSON format.

[1754] Step 3:

[1755] Server: The server passes the data received from the device to the emotion engine and recognizes the user's emotion. For example, it recognizes that the user is expressing anger along with the request "I need a new tool."

[1756] Step 4:

[1757] Server: The server passes the recognized emotion data to a natural language processing engine (e.g., ChatGPT) for content analysis. The analysis determines that the user wants to "introduce a new tool."

[1758] Step 5:

[1759] Server: Based on the analysis and emotion recognition results, the server searches for relevant resources and information from databases and external APIs, for example, searching for information about available project management tools.

[1760] Step 6:

[1761] Server: The server generates specific suggestions and answers for the user based on the search results. For example, it generates an answer such as, "We recommend XX as a new project management tool. Also, please let us know if you have any complaints."

[1762] Step 7:

[1763] Server: The server generates a response and sends it to the device.

[1764] Step 8:

[1765] Terminal: The terminal displays the answer received from the server to the user, who then confirms the proposal.

[1766] Providing necessary information and resources

[1767] Step 1:

[1768] User: The user uses the device interface to input a question or concern, for example, "I would like information about career paths."

[1769] Step 2:

[1770] Terminal: The terminal sends user questions and concerns in text format to the server. If necessary, the input data is converted to JSON format.

[1771] Step 3:

[1772] Server: The server passes the data received from the device to the emotion engine and recognizes the user's emotion. For example, it recognizes that the user is expressing anxiety.

[1773] Step 4:

[1774] Server: The server passes the recognized emotion data to a natural language processing engine, which analyzes the question. Through this analysis, it determines that the user is looking for information about career paths.

[1775] Step 5:

[1776] Server: Based on the analysis results, the server searches for appropriate resources and information from databases or external APIs, for example, career development programs or training materials.

[1777] Step 6:

[1778] Server: The server generates a specific answer to the user based on the search results. For example, it generates an answer such as, "You can find information about career paths by clicking the link below. If you have any concerns, please feel free to contact us."

[1779] Step 7:

[1780] Server: The server generates a response and sends it to the device.

[1781] Step 8:

[1782] Terminal: The terminal displays the answer received from the server to the user, who then views the provided information.

[1783] Work-life balance and stress management advice

[1784] Step 1:

[1785] User: The user uses the device interface to input a question about work-life balance or stress management, for example, "What are some effective time management techniques?"

[1786] Step 2:

[1787] Terminal: The terminal sends the user's question in text format to the server. If necessary, the input data is converted to JSON format.

[1788] Step 3:

[1789] Server: The server passes the data received from the device to the emotion engine and recognizes the user's emotion. For example, it recognizes that the user is feeling stressed.

[1790] Step 4:

[1791] Server: The server passes the recognized emotion data to a natural language processing engine, which analyzes the question. Through the analysis, it determines that the user is asking about "time management methods."

[1792] Step 5:

[1793] Server: Based on the analysis results, the server searches for resources and information related to work-life balance and stress management from databases and external APIs, such as time management tools and relaxation techniques.

[1794] Step 6:

[1795] Server: The server generates specific advice for the user based on the search results. For example, it generates an answer such as, "We recommend ____ as a tool for effective time management. Please also use techniques to reduce stress."

[1796] Step 7:

[1797] Server: The server sends the generated advice to the terminal.

[1798] Step 8:

[1799] Terminal: The terminal displays the advice received from the server to the user, who can then put the suggested tools and methods into practice.

[1800] Through these processing steps, the system provides appropriate resources and advice in response to user feedback and questions, and responds in accordance with the user's emotions, thereby improving employee satisfaction and engagement. In this way, the system of the present invention can also contribute to improving employee stress management and work-life balance.

[1801] Example 2

[1802] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1803] Conventional systems lacked the processing power to provide appropriate resources and information in response to user input, and were particularly unable to respond in a way that took the user's emotions into consideration. Furthermore, responses to user feedback and questions were uniform, making it difficult to respond flexibly to improve user satisfaction. Advice and support regarding work-life balance and stress management were also limited, preventing them from contributing to overall improvements in employee satisfaction and engagement.

[1804] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for accepting user input, means for recognizing the user's emotion, means for optimizing a response using the emotion recognition result, means for passing the input data to a natural language processing engine for analysis, means for searching for appropriate resources and information based on the analysis result and the emotion recognition result, means for generating a response to the user based on the search result, and means for providing the generated response to the user. This enables flexible and optimal responses that take the user's emotion into consideration, thereby significantly improving user satisfaction and engagement.

[1805] A "user" is an individual or organization that utilizes the system to enter feedback and questions and obtain answers and information.

[1806] "Means for accepting input" refers to an interface or module for inputting text data or questions from the user into the system.

[1807] "Means of analysis" refers to the processes and modules used to process received text data and understand and comprehend its contents.

[1808] An "emotion recognition means" is an engine or algorithm that analyzes input text data and identifies the emotion being expressed by the user.

[1809] The "means for optimizing responses" refers to a process or module that generates appropriate answers or suggestions based on the recognized emotions and provides optimal information to the user.

[1810] A "natural language processing engine" is a technology or algorithm that analyzes input text data and understands its meaning.

[1811] "Means for retrieving resources and information" refers to processes or modules for locating relevant information and resources from databases or external sources based on the analysis results.

[1812] "Means for generating answers" refers to processes or modules for creating specific answers or suggestions to provide to users based on search results and analysis content.

[1813] The "means for providing" refers to an interface or function for displaying the generated answers or suggestions to the user and enabling the user to use them.

[1814] "Flexible response" is the ability to individually tailor and provide the optimal response based on the user's individual needs and emotions.

[1815] This invention is a system that accepts feedback, requests, questions, etc. from users and provides appropriate answers and resources using a natural language processing engine and an emotion recognition engine. In particular, it has the function of recognizing the user's emotions and optimizing responses based on those emotions.

[1816] The system mainly uses the following hardware and software:

[1817] 1. User device: A device used by a user to input text data, such as a PC, smartphone, or tablet.

[1818] 2. Server: A computer system that receives, analyzes, and processes data.

[1819] 3. Natural language processing engine (e.g. ChatGPT): Software that analyzes text data entered by users and understands its meaning.

[1820] 4. Emotion recognition engine (e.g., Affectiva): Software that recognizes user emotions from text data.

[1821] 5. Database: An information system for storing relevant resources and information for user feedback, requests and questions.

[1822] The invention is implemented in the following steps:

[1823] 1. User provides text input: The user uses the device interface to enter feedback, requests, or questions in text format, for example, "I need a new project management tool."

[1824] 2. Sending input data: The terminal converts the input data into JSON format and sends it to the server.

[1825] 3. Emotion Recognition: The server receives the input data and first passes it to the emotion recognition engine, which analyzes the emotions in the text and recognizes emotions such as anger, anxiety, and joy.

[1826] 4. Natural Language Analysis: The server then sends the data to a natural language processing engine for content analysis. The engine understands the intent of the input and prepares an appropriate response.

[1827] 5. Search for related information: Based on the analysis results, the server searches for related resources and information from databases and external APIs, for example, gathering information about a new project management tool.

[1828] 6. Answer Generation: The server generates the best answer for the user based on the search results. For example, it generates a sentence like, "We recommend XX as a new project management tool. Also, please let us know if you have any other complaints."

[1829] 7. Displaying the Answer: The terminal displays the answer received from the server to the user, who can view it and provide feedback.

[1830] A distinctive feature of this system is its emotion recognition function. By understanding the user's emotions, it can provide more appropriate and empathetic responses. For example, if a user writes "I'd like information about career paths" with a sense of anxiety, the server will recognize that anxiety and generate a response with an empathetic comment such as "If you have any concerns, please feel free to contact us."

[1831] As a concrete example, if a user types "Please tell me effective time management methods," this data is sent from the device to the server. The server uses an emotion recognition engine to recognize the user's sense of stress, and then analyzes the content using a natural language processing engine. As a result, it generates a response such as "We recommend ____ as a tool for effective time management. Please also use techniques for stress reduction," and displays it on the device.

[1832] Example prompt sentence:

[1833] User: What are some effective time management techniques?

[1834] In this way, the invention can provide flexible and optimal responses according to the user's emotions, significantly improving user satisfaction and engagement.

[1835] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1836] Step 1:

[1837] User: Through a terminal interface, users input feedback, requests, and questions. This input is typically in text format and includes prompts such as "I need a new project management tool."

[1838] Input: Text data

[1839] Output: Text data captured on the user's terminal

[1840] Step 2:

[1841] Terminal: The terminal receives the text data entered by the user and sends it to the server, where it is converted to JSON format and sent to the server as an HTTPS request.

[1842] Specific behavior: Converts text data into JSON format and constructs and sends an HTTPS request.

[1843] Input: Text data entered by the user

[1844] Output: JSON format data is sent to the server

[1845] Step 3:

[1846] Server: The server passes the JSON data received from the device to the emotion recognition engine. In this process, the text data is analyzed to recognize the user's emotions (e.g., anger, joy, anxiety, etc.).

[1847] Specific operation: Pass the data to the emotion recognition engine and perform emotion analysis.

[1848] Input: JSON format text data

[1849] Output: User emotion data (e.g. anger, anxiety, joy)

[1850] Step 4:

[1851] Server: The server sends the text data along with the recognized emotion data to a natural language processing engine, which analyzes the text data and understands the intent of the specific request or question.

[1852] Specific operation: Pass the data to a natural language processing engine and analyze the content.

[1853] Input: Emotion data and text data

[1854] Output: The parsed request or question intent

[1855] Step 5:

[1856] Server: Based on the analysis results, it searches for relevant information from databases and external APIs, for example, finding information and links about new project management tools.

[1857] Specific Actions: Execute SQL queries to perform database searches or send REST API requests to external services.

[1858] Input: Parsed request or question intent

[1859] Output: Search results (related resources and information)

[1860] Step 6:

[1861] Server: Generates the best answer for the user based on the search results. The generated answer is built using a template engine, etc. For example, it might create an answer like, "We recommend XX as a new project management tool. Also, please let us know if you have any other complaints."

[1862] What it does: Uses a template engine to build answers based on search results.

[1863] Input: Search result data

[1864] Output: Text of the reply to the user

[1865] Step 7:

[1866] Terminal: The terminal displays the answers received from the server to the user, allowing the user to review suggestions and information and take useful actions.

[1867] Specific behavior: Receives text data from the server and displays it in the user interface.

[1868] Input: Response text from the server

[1869] Output: Answer displayed on the user's terminal

[1870] (Application example 2)

[1871] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1872] Conventional customer support systems in brick-and-mortar stores have struggled to respond quickly and appropriately to feedback and requests. They also lack the ability to respond in a way that takes into account customer emotions, recommend optimal products according to the situation, or provide special offers. This has created challenges in improving customer satisfaction and the in-store shopping experience.

[1873] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for accepting input from a user, means for analyzing the accepted input, means for searching for appropriate resources or information based on the analysis results, means for generating a response to the user based on the search results, means for performing emotion analysis and optimizing the response based on the user's emotions, and means for providing the generated response to the user. This enables faster and more optimized customer service in physical stores, flexible responses according to customer emotions, and the provision of recommended information and special offers.

[1874] "Means for accepting user input" refers to an interface through which user-provided information or feedback can be entered into the system.

[1875] The "means for analyzing accepted input" refers to a function for analyzing input data from a user and performing processing to understand its contents.

[1876] "Means for searching for appropriate resources and information based on the analysis results" refers to the function of identifying related information and resources from the analyzed content and searching them from databases or external systems.

[1877] "Means for generating a response to the user based on the search results" refers to a function that generates a specific response to the user based on the searched resources or information.

[1878] "Means for performing sentiment analysis and optimizing responses based on the user's emotions" refers to a function that analyzes emotions from the user's words and expressions and constructs an optimal response based on those emotions.

[1879] "Means for providing the generated answer to the user" refers to means for notifying the user of the answer generated by the system.

[1880] A "natural language processing engine" refers to technology for understanding text data and analyzing its meaning and intent.

[1881] "Means for searching for information on specific products and generating suggestions" refers to a function for searching for information on specific products based on the analysis results and making suggestions to the user.

[1882] "Means for generating and providing specific discount information and coupons in physical stores based on user feedback and requests" refers to the function of creating discount information and coupons in physical stores based on feedback and requests from online users and providing them to users.

[1883] In the system realizing this invention, the user, the terminal, and the server work in cooperation with each other. Specific implementation means are shown below.

[1884] First, the user uses the smartphone application "Smart Shop Assistant." This application provides an interface for inputting feedback and requests from the user. For example, the user inputs a request such as "Do you have this product in other colors?" This input is sent to the server in text format by the device.

[1885] The server then analyzes the received input using an emotion analysis engine (e.g., Microsoft Azure Emotion API) to recognize the user's emotions. For example, it determines whether the user's request is positive or negative. The analysis results are then passed to a natural language processing engine (e.g., OpenAI's ChatGPT), which analyzes the specific content of the request. Based on these results, related product information and resources are searched for in a database or external API.

[1886] Based on the search results, the server generates a response to the user. It also takes into account the results of sentiment analysis, and if the user is dissatisfied, for example, it generates a response that includes an apology. Specifically, it generates a response such as, "This product is available in blue and red. Please let us know if you have any complaints."

[1887] It can also provide in-store rewards: for example, if a user shows a high interest in a particular product, the system can generate special coupons or discount information and provide it to the user.

[1888] Finally, the generated answers and suggestions are sent to the user via a smartphone application, allowing the user to receive relevant information and suggestions and improve their shopping experience in physical stores.

[1889] For example, the following prompt is sent to the generative AI model:

[1890] "The user is asking if you have a dress in size medium. The sentiment is neutral. Please generate an answer with product recommendations."

[1891] In this way, the system will enable faster and more optimized customer service in physical stores, flexible responses based on customer sentiment, and the provision of recommended information and special offers.

[1892] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1893] Step 1:

[1894] Users use a smartphone application to input feedback and requests. For example, they might input a request such as, "Do you have this product in other colors?" The input data is sent to the device in text format.

[1895] Step 2:

[1896] The terminal converts the input data from the user into JSON format and sends it to the server. For example, the input text "Do you have this product in other colors?" is converted into JSON format.

[1897] Step 3:

[1898] The server first passes the received input data to a sentiment analysis engine to recognize the user's sentiment. For example, it analyzes text data and recognizes that the user is expressing a neutral sentiment.

[1899] Step 4:

[1900] Based on the results of the sentiment analysis, the server passes the data to a natural language processing engine (e.g., ChatGPT) for analysis. For example, the question "Do you have this product in other colors?" is analyzed and it is determined that product information needs to be searched.

[1901] Step 5:

[1902] The server searches for related product information from a database or external API based on the analysis results of the natural language processing engine. For example, it searches the product database for "Whether or not there are products in different colors" and finds that there are blue and red colors.

[1903] Step 6:

[1904] The server generates a response to the user based on the search results, taking into account the results of sentiment analysis. For example, it generates a response such as, "This product is available in blue and red. Please let us know if you have any complaints."

[1905] Step 7:

[1906] The device displays the answer received from the server to the user. The user can check the generated answer through the smartphone application. For example, information such as "This product is available in blue and red" may be displayed.

[1907] Step 8:

[1908] In the case of specific rewards, specific discount information and coupons can be generated and provided based on user feedback and requests. For example, special coupons can be generated for products that users show a high interest in and provided through the application.

[1909] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1910] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1911] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1912] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1913] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1914] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1915] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1916] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1917] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1918] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1919] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1920] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1921] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1922] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1923] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1924] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1925] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1926] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1927] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1928] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1929] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1930] The following is further disclosed regarding the above embodiment.

[1931] (Claim 1)

[1932] means for accepting input from a user;

[1933] a means for parsing the received input;

[1934] A means of searching for appropriate resources and information based on the analysis results;

[1935] a means for generating a response to the user based on the search results;

[1936] means for providing the generated answer to the user;

[1937] A system including:

[1938] (Claim 2)

[1939] A means of passing the input data to a natural language processing engine for analysis;

[1940] A means of searching for appropriate resources and information based on the analysis results, and

[1941] The system of claim 1 further comprising:

[1942] (Claim 3)

[1943] a means for generating responses to user feedback and requests;

[1944] a means of providing advice on work-life balance and stress management;

[1945] The system of claim 1 further comprising:

[1946] "Example 1"

[1947] (Claim 1)

[1948] means for accepting input from a user;

[1949] means for transmitting the received input to a server in text form;

[1950] a means for passing the input data to a natural language processing engine in the server for analysis;

[1951] A means of searching for appropriate resources and information based on the analysis results;

[1952] a means for generating a response to the user based on the search results;

[1953] means for transmitting the generated answer to the terminal;

[1954] means for displaying the submitted answers to the user;

[1955] A system including:

[1956] (Claim 2)

[1957] a means for generating responses to user feedback and requests;

[1958] a means of providing information and resources for questions about career paths and training materials;

[1959] a means of providing advice on work-life balance and stress management;

[1960] The system of claim 1 further comprising:

[1961] (Claim 3)

[1962] A means for converting input data into JSON format and sending it to a server as an HTTP request in the terminal;

[1963] The server searches the appropriate database or external API based on the question or request,

[1964] 2. The system according to claim 1, further comprising means for automatically generating an answer based on a template, the answer being generated from the analysis result.

[1965] "Application Example 1"

[1966] (Claim 1)

[1967] means for accepting input from a user;

[1968] a means for parsing the received input;

[1969] A means of searching for appropriate resources and information based on the analysis results;

[1970] a means for generating a response to the user based on the search results;

[1971] means for providing the generated answer to the user;

[1972] A means for receiving security questions and feedback;

[1973] a means for analyzing received security inputs and generating optimal answers;

[1974] means for providing the generated security answers to a user;

[1975] A system including:

[1976] (Claim 2)

[1977] A means of passing the input data to a natural language processing engine for analysis;

[1978] A means of searching for appropriate resources and information based on the analysis results, and

[1979] A means for generating optimal answers using a generative AI model; and

[1980] The system of claim 1 further comprising:

[1981] (Claim 3)

[1982] a means for generating responses to user feedback and requests;

[1983] a means of providing advice on work-life balance and stress management;

[1984] a means of providing security advice;

[1985] The system of claim 1 further comprising:

[1986] "Example 2: Combining Emotion Engines"

[1987] (Claim 1)

[1988] means for accepting input from a user;

[1989] a means for parsing the received input;

[1990] A means of searching for appropriate resources and information based on the analysis results;

[1991] a means for generating a response to the user based on the search results;

[1992] means for providing the generated answer to the user;

[1993] means for recognizing a user's emotion;

[1994] a means for optimizing a response using emotion recognition results;

[1995] A system including:

[1996] (Claim 2)

[1997] A means of passing the input data to a natural language processing engine for analysis;

[1998] A means for searching for appropriate resources and information based on the analysis results and emotion recognition results;

[1999] The system of claim 1 further comprising:

[2000] (Claim 3)

[2001] a means for generating responses to user feedback and requests;

[2002] a means of providing advice on work-life balance and stress management;

[2003] The system of claim 1 further comprising:

[2004] "Application example 2 when combining emotion engines"

[2005] (Claim 1)

[2006] means for accepting input from a user;

[2007] a means for parsing the received input;

[2008] A means of searching for appropriate resources and information based on the analysis results;

[2009] a means for generating a response to the user based on the search results;

[2010] means for performing sentiment analysis and optimizing responses based on the sentiment of the user;

[2011] means for providing the generated answer to the user;

[2012] A system including:

[2013] (Claim 2)

[2014] A means of passing the input data to a natural language processing engine for analysis;

[2015] A means of searching for appropriate resources and information based on the analysis results, and

[2016] A means for searching for unique product information and generating suggestions according to the analysis results of the natural language processing engine;

[2017] The system of claim 1 further comprising:

[2018] (Claim 3)

[2019] a means for generating responses to user feedback and requests;

[2020] a means of providing advice on work-life balance and stress management;

[2021] A means for generating and providing specific discount information and coupons in physical stores according to user feedback and requests;

[2022] The system of claim 1 further comprising: [Explanation of symbols]

[2023] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. means for accepting input from a user; a means for parsing the received input; A means of searching for appropriate resources and information based on the analysis results; a means for generating a response to the user based on the search results; means for providing the generated answer to the user; A system including:

2. A means of passing the input data to a natural language processing engine for analysis; A means of searching for appropriate resources and information based on the analysis results, and The system of claim 1 further comprising:

3. a means for generating responses to user feedback and requests; a means of providing advice on work-life balance and stress management; The system of claim 1 further comprising:

Images