system

Abstract

We provide the system. [Solution] To select the optimal system based on the user's application details. Request receiving method, A search method for searching the internal database for a system corresponding to the application content, A notification method for informing the user of the selected system, A search method for finding the contact information for the relevant system from the internal database, A notification method for informing users of contact information, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, the method including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In modern enterprises, a large number of in-house systems have been introduced, and it is often difficult for users to determine which system to use when performing a specific task. Also, due to the large number of systems, the contact points associated with each system are different, and there may be a waste of time due to contacting the wrong contact point. Furthermore, managing the authentication information (ID and password) for each system is also complicated and involves security risks. In such a complex system environment, there is a need for a system that supports users in quickly and accurately performing their tasks.

Means for Solving the Problems

[0005] The present invention provides a system that selects the optimal system based on the user's application and notifies the user. Specifically, the system includes a request receiving means for receiving user requests, a search means for searching an internal database for systems corresponding to the application, a notification means for notifying the user of the selected system, a search means for searching an internal database for the contact information of the relevant system, and a notification means for notifying the user of the contact information. Furthermore, by providing a storage means for storing the user's authentication information, a search means for searching the stored authentication information, and a provision means for providing the search results to the user, security and convenience are achieved. In addition, security risks are reduced by providing an encryption means for encrypting and storing the authentication information. As a result, the system provides users with the ability to quickly identify the optimal system, know the correct contact information, and manage their authentication information securely.

[0006] "User" refers to an individual or legal entity that uses the system to perform business operations.

[0007] "Request receiving means" refers to the function for receiving and processing user applications and requests.

[0008] "Search method" refers to a function for searching and extracting specific information from an internal database.

[0009] "Notification means" refers to a function that provides information from the system to the user.

[0010] "Storage means" refers to a function for saving data such as user authentication information to a storage device.

[0011] "Means of provision" refers to the function for providing stored data to users.

[0012] "Encryption methods" refer to functions that encode data to ensure security.

[0013] An "internal database" refers to a collection of information held within a system, where operations such as searching and saving are performed.

[0014] "Application details" refers to the specific tasks or operations that the user requests from the system.

[0015] "Contact point" refers to the department or person who provides support and answers questions about the system.

[0016] "Authentication information" refers to information such as IDs and passwords that a user provides to a system to identify themselves. [Brief explanation of the drawing]

[0017] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10]Shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when an emotion engine is combined.

Mode for Carrying Out the Invention

[0018] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0019] First, the language used in the following description will be explained.

[0020] In the following embodiments, a numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of a plurality of arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of a plurality of types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0021] In the following embodiments, a numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0022] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0023] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0025] [First Embodiment]

[0026] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0027] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0030] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0033] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0037] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0038] The system of the present invention helps users select the optimal system when using multiple internal systems, enabling them to perform their tasks quickly and accurately. Specific embodiments are described below.

[0039] 1. System Configuration

[0040] The system of the present invention includes the following main components:

[0041] Request receiving method: Receives application details and requests from users.

[0042] Search method: The system corresponding to the application content is searched from the internal database.

[0043] Notification method: Notify the user of the most suitable system and the appropriate contact point.

[0044] Storage method: Stores user authentication information.

[0045] Search method: Search for saved authentication information.

[0046] Delivery method: Provide search results to the user.

[0047] Encryption method: Authentication information is encrypted and stored.

[0048] 2. How to operate the system

[0049] The user's workflow for operating the system is as follows:

[0050] Request received:

[0051] Users want to perform specific tasks and input the details into the system (for example, "leave request" or "expense reimbursement").

[0052] System selection:

[0053] The server receives requests from users.

[0054] The server searches its internal database for the most suitable system corresponding to the application details.

[0055] The server notifies the user of the selected system.

[0056] Contact information:

[0057] The server searches its internal database for contact information related to the selected system.

[0058] The server will notify the user of the contact information.

[0059] Storing authentication information:

[0060] The user enters authentication information (ID and password) for a specific system and sends a request to save it to the system.

[0061] The server receives the authentication information and stores it using encryption.

[0062] The server notifies the user of the saved results.

[0063] Obtaining authentication information:

[0064] The user sends a request to the system to retrieve previously saved credentials.

[0065] The server searches for stored authentication information and provides the search results to the user.

[0066] If the server cannot find the appropriate authentication information, it will notify the user that the information could not be found.

[0067] 3. Specific Examples

[0068] Specific examples are given below.

[0069] For example, the procedure for a user to submit a "leave request" is as follows:

[0070] 1. The user enters "leave request" and submits a request to the support system.

[0071] 2. The server receives the request and searches its internal database for the "leave management system" corresponding to the "leave request".

[0072] 3. The server selects a "vacation management system" and notifies the user.

[0073] 4. The server then searches for a contact point regarding the "Leave Management System" and notifies the user that it is the "Human Resources Department".

[0074] Next, the procedure for users to save their credentials is as follows:

[0075] 1. The user enters their ID and password for the "Leave Management System" and sends a save request to the support system.

[0076] 2. The server receives the request and stores the authentication information in an encrypted form.

[0077] 3. The server notifies the user of the saved results.

[0078] Furthermore, the procedure for users to obtain their authentication credentials is as follows:

[0079] 1. The user sends a request to retrieve previously saved authentication information for the "Leave Management System".

[0080] 2. The server retrieves the stored authentication information and provides it to the user.

[0081] 3. If the server cannot find the relevant information, it will notify the user accordingly.

[0082] The above describes a specific embodiment for carrying out the present invention. This allows users to quickly identify the optimal system, find the correct contact point, and securely manage their authentication information.

[0083] The following describes the processing flow.

[0084] When a user submits a leave request

[0085] Step 1:

[0086] The user uses their device to type "leave request" and sends the request to the support system.

[0087] Step 2:

[0088] The server receives this request.

[0089] Step 3:

[0090] Based on the application received by the server, it searches the internal database for the corresponding system (in this case, the "Leave Management System").

[0091] Step 4:

[0092] The server selects the most suitable system, the "vacation management system," based on the search results and notifies the user of that information.

[0093] Step 5:

[0094] The server then searches its internal database for contact information related to the "vacation management system."

[0095] Step 6:

[0096] The server finds the contact point, "Human Resources Department," and notifies the user of that information.

[0097] When saving authentication information

[0098] Step 1:

[0099] The user uses a terminal to enter their ID and password for the "Leave Management System" and sends a request to the support system to save their authentication information.

[0100] Step 2:

[0101] The server receives this request.

[0102] Step 3:

[0103] The server encrypts the received ID and password.

[0104] Step 4:

[0105] The server stores encrypted authentication information in its internal database.

[0106] Step 5:

[0107] The server notifies the user of the saved results.

[0108] When obtaining authentication information

[0109] Step 1:

[0110] The user uses their device to send a request to retrieve previously saved credentials for the "Leave Management System".

[0111] Step 2:

[0112] The server receives this request.

[0113] Step 3:

[0114] The server searches its internal database for the corresponding authentication information.

[0115] Step 4:

[0116] The server provides the user with the relevant authentication information based on the search results (in this case, the information is decrypted before being provided).

[0117] Step 5:

[0118] If the server cannot find the corresponding authentication information, it will notify the user accordingly.

[0119] These steps allow users to quickly and accurately learn the optimal way to use the system and who to contact for support, while also enabling them to manage their authentication information securely.

[0120] (Example 1)

[0121] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0122] In today's business environment, users need to efficiently utilize multiple internal systems. However, these systems each require different authentication credentials, making it difficult to determine which system to use. Furthermore, finding the appropriate contact point is time-consuming, hindering work efficiency. Therefore, there is a need for a system that helps users quickly and accurately select the optimal system and perform their tasks effectively.

[0123] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0124] In this invention, the server includes a request receiving means for selecting the optimal means based on the user's application; a search means for searching for means corresponding to the application from internal storage; a notification means for notifying the user of the selected means; a search means for searching for the contact point for the relevant means from internal storage; a notification means for notifying the user of the contact point; a storage means for storing the user's authentication information; a search means for searching the stored authentication information; a providing means for providing the search results to the user; and an encryption means for encrypting and storing the authentication information. This enables the user to efficiently select the optimal system, obtain appropriate contact information, and securely manage their authentication information.

[0125] A "user" refers to an individual or group that performs operations or inputs into a system.

[0126] "Application details" refers to the detailed information of a specific request or task that a user submits to the system.

[0127] "Optimal means" refers to systems and services that best suit the user's application and respond efficiently.

[0128] "Request receiving means" refers to a process or device for receiving requests sent by a user.

[0129] "Search means" refers to a process or device for retrieving information from an internal storage device based on specific conditions.

[0130] "Notification means" refers to a process or device for conveying retrieved information or systems to the user.

[0131] "Internal storage device" refers to a storage medium or system that can store data and retrieve it as needed.

[0132] "Contact point" refers to the department or person responsible for providing additional information and support regarding the selected system.

[0133] "Storage means" refers to a process or device for securely storing user authentication information.

[0134] "Means of provision" refers to a process or device for providing search results to a user.

[0135] "Encryption means" refers to a process or device that encrypts data in order to protect user authentication information from unauthorized access.

[0136] This invention provides a system for users to efficiently utilize multiple internal systems, and in particular, it has functions to quickly and accurately select the optimal system, notify contact information, and store and retrieve authentication information. This system consists of a server including request receiving means, search means, notification means, storage means, provision means, and encryption means.

[0137] The following are the main components for generating the program for this system:

[0138] 1. Method of receiving requests:

[0139] Users want to perform a specific task and input the details into the system. They use a terminal to input the task details (e.g., "leave request," "expense reimbursement") and send a request to the server. Typical devices used are PCs and smartphones.

[0140] 2. Search methods:

[0141] The server receives a request and searches its internal database for the system best suited to the request. SQL or NoSQL databases are used. For example, if the server receives a "leave request," it uses an SQL query to search for the "leave management system."

[0142] 3. Means of notification:

[0143] The server notifies the user of the selected system. It returns information to the user using an HTTP response. Furthermore, it searches for and notifies the contact person for inquiries regarding the relevant system. For example, it might notify the user that the "Human Resources Department" is the contact person for inquiries regarding the "Leave Management System".

[0144] 4. Preservation means:

[0145] The user enters authentication information (ID and password) for a specific system and sends a save request to the server. The server receives the authentication information and stores it using encryption.

[0146] 5. Means of provision:

[0147] The user sends a request to retrieve previously saved credentials. The server searches for the saved credentials and provides the search results to the user. If no suitable credentials are found, the server notifies the user accordingly.

[0148] 6. Encryption methods:

[0149] The server encrypts authentication information using encryption algorithms such as AES and stores it in an internal database. This process ensures that user authentication information is managed securely.

[0150] Specific example:

[0151] For example, the procedure for a user to submit a "leave request" is as follows:

[0152] 1. The user enters "leave request" and submits the request to the system.

[0153] 2. The server receives the request and searches its internal database for the "leave management system" corresponding to the "leave request".

[0154] 3. The server selects a "vacation management system" and notifies the user.

[0155] 4. The server then searches for a contact point regarding the "Leave Management System" and notifies the user that it is the "Human Resources Department".

[0156] Next, the procedure for users to save their credentials is as follows:

[0157] 1. The user enters their ID and password for the "Leave Management System" and sends a save request to the support system.

[0158] 2. The server receives the request and encrypts the authentication information using the AES encryption algorithm.

[0159] 3. The server stores encrypted authentication information in an internal database.

[0160] 4. The server notifies the user of the saved results.

[0161] Furthermore, the procedure for users to obtain their authentication credentials is as follows:

[0162] 1. The user sends a request to retrieve previously saved authentication information for the "Leave Management System".

[0163] 2. The server retrieves the stored authentication information from its internal database and provides it to the user.

[0164] 3. If the server cannot find the relevant information, it will notify the user accordingly.

[0165] This system allows users to efficiently select the optimal system, obtain appropriate contact information, and securely manage their authentication information.

[0166] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0167] Step 1:

[0168] The user uses a terminal to input the details of the task they want to perform and sends a request to the server. Input: Task details (e.g., "Leave Request"). Output: Request data sent to the server.

[0169] Specific actions:

[0170] The user fills in the details of their work, such as "leave request," in the input form on the terminal and clicks the "submit" button. The terminal sends this input data to the server as an HTTP POST request.

[0171] Step 2:

[0172] The server receives requests from users and parses their contents. Input: Request data. Output: Parsing result (e.g., "Leave Request").

[0173] Specific actions:

[0174] The server receives an HTTP POST request, extracts the business details from the data, and parses it. For example, the request data is received in JSON format as {"request": "leave request"}, and the server uses a JSON parser to extract the keyword "leave request".

[0175] Step 3:

[0176] The server searches its internal database to find the most suitable system for the application. Input: Analysis result (e.g., "Leave Request"). Output: Optimal system information (e.g., "Leave Management System").

[0177] Specific actions:

[0178] The server generates an SQL query and searches the database. For example, it executes a query like SELECT FROM systems WHERE request = 'Leave Request' to retrieve records corresponding to "Leave Management System".

[0179] Step 4:

[0180] The server notifies the user of the selected system. Input: Optimal system information (e.g., "Leave Management System"). Output: Notification content to the user.

[0181] Specific actions:

[0182] The server returns the selected system information to the user as an HTTP response. For example, the response body might say, "Please use the 'Leave Management System' for your leave requests."

[0183] Step 5:

[0184] The server searches its internal database for contact information related to the system in question. Input: Optimal system information (e.g., "Leave Management System"). Output: Contact information (e.g., "Human Resources Department").

[0185] Specific actions:

[0186] The server generates an SQL query to search for the contact information. For example, it executes a query like SELECT FROM contacts WHERE system = 'Leave Management System' to retrieve records corresponding to "Human Resources Department".

[0187] Step 6:

[0188] The server notifies the user of the contact information. Input: Contact information (e.g., "Human Resources Department"). Output: Content of the notification to the user.

[0189] Specific actions:

[0190] The server returns the retrieved contact information to the user as an HTTP response. For example, it might say, "Please direct inquiries regarding the 'Leave Management System' to the 'Human Resources Department'."

[0191] Step 7:

[0192] The user enters authentication information (ID and password) for a specific system and sends a save request to the server. Input: Authentication information (e.g., ID, password). Output: Save request sent to the server.

[0193] Specific actions:

[0194] The user enters authentication information for the "Leave Management System" into the input form on the terminal and clicks the "Save" button. The terminal sends this data to the server as an HTTP POST request.

[0195] Step 8:

[0196] The server receives the request and encrypts the authentication information. Input: Saved request (authentication information). Output: Encrypted authentication information.

[0197] Specific actions:

[0198] The server receives an HTTP POST request and encrypts the received authentication information using the AES encryption algorithm. The encrypted data is then temporarily stored in memory.

[0199] Step 9:

[0200] The server stores encrypted authentication information in the database. Input: Encrypted authentication information. Output: Saved result.

[0201] Specific actions:

[0202] The server generates an INSERT statement and saves the encrypted authentication information to the database. For example, it executes a query such as INSERT INTO credentials (system, id, password) VALUES ('Leave Management System', 'encrypted_id', 'encrypted_password').

[0203] Step 10:

[0204] The server notifies the user of the saved result. Input: Saved result. Output: Notification content to the user.

[0205] Specific actions:

[0206] If the saving process is successful, the server will notify the user of the result via an HTTP response. For example, it might state, "Authentication information saved successfully."

[0207] Step 11:

[0208] The user sends a request to the server to retrieve previously saved authentication information. Input: System name (e.g., "Leave Management System"). Output: Retrieval request sent to the server.

[0209] Specific actions:

[0210] The user enters the system name into the input form on the terminal and clicks the "Get" button. The terminal sends this data to the server as an HTTP POST request.

[0211] Step 12:

[0212] The server receives the request and retrieves the stored authentication information from its internal database. Input: Retrieval request (system name). Output: Search results (encrypted authentication information).

[0213] Specific actions:

[0214] The server parses the received request and searches its internal database for the authentication information of the relevant system. For example, it might execute a query like SELECT FROM credentials WHERE system = 'Leave Management System'.

[0215] Step 13:

[0216] The server provides the retrieved authentication information to the user. Input: Search results (encrypted authentication information). Output: Notification content to the user.

[0217] Specific actions:

[0218] The server decrypts the search results and provides them to the user. For example, it might display "ID: decrypted_id, Password: decrypted_password".

[0219] Step 14:

[0220] The server notifies the user if no matching information is found. Input: Search results (no results found). Output: Notification sent to the user.

[0221] Specific actions:

[0222] If the server cannot find the corresponding authentication credentials, it will notify the user via an HTTP response. For example, it might state, "Certificate credentials could not be found."

[0223] (Application Example 1)

[0224] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0225] Robots operating in factories need to work in conjunction with numerous different systems. However, currently, selecting the optimal system for each robot and obtaining authentication information quickly is difficult, leading to decreased work efficiency. Furthermore, secure management of authentication information is also required.

[0226] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0227] In this invention, the server includes: a request receiving means for selecting the optimal computer system based on the user's application; a search means for searching an internal database for a computer system corresponding to the application; a notification means for notifying the user of the selected computer system; a search means for searching an internal database for the source of the inquiry for the relevant computer system; a notification means for notifying the user of the source of the inquiry; a robot notification means for notifying the robot that received the request of the optimal system and source of the inquiry; a storage means for storing authentication information; an encryption means for encrypting and storing the stored authentication information; and a provision means for searching the stored authentication information and providing it to the robot as needed. This enables the robot to efficiently utilize multiple systems, safely and quickly acquire the necessary authentication information, and perform its tasks.

[0228] "User" refers to the factory operators or robots that utilize this system.

[0229] "Application details" refers to the specific tasks or operations that the user requests from the system.

[0230] An "optimal computing system" refers to a system that provides the most suitable response to the user's request.

[0231] A "request receiving method" is a means of receiving application details from a user.

[0232] A "search method" is a means of searching for a computer system corresponding to the application content within an internal database.

[0233] "Notification means" refers to the means of communicating selected computing systems and inquiry source information to users or robots.

[0234] "Inquiry source" refers to the organization or contact that receives inquiries related to computer systems.

[0235] A "robot notification method" is a means of notifying a robot that has received a request of the optimal system and source of the inquiry.

[0236] "Storage means" refers to means of storing authentication information for robots and users.

[0237] "Encryption means" refers to a method for encrypting the authentication information that is stored.

[0238] "Means of provision" refers to means of searching for stored authentication information and providing it to the robot as needed.

[0239] Modes for carrying out the invention

[0240] The embodiments for carrying out the present invention will be described in detail below.

[0241] System configuration and program execution order

[0242] The system of the present invention provides a set of functions for receiving requests from users, selecting the optimal computing system, and notifying the user. Specifically, it includes the following main components:

[0243] Request receiving method: Receives application details from users.

[0244] Search method: The system corresponding to the application content is searched from the internal database.

[0245] Notification method: Notify users and robots of the selected computing system and the source of the inquiry.

[0246] Robot notification mechanism: Notifies the robot that received the request of the optimal system and source of the inquiry.

[0247] Storage method: Store authentication information.

[0248] Encryption method: Encrypt the authentication information to be stored.

[0249] Method of provision: Search for stored authentication information and provide it to the robot as needed.

[0250] Hardware and software usage

[0251] This system is designed to work in conjunction with robots located within the factory. The following are specific examples of hardware and software usage:

[0252] Server: The central management server within the factory performs request receiving, searching, notification, storage, encryption, and provisioning functions.

[0253] Database: Internal databases are used to store computer system information, query sources, and authentication information. SQLite is a concrete example.

[0254] Encryption library: The Python cryptography library is used to encrypt authentication information.

[0255] Program processing

[0256] When the server receives a request from a user, it searches its internal database for the most suitable computing system to meet that request. The server promptly notifies the user of the search results, as well as the robot that received the request. If the robot requires authentication information, the server provides it in encrypted form. These features enable the robot to efficiently utilize multiple systems and obtain authentication information securely and quickly.

[0257] Specific example

[0258] For example, consider a scenario where robot A in a factory wants to procure parts using a parts supply system. Robot A sends a request to a server. Upon receiving this request, the server searches its database for the most suitable computing system for the parts supply system and notifies robot A of the result. If necessary, it also provides robot A with encrypted authentication information. This allows robot A to procure parts quickly and improve production efficiency.

[0259] Example of a prompt

[0260] An example of a prompt for the generated AI model is: "Create a program that searches for the optimal system and contact information when a robot operating in a factory wants to use a parts supply system, and notifies the robot of that information. Also, ensure that it can store and retrieve authentication information."

[0261] The above describes specific embodiments for carrying out the present invention. This invention makes it possible for robots in factories to efficiently utilize a variety of systems and perform tasks safely and quickly.

[0262] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0263] Step 1:

[0264] A user sends a request to a server to use a specific service (e.g., a "parts supply system"). The request contains the details of the application. The server receives this request through a request receiving mechanism. The input is the user's request, and the output is the received request content.

[0265] Step 2:

[0266] The server searches its internal database for the most suitable computing system based on the received request. This search is performed using a search mechanism. The input is the received request, and the output is information about the best computing system found.

[0267] Step 3:

[0268] The server notifies the user of the best-finded computing system through a notification system. The input is information about the searched computing system, and the output is the notification sent to the user.

[0269] Step 4:

[0270] The server then searches its internal database for the source of the query for the relevant computing system. This search is also performed using a search mechanism. The input is information about the optimal computing system, and the output is information about the query source.

[0271] Step 5:

[0272] The server notifies the user of the source of the inquiry through a notification system. The input is the source of the inquiry, and the output is the notification content sent to the user.

[0273] Step 6:

[0274] The robot that receives the request sends a request to the server to obtain the necessary authentication information. The server receives this request and retrieves the authentication information from its internal database. The input is the request from the robot, and the output is the stored authentication information.

[0275] Step 7:

[0276] The server encrypts the retrieved authentication information and provides it to the robot. This process is carried out using encryption and provisioning methods. The input is the stored authentication information, and the output is the encrypted authentication information.

[0277] Step 8:

[0278] The server notifies the robot that sent the request of the encrypted authentication information obtained as a result of the processing via the robot notification mechanism. The input is the encrypted authentication information, and the output is the content of the notification to the robot.

[0279] The above describes the system's processing flow based on an application example. This enables robots within a factory to efficiently utilize the computer system and obtain necessary authentication information safely and quickly.

[0280] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0281] The system of the present invention assists users in selecting the optimal system when using multiple internal systems, enabling them to perform their tasks quickly and accurately. Furthermore, the system incorporates an emotion engine that recognizes the user's emotions and adjusts its response accordingly. Specific embodiments are described below.

[0282] 1. System Configuration

[0283] The system of the present invention includes the following main components:

[0284] Request receiving means: Receives the application content and requests from users.

[0285] Search means: Searches for the corresponding system in the internal database according to the application content.

[0286] Notification means: Notifies the user of the optimal system and the corresponding inquiry destination.

[0287] Storage means: Stores the authentication information of the user.

[0288] Search means: Searches for the stored authentication information.

[0289] Provision means: Provides the search results to the user.

[0290] Encryption means: Encrypts and stores the authentication information.

[0291] Emotion engine: Recognizes the emotions of the user and selects the optimal response based on them.

[0292] 2. Operation method of the system

[0293] The process by which the user operates the system is as follows.

[0294] Request reception:

[0295] The user uses the terminal to input a request such as "leave application" and sends it to the support system.

[0296] System selection:

[0297] The server receives the request and searches for the corresponding system in the internal database (here, searches for the "leave management system").

[0298] The server notifies the user of the selected system.

[0299] Inquiry destination notification:

[0300] The server searches the internal database for inquiry destinations related to the "Vacation Management System" and notifies the user of the "Personnel Department".

[0301] Storage of authentication information:

[0302] The user inputs authentication information (ID and password) for the "Vacation Management System" and sends a storage request to the system.

[0303] The server stores the authentication information using encryption means and notifies the user of the result.

[0304] Obtaining authentication information:

[0305] The user sends a request to obtain previously stored authentication information.

[0306] The server searches for the stored authentication information and provides the result to the user.

[0307] If the server cannot find the relevant information, it notifies the user to that effect. <00​​​​​​​​​​​​​​​​​Furthermore, if we determine from the user's facial expression that they are dissatisfied, we will promptly encourage them to contact a support representative.

[0313] 3. Specific Examples

[0314] For example, the procedure for a user to submit a "leave request" is as follows:

[0315] 1. The user enters a "leave request" and submits the request to the support system.

[0316] 2. The server receives the request, searches for and selects the "vacation management system," and notifies the user.

[0317] 3. The server searches for the contact information for inquiries regarding the "Leave Management System" and notifies the user of the "Human Resources Department".

[0318] Next, the procedure for users to save their credentials is as follows:

[0319] 1. The user enters their ID and password for the "Leave Management System" and submits a save request.

[0320] 2. The server receives the request, encrypts and stores the authentication information, and notifies the user of the result.

[0321] Furthermore, the procedure for users to utilize the emotion engine is as follows:

[0322] 1. The user inputs voice and facial expression data using the microphone and camera on their device.

[0323] 2. The server's emotion engine analyzes this and recognizes the user's emotions.

[0324] 3. The server provides the user with the most appropriate response based on the emotions it recognizes.

[0325] These features allow users to quickly and accurately identify the most suitable system or contact point, while also managing their authentication information securely. Furthermore, by utilizing an emotion engine, users can receive appropriate support tailored to their emotions.

[0326] The following describes the processing flow.

[0327] When a user submits a leave request

[0328] Step 1:

[0329] The user uses their device to type "leave request" and sends the request to the support system.

[0330] Step 2:

[0331] The server receives the request.

[0332] Step 3:

[0333] Based on the application received by the server, it searches the internal database for the corresponding system (in this case, the "Leave Management System").

[0334] Step 4:

[0335] The server selects the most suitable system, the "vacation management system," based on the search results and notifies the user of that information.

[0336] Step 5:

[0337] The server then searches its internal database for contact information related to the "vacation management system."

[0338] Step 6:

[0339] The server finds the contact point, "Human Resources Department," and notifies the user of that information.

[0340] When saving authentication information

[0341] Step 1:

[0342] The user uses a terminal to enter their ID and password for the "Leave Management System" and sends a request to the support system to save their authentication information.

[0343] Step 2:

[0344] The server receives this request.

[0345] Step 3:

[0346] The server encrypts the received ID and password.

[0347] Step 4:

[0348] The server stores encrypted authentication information in its internal database.

[0349] Step 5:

[0350] The server notifies the user of the saved results.

[0351] When obtaining authentication information

[0352] Step 1:

[0353] The user uses their device to send a request to retrieve previously saved credentials for the "Leave Management System".

[0354] Step 2:

[0355] The server receives this request.

[0356] Step 3:

[0357] The server searches its internal database for the corresponding authentication information.

[0358] Step 4:

[0359] The server provides the user with the relevant authentication information based on the search results (in this case, the information is decrypted before being provided).

[0360] Step 5:

[0361] If the server cannot find the corresponding authentication information, it will notify the user accordingly.

[0362] When using an emotion engine

[0363] Step 1:

[0364] The user inputs voice and facial expression data using the microphone and camera on their device.

[0365] Step 2:

[0366] The server's emotion engine analyzes the input data and recognizes the user's emotional state.

[0367] Step 3:

[0368] The server selects the most appropriate response based on the emotions it perceives.

[0369] Step 4:

[0370] The server will be selected and the user will be notified of the corresponding action.

[0371] Specific example

[0372] For example, here is a specific example of when a user submits a "leave request":

[0373] 1. The user enters a "leave request" and submits the request to the support system.

[0374] 2. The server receives the request, searches for and selects the "vacation management system," and notifies the user of that information.

[0375] 3. The server searches for the contact person for inquiries regarding the "Leave Management System" and notifies the "Human Resources Department".

[0376] Next, here is a specific example of when a user saves their authentication information:

[0377] 1. The user enters their ID and password for the "Leave Management System" and submits a save request.

[0378] 2. The server receives the request, encrypts and stores the authentication information, and notifies the result.

[0379] Furthermore, specific examples of how users utilize the emotion engine are as follows:

[0380] 1. The user inputs voice and facial expression data using the microphone and camera on their device.

[0381] 2. The server's emotion engine analyzes the user's voice, for example, and if it detects stress, it analyzes that information.

[0382] 3. Based on the emotions the server recognizes, it will notify the user with suggestions, such as relaxation techniques.

[0383] (Example 2)

[0384] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0385] Currently, it is difficult for users to quickly and accurately select the optimal system when using multiple internal systems. Furthermore, mechanisms for securely managing user authentication information and providing appropriate responses tailored to user emotions are insufficient. As a result, problems such as decreased work efficiency and increased user stress are occurring.

[0386] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0387] In this invention, the server includes a request receiving means for selecting the optimal information processing device based on the user's request; a search means for searching for an information processing device corresponding to the request from internal storage; a notification means for notifying the user of the selected information processing device; a search means for searching for the contact point for the relevant information processing device from internal storage; a notification means for notifying the user of the contact point; and an emotion recognition means for recognizing the user's emotions and adjusting the response accordingly. As a result, the user can not only quickly and accurately identify the optimal system and contact point, but also receive an appropriate response that is in line with their emotions.

[0388] A "request receiving means" is a device or system for receiving application details or requests from users.

[0389] A "search method" refers to a device or system for finding the most suitable information processing device or contact point from internal storage based on the received application content.

[0390] "Notification means" refers to a device or system that informs the user of the retrieved information processing device or contact information.

[0391] An "emotion recognition means" is a device or system that analyzes a user's voice and facial expression data to recognize their emotional state and determine a response appropriate to that state.

[0392] "Storage means" refers to a device or system for storing user authentication information.

[0393] "Means of provision" refers to a device or system for retrieving stored authentication information and providing the results to the user.

[0394] "Encryption means" refers to a device or system for encrypting user authentication information and securely storing that information.

[0395] Modes for carrying out the invention

[0396] The system of the present invention aims to help users quickly and accurately access multiple internal systems. In particular, the system incorporates an emotion engine that recognizes the user's emotions and adjusts its response accordingly.

[0397] Hardware and software to be used

[0398] Server: Responsible for the main processing. Specifically, it handles request reception, system lookups, notifications, query lookups, authentication information storage and retrieval, and sentiment recognition. Database operations and encryption processing are also performed here.

[0399] Terminal: An input device used by a user. This includes PCs and smartphones.

[0400] Internal storage: Connected to the server, including a database that stores system information, contact details, and authentication information.

[0401] Encryption device: Encrypts authentication information using encryption algorithms such as AES or RSA.

[0402] System Configuration

[0403] The system of the present invention includes the following main components:

[0404] Request reception method: Users use their devices to input application details and requests via a browser or dedicated application and send them to the server.

[0405] Search method: After the server receives a request from a user, it searches its internal storage for the corresponding system. SQL queries and NoSQL queries are used as search algorithms.

[0406] Notification method: The server notifies the user of the search results. Information is sent to the user using HTTP responses or WebSockets.

[0407] Inquiry contact search method: The server searches its internal storage for contact information related to the system in question and notifies the user of the results.

[0408] Storage method: The user enters authentication information (ID and password) using a terminal and sends it to the server. The server receives this information, encrypts it using an encryption device, and stores it in its internal storage device.

[0409] Emotion recognition method: User voice and facial expression data are input through the device's microphone and camera and sent to the server. The emotion engine analyzes this data and responds based on the user's emotional state.

[0410] Usage example

[0411] For example, the procedure for a user to submit a "leave request" is as follows:

[0412] 1. The user enters a "leave request" and submits the request to the support system.

[0413] 2. The server receives the request, searches for and selects the "vacation management system," and notifies the user.

[0414] 3. The server searches for the contact information for inquiries regarding the "Leave Management System" and notifies the user of the "Human Resources Department".

[0415] Next, the procedure for users to save their credentials is as follows:

[0416] 1. The user enters their ID and password for the "Leave Management System" and submits a save request.

[0417] 2. The server receives the save request, encrypts and saves the authentication information, and notifies the server of the result.

[0418] Furthermore, the procedure for users to utilize the emotion engine is as follows:

[0419] 1. The user inputs voice and facial expression data using the microphone and camera on their device.

[0420] 2. The server's emotion engine analyzes this and recognizes the user's emotions.

[0421] 3. The server provides the user with the most appropriate response based on the emotions it recognizes.

[0422] Example of a prompt

[0423] The following are specific examples of prompt statements for generative AI models:

[0424] "Please provide a detailed description of the user's vacation request process. In particular, please explain in detail how the request is received, how the system is selected, how contact information is provided, how authentication information is stored and retrieved, and how sentiment recognition and response are handled."

[0425] This allows users to quickly and accurately identify the most suitable system or contact point, as well as receive appropriate responses that are tailored to their emotional needs.

[0426] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0427] Step 1:

[0428] Request Input

[0429] The user uses a terminal to log in to the support system interface. For example, the user enters request information, such as a "leave request," through a browser or dedicated application and presses the "submit" button. This sends the request data to the server. The input is the request information made by the user, and the output is an HTTP request containing the user's input data.

[0430] Step 2:

[0431] Request received

[0432] The server receives a request from the user. Specifically, the server receives an HTTP request and parses its contents. The request data is temporarily stored in memory. The input is the HTTP request sent by the user, and the output is the parsed request data.

[0433] Step 3:

[0434] System Search

[0435] Based on the request data received by the server, it searches its internal storage for the corresponding information processing device. For example, if the request is "leave request," the server searches for "leave management system." It uses SQL queries or NoSQL queries to retrieve the matching system from the database. The input is the request data, and the output is the search result, "leave management system."

[0436] Step 4:

[0437] System Notification

[0438] The server notifies the user of the search results. Specifically, the server generates a message such as "A vacation management system has been selected" and sends it to the user's terminal. Notifications are made using HTTP responses or WebSockets. The input is the search results, and the output is the notification message to the user.

[0439] Step 5:

[0440] Contact information search

[0441] The server searches its internal storage for contact information related to the "Leave Management System" (e.g., Human Resources Department). The server then uses SQL or NoSQL queries to retrieve the appropriate contact information. The input is information about the "Leave Management System," and the output is the retrieved contact information.

[0442] Step 6:

[0443] Contact information notification

[0444] The server retrieves contact information and notifies the user. HTTP responses and WebSockets are used as notification methods. The input is the contact information, and the output is the notification message to the user.

[0445] Step 7:

[0446] Enter authentication information

[0447] The user enters their authentication information (ID and password) for the "Leave Management System" into the interface and sends a save request. This sends the authentication information to the server. The input is the authentication information entered by the user, and the output is the save request sent to the server.

[0448] Step 8:

[0449] Authentication information storage

[0450] The server receives a save request and encrypts the authentication information. Specifically, it encrypts the authentication information using an encryption algorithm such as AES or RSA, and then saves it to internal storage. Once saving is complete, it notifies the user of the result. The input is the user's authentication information and save request, and the output is the encrypted authentication information and the saving result notification.

[0451] Step 9:

[0452] Authentication information acquisition

[0453] A request is sent to retrieve previously saved authentication information from the user. The user presses the "Retrieve Authentication Information" button to send a request to the server. The input is the user's retrieval request, and the output is the request data sent to the server.

[0454] Step 10:

[0455] Authentication Information Search

[0456] The server searches its internal storage for stored authentication information. If the matching authentication information is found, it is decrypted and provided to the user. If it is not found, the user is notified accordingly. The input is the user's retrieval request and the encrypted authentication information, and the output is the decrypted authentication information or a notification stating "Information not found."

[0457] Step 11:

[0458] Emotional data entry

[0459] The user inputs voice and facial expression data using the microphone and camera on their device. The input data is sent to the server in real time. The input is the user's voice and facial expression data, and the output is the emotion data sent to the server.

[0460] Step 12:

[0461] emotion recognition

[0462] The server's emotion engine analyzes input data and recognizes the user's emotional state. Specifically, it uses machine learning models or deep learning models to identify emotions from voice and facial expressions. The input is the user's voice and facial expression data, and the output is data of the recognized emotional state.

[0463] Step 13:

[0464] Emotion-based responses

[0465] The server provides the user with the most appropriate response based on the emotions it recognizes. For example, if stress is detected, it offers suggestions for relaxation. If the user is feeling dissatisfied, it prompts them to contact support immediately. The input is recognized emotional state data, and the output is suggested responses or notifications to the user.

[0466] (Application Example 2)

[0467] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0468] In factory and other work environments, prompt and accurate responses to various applications and inquiries are required, but reducing the psychological burden on workers is also a crucial issue. While conventional systems can select the most appropriate system and notify contact information based on the application content, they cannot respond based on the emotional state of the workers. Therefore, it is difficult for workers to receive appropriate support when they experience stress or dissatisfaction.

[0469] In Application Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes a request receiving means for selecting the optimal system based on the content of the application from the user, a search means for searching an internal database for a system corresponding to the content of the application, a notification means for notifying the user of the selected system, a search means for searching an internal database for the contact point of the relevant system, a notification means for notifying the user of the contact point, an emotion engine means for recognizing the user's emotions and adjusting the response based on the emotional state, and an image acquisition means for acquiring an image using a camera and providing the image data to the emotion engine. As a result, workers can not only make applications and inquiries quickly and accurately, but also receive appropriate support according to their emotional state.

[0470] A "request receiving means" is a device or function that receives application details from a user and acquires data for processing those details.

[0471] A "search tool" is a device or function that retrieves corresponding information from a predetermined database based on the user's application details.

[0472] "Notification means" refers to a device or function used to communicate information retrieved by the system to the user.

[0473] An "emotion engine" is a device or function that analyzes data such as a user's voice and facial expressions to recognize their emotions and psychological state.

[0474] "Image acquisition means" refers to a device or function that acquires image data using a camera or similar device and processes it.

[0475] "Storage means" refers to a device or function for securely storing user authentication information and other data.

[0476] "Authentication means" refers to a device or function that verifies and grants access rights using authentication information entered by the user.

[0477] "Encryption means" refers to a device or function that prevents unauthorized access by third parties by encrypting stored authentication information and other data.

[0478] "Means of provision" refers to a device or function that provides users with acquired data, such as retrieved information or authentication information.

[0479] This invention is a system that assists users in selecting the optimal system and responding quickly when making various requests or inquiries within a factory. This system includes a request receiving means, a search means, a notification means, an emotion engine means, an image acquisition means, a storage means, an authentication means, an encryption means, and a provision means.

[0480] System Configuration

[0481] The system includes the following main components:

[0482] 1. Request receiving method: Receives application details from the user's terminal (smart glasses).

[0483] 2. Search method: The system corresponding to the request is searched from the internal database.

[0484] 3. Notification method: The user will be notified of the selected system and the appropriate contact point.

[0485] 4. Emotion Engine: Uses cameras and microphones to recognize the user's emotions and adjusts responses accordingly.

[0486] 5. Image acquisition means: Image data is acquired using a camera built into the smart glasses and provided to the emotion engine means.

[0487] 6. Storage method: Store user authentication information.

[0488] 7. Authentication method: Access permission is verified and granted using the user's authentication information.

[0489] 8. Encryption method: Encrypt the stored authentication information.

[0490] 9. Means of delivery: Provide search results and acquired data to the user.

[0491] Operation overview

[0492] When a user uses smart glasses to submit a request or inquiry within the factory, the system operates as follows: First, the user uses the smart glasses to input the request details (e.g., "Request assistance for machine malfunction") and submits the request. The request receiving device receives this request, and the search device searches the internal database for a corresponding system. Once a system is selected, the notification device notifies the user of the selection result and the contact information.

[0493] Furthermore, this system uses the smart glasses' camera and microphone to capture the user's facial expressions and voice in order to recognize the user's emotions and take appropriate action based on their emotional state. The image acquisition means provides this data to the emotion engine means, which analyzes the user's emotional state. For example, if the user is feeling stressed, the emotion engine means will provide suggestions to promote relaxation.

[0494] As a concrete example, consider a scenario where a factory worker requests support regarding a machine malfunction. The user uses smart glasses to type, "The packaging machine on line 5 has malfunctioned. I request technical assistance," and sends the request. The system receives this request, selects the appropriate maintenance system, and notifies the user. Furthermore, it uses a camera to capture the situation on-site, and an emotion engine analyzes this data. If it determines that the user is experiencing significant stress, it immediately prompts them to contact a support representative. Specific examples of prompt messages include the following:

[0495] "Currently, the packaging machine on Line 5 has malfunctioned. We request technical assistance."

[0496] "Error code 123 is being displayed at the site."

[0497] "I'm showing the problem area to the camera on my smart glasses."

[0498] In this way, users can submit applications quickly and accurately, receive appropriate support, and even receive responses tailored to their emotional state.

[0499] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0500] Step 1:

[0501] The user enters the application details using smart glasses. An example of the input is an application requesting assistance with a machine malfunction. This input is sent to the request receiving system via the smart glasses' UI. The input data is in text format and is received by the server.

[0502] Step 2:

[0503] The server receives the application details sent by the user using a request receiving mechanism. Here, the application details are received as a string, and data processing is performed to parse the type of request. The received data is temporarily stored within the system.

[0504] Step 3:

[0505] The server's search mechanism uses an internal database to search for a corresponding system based on the received application content. In this step, keyword matching is performed on the application content to identify the relevant system (e.g., "maintenance system"). The search results are read from the database, and the relevant system is selected.

[0506] Step 4:

[0507] The server's notification system notifies the user of the selected system. At the same time, the system also retrieves the contact information for that system (e.g., "Maintenance Department") from its internal database and notifies the user accordingly. The notification content is sent as a text message to the user's smart glasses.

[0508] Step 5:

[0509] The user uses the camera and microphone on their smart glasses to record the situation on site and sends the data to the server. Audio and video data are input in this step. The input data is sent from the user's device to the server.

[0510] Step 6:

[0511] The server's image acquisition mechanism receives video and audio data sent from the user. The received data is temporarily stored. In this step, data processing such as video data compression and audio data noise reduction is performed.

[0512] Step 7:

[0513] The server's emotion engine analyzes the received video and audio data to recognize the user's emotions. In this step, a generative AI model is used to identify emotions (e.g., "stress" or "dissatisfaction") from the user's facial expressions and voice. The analysis results are output as numerical data.

[0514] Step 8:

[0515] The server determines the appropriate response based on the emotional state recognized by the emotion engine. For example, if the user is feeling stressed, it will offer suggestions for relaxation (e.g., "Take a deep breath"). This response is generated in text format.

[0516] Step 9:

[0517] The server sends the generated response details to the user via a notification system. The response details are displayed as a text notification on the user's smart glasses. This notification ensures that appropriate support is provided.

[0518] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0519] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0520] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0521] [Second Embodiment]

[0522] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0523] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0524] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0525] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0526] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0527] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0528] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0529] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0530] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0531] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0532] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0533] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0534] The system of the present invention helps users select the optimal system when using multiple internal systems, enabling them to perform their tasks quickly and accurately. Specific embodiments are described below.

[0535] 1. System Configuration

[0536] The system of the present invention includes the following main components:

[0537] Request receiving method: Receives application details and requests from users.

[0538] Search method: The system corresponding to the application content is searched from the internal database.

[0539] Notification method: Notify the user of the most suitable system and the appropriate contact point.

[0540] Storage method: Stores user authentication information.

[0541] Search method: Search for saved authentication information.

[0542] Delivery method: Provide search results to the user.

[0543] Encryption method: Authentication information is encrypted and stored.

[0544] 2. How to operate the system

[0545] The user's workflow for operating the system is as follows:

[0546] Request received:

[0547] Users want to perform specific tasks and input the details into the system (for example, "leave request" or "expense reimbursement").

[0548] System selection:

[0549] The server receives requests from users.

[0550] The server searches its internal database for the most suitable system corresponding to the application details.

[0551] The server notifies the user of the selected system.

[0552] Contact information:

[0553] The server searches its internal database for contact information related to the selected system.

[0554] The server will notify the user of the contact information.

[0555] Storing authentication information:

[0556] The user enters authentication information (ID and password) for a specific system and sends a request to save it to the system.

[0557] The server receives the authentication information and stores it using encryption.

[0558] The server notifies the user of the saved results.

[0559] Obtaining authentication information:

[0560] The user sends a request to the system to retrieve previously saved credentials.

[0561] The server searches for stored authentication information and provides the search results to the user.

[0562] If the server cannot find the appropriate authentication information, it will notify the user that the information could not be found.

[0563] 3. Specific Examples

[0564] Specific examples are given below.

[0565] For example, the procedure for a user to submit a "leave request" is as follows:

[0566] 1. The user enters "leave request" and submits a request to the support system.

[0567] 2. The server receives the request and searches its internal database for the "leave management system" corresponding to the "leave request".

[0568] 3. The server selects a "vacation management system" and notifies the user.

[0569] 4. The server then searches for a contact point regarding the "Leave Management System" and notifies the user that it is the "Human Resources Department".

[0570] Next, the procedure for users to save their credentials is as follows:

[0571] 1. The user enters their ID and password for the "Leave Management System" and sends a save request to the support system.

[0572] 2. The server receives the request and stores the authentication information in an encrypted form.

[0573] 3. The server notifies the user of the saved results.

[0574] Furthermore, the procedure for users to obtain their authentication credentials is as follows:

[0575] 1. The user sends a request to retrieve previously saved authentication information for the "Leave Management System".

[0576] 2. The server retrieves the stored authentication information and provides it to the user.

[0577] 3. If the server cannot find the relevant information, it will notify the user accordingly.

[0578] The above describes a specific embodiment for carrying out the present invention. This allows users to quickly identify the optimal system, find the correct contact point, and securely manage their authentication information.

[0579] The following describes the processing flow.

[0580] When a user submits a leave request

[0581] Step 1:

[0582] The user uses their device to type "leave request" and sends the request to the support system.

[0583] Step 2:

[0584] The server receives this request.

[0585] Step 3:

[0586] Based on the application received by the server, it searches the internal database for the corresponding system (in this case, the "Leave Management System").

[0587] Step 4:

[0588] The server selects the most suitable system, the "vacation management system," based on the search results and notifies the user of that information.

[0589] Step 5:

[0590] The server then searches its internal database for contact information related to the "vacation management system."

[0591] Step 6:

[0592] The server finds the contact point, "Human Resources Department," and notifies the user of that information.

[0593] When saving authentication information

[0594] Step 1:

[0595] The user uses a terminal to enter their ID and password for the "Leave Management System" and sends a request to the support system to save their authentication information.

[0596] Step 2:

[0597] The server receives this request.

[0598] Step 3:

[0599] The server encrypts the received ID and password.

[0600] Step 4:

[0601] The server stores encrypted authentication information in its internal database.

[0602] Step 5:

[0603] The server notifies the user of the saved results.

[0604] When obtaining authentication information

[0605] Step 1:

[0606] The user uses their device to send a request to retrieve previously saved credentials for the "Leave Management System".

[0607] Step 2:

[0608] The server receives this request.

[0609] Step 3:

[0610] The server searches its internal database for the corresponding authentication information.

[0611] Step 4:

[0612] The server provides the user with the relevant authentication information based on the search results (in this case, the information is decrypted before being provided).

[0613] Step 5:

[0614] If the server cannot find the corresponding authentication information, it will notify the user accordingly.

[0615] These steps allow users to quickly and accurately learn the optimal way to use the system and who to contact for support, while also enabling them to manage their authentication information securely.

[0616] (Example 1)

[0617] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0618] In today's business environment, users need to efficiently utilize multiple internal systems. However, these systems each require different authentication credentials, making it difficult to determine which system to use. Furthermore, finding the appropriate contact point is time-consuming, hindering work efficiency. Therefore, there is a need for a system that helps users quickly and accurately select the optimal system and perform their tasks effectively.

[0619] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0620] In this invention, the server includes a request receiving means for selecting the optimal means based on the user's application; a search means for searching for means corresponding to the application from internal storage; a notification means for notifying the user of the selected means; a search means for searching for the contact point for the relevant means from internal storage; a notification means for notifying the user of the contact point; a storage means for storing the user's authentication information; a search means for searching the stored authentication information; a providing means for providing the search results to the user; and an encryption means for encrypting and storing the authentication information. This enables the user to efficiently select the optimal system, obtain appropriate contact information, and securely manage their authentication information.

[0621] A "user" refers to an individual or group that performs operations or inputs into a system.

[0622] "Application details" refers to the detailed information of a specific request or task that a user submits to the system.

[0623] "Optimal means" refers to systems and services that best suit the user's application and respond efficiently.

[0624] "Request receiving means" refers to a process or device for receiving requests sent by a user.

[0625] "Search means" refers to a process or device for retrieving information from an internal storage device based on specific conditions.

[0626] "Notification means" refers to a process or device for conveying retrieved information or systems to the user.

[0627] "Internal storage device" refers to a storage medium or system that can store data and retrieve it as needed.

[0628] "Contact point" refers to the department or person responsible for providing additional information and support regarding the selected system.

[0629] "Storage means" refers to a process or device for securely storing user authentication information.

[0630] "Means of provision" refers to a process or device for providing search results to a user.

[0631] "Encryption means" refers to a process or device that encrypts data in order to protect user authentication information from unauthorized access.

[0632] This invention provides a system for users to efficiently utilize multiple internal systems, and in particular, it has functions to quickly and accurately select the optimal system, notify contact information, and store and retrieve authentication information. This system consists of a server including request receiving means, search means, notification means, storage means, provision means, and encryption means.

[0633] The following are the main components for generating the program for this system:

[0634] 1. Method of receiving requests:

[0635] Users want to perform a specific task and input the details into the system. They use a terminal to input the task details (e.g., "leave request," "expense reimbursement") and send a request to the server. Typical devices used are PCs and smartphones.

[0636] 2. Search methods:

[0637] The server receives a request and searches its internal database for the system best suited to the request. SQL or NoSQL databases are used. For example, if the server receives a "leave request," it uses an SQL query to search for the "leave management system."

[0638] 3. Means of notification:

[0639] The server notifies the user of the selected system. It returns information to the user using an HTTP response. Furthermore, it searches for and notifies the contact person for inquiries regarding the relevant system. For example, it might notify the user that the "Human Resources Department" is the contact person for inquiries regarding the "Leave Management System".

[0640] 4. Preservation means:

[0641] The user enters authentication information (ID and password) for a specific system and sends a save request to the server. The server receives the authentication information and stores it using encryption.

[0642] 5. Means of provision:

[0643] The user sends a request to retrieve previously saved credentials. The server searches for the saved credentials and provides the search results to the user. If no suitable credentials are found, the server notifies the user accordingly.

[0644] 6. Encryption methods:

[0645] The server encrypts authentication information using encryption algorithms such as AES and stores it in an internal database. This process ensures that user authentication information is managed securely.

[0646] Specific example:

[0647] For example, the procedure for a user to submit a "leave request" is as follows:

[0648] 1. The user enters "leave request" and submits the request to the system.

[0649] 2. The server receives the request and searches its internal database for the "leave management system" corresponding to the "leave request".

[0650] 3. The server selects a "vacation management system" and notifies the user.

[0651] 4. The server then searches for a contact point regarding the "Leave Management System" and notifies the user that it is the "Human Resources Department".

[0652] Next, the procedure for users to save their credentials is as follows:

[0653] 1. The user enters their ID and password for the "Leave Management System" and sends a save request to the support system.

[0654] 2. The server receives the request and encrypts the authentication information using the AES encryption algorithm.

[0655] 3. The server stores encrypted authentication information in an internal database.

[0656] 4. The server notifies the user of the saved results.

[0657] Furthermore, the procedure for users to obtain their authentication credentials is as follows:

[0658] 1. The user sends a request to retrieve previously saved authentication information for the "Leave Management System".

[0659] 2. The server retrieves the stored authentication information from its internal database and provides it to the user.

[0660] 3. If the server cannot find the relevant information, it will notify the user accordingly.

[0661] This system allows users to efficiently select the optimal system, obtain appropriate contact information, and securely manage their authentication information.

[0662] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0663] Step 1:

[0664] The user uses a terminal to input the details of the task they want to perform and sends a request to the server. Input: Task details (e.g., "Leave Request"). Output: Request data sent to the server.

[0665] Specific actions:

[0666] The user fills in the details of their work, such as "leave request," in the input form on the terminal and clicks the "submit" button. The terminal sends this input data to the server as an HTTP POST request.

[0667] Step 2:

[0668] The server receives requests from users and parses their contents. Input: Request data. Output: Parsing result (e.g., "Leave Request").

[0669] Specific actions:

[0670] The server receives an HTTP POST request, extracts the business details from the data, and parses it. For example, the request data is received in JSON format as {"request": "leave request"}, and the server uses a JSON parser to extract the keyword "leave request".

[0671] Step 3:

[0672] The server searches its internal database to find the most suitable system for the application. Input: Analysis result (e.g., "Leave Request"). Output: Optimal system information (e.g., "Leave Management System").

[0673] Specific actions:

[0674] The server generates an SQL query and searches the database. For example, it executes a query like SELECT FROM systems WHERE request = 'Leave Request' to retrieve records corresponding to "Leave Management System".

[0675] Step 4:

[0676] The server notifies the user of the selected system. Input: Optimal system information (e.g., "Leave Management System"). Output: Notification content to the user.

[0677] Specific actions:

[0678] The server returns the selected system information to the user as an HTTP response. For example, the response body might say, "Please use the 'Leave Management System' for your leave requests."

[0679] Step 5:

[0680] The server searches its internal database for contact information related to the system in question. Input: Optimal system information (e.g., "Leave Management System"). Output: Contact information (e.g., "Human Resources Department").

[0681] Specific actions:

[0682] The server generates an SQL query to search for the contact information. For example, it executes a query like SELECT FROM contacts WHERE system = 'Leave Management System' to retrieve records corresponding to "Human Resources Department".

[0683] Step 6:

[0684] The server notifies the user of the contact information. Input: Contact information (e.g., "Human Resources Department"). Output: Content of the notification to the user.

[0685] Specific actions:

[0686] The server returns the retrieved contact information to the user as an HTTP response. For example, it might say, "Please direct inquiries regarding the 'Leave Management System' to the 'Human Resources Department'."

[0687] Step 7:

[0688] The user enters authentication information (ID and password) for a specific system and sends a save request to the server. Input: Authentication information (e.g., ID, password). Output: Save request sent to the server.

[0689] Specific actions:

[0690] The user enters authentication information for the "Leave Management System" into the input form on the terminal and clicks the "Save" button. The terminal sends this data to the server as an HTTP POST request.

[0691] Step 8:

[0692] The server receives the request and encrypts the authentication information. Input: Saved request (authentication information). Output: Encrypted authentication information.

[0693] Specific actions:

[0694] The server receives an HTTP POST request and encrypts the received authentication information using the AES encryption algorithm. The encrypted data is then temporarily stored in memory.

[0695] Step 9:

[0696] The server stores encrypted authentication information in the database. Input: Encrypted authentication information. Output: Saved result.

[0697] Specific actions:

[0698] The server generates an INSERT statement and saves the encrypted authentication information to the database. For example, it executes a query such as INSERT INTO credentials (system, id, password) VALUES ('Leave Management System', 'encrypted_id', 'encrypted_password').

[0699] Step 10:

[0700] The server notifies the user of the saved result. Input: Saved result. Output: Notification content to the user.

[0701] Specific actions:

[0702] If the saving process is successful, the server will notify the user of the result via an HTTP response. For example, it might state, "Authentication information saved successfully."

[0703] Step 11:

[0704] The user sends a request to the server to retrieve previously saved authentication information. Input: System name (e.g., "Leave Management System"). Output: Retrieval request sent to the server.

[0705] Specific actions:

[0706] The user enters the system name into the input form on the terminal and clicks the "Get" button. The terminal sends this data to the server as an HTTP POST request.

[0707] Step 12:

[0708] The server receives the request and retrieves the stored authentication information from its internal database. Input: Retrieval request (system name). Output: Search results (encrypted authentication information).

[0709] Specific actions:

[0710] The server parses the received request and searches its internal database for the authentication information of the relevant system. For example, it might execute a query like SELECT FROM credentials WHERE system = 'Leave Management System'.

[0711] Step 13:

[0712] The server provides the retrieved authentication information to the user. Input: Search results (encrypted authentication information). Output: Notification content to the user.

[0713] Specific actions:

[0714] The server decrypts the search results and provides them to the user. For example, it might display "ID: decrypted_id, Password: decrypted_password".

[0715] Step 14:

[0716] The server notifies the user if no matching information is found. Input: Search results (no results found). Output: Notification sent to the user.

[0717] Specific actions:

[0718] If the server cannot find the corresponding authentication credentials, it will notify the user via an HTTP response. For example, it might state, "Certificate credentials could not be found."

[0719] (Application Example 1)

[0720] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0721] Robots operating in factories need to work in conjunction with numerous different systems. However, currently, selecting the optimal system for each robot and obtaining authentication information quickly is difficult, leading to decreased work efficiency. Furthermore, secure management of authentication information is also required.

[0722] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0723] In this invention, the server includes: a request receiving means for selecting the optimal computer system based on the user's application; a search means for searching an internal database for a computer system corresponding to the application; a notification means for notifying the user of the selected computer system; a search means for searching an internal database for the source of the inquiry for the relevant computer system; a notification means for notifying the user of the source of the inquiry; a robot notification means for notifying the robot that received the request of the optimal system and source of the inquiry; a storage means for storing authentication information; an encryption means for encrypting and storing the stored authentication information; and a provision means for searching the stored authentication information and providing it to the robot as needed. This enables the robot to efficiently utilize multiple systems, safely and quickly acquire the necessary authentication information, and perform its tasks.

[0724] "User" refers to the factory operators or robots that utilize this system.

[0725] "Application details" refers to the specific tasks or operations that the user requests from the system.

[0726] An "optimal computing system" refers to a system that provides the most suitable response to the user's request.

[0727] A "request receiving method" is a means of receiving application details from a user.

[0728] A "search method" is a means of searching for a computer system corresponding to the application content within an internal database.

[0729] "Notification means" refers to the means of communicating selected computing systems and inquiry source information to users or robots.

[0730] "Inquiry source" refers to the organization or contact that receives inquiries related to computer systems.

[0731] A "robot notification method" is a means of notifying a robot that has received a request of the optimal system and source of the inquiry.

[0732] "Storage means" refers to means of storing authentication information for robots and users.

[0733] "Encryption means" refers to a method for encrypting the authentication information that is stored.

[0734] "Means of provision" refers to means of searching for stored authentication information and providing it to the robot as needed.

[0735] Modes for carrying out the invention

[0736] The embodiments for carrying out the present invention will be described in detail below.

[0737] System configuration and program execution order

[0738] The system of the present invention provides a set of functions for receiving requests from users, selecting the optimal computing system, and notifying the user. Specifically, it includes the following main components:

[0739] Request receiving method: Receives application details from users.

[0740] Search method: The system corresponding to the application content is searched from the internal database.

[0741] Notification method: Notify users and robots of the selected computing system and the source of the inquiry.

[0742] Robot notification mechanism: Notifies the robot that received the request of the optimal system and source of the inquiry.

[0743] Storage method: Store authentication information.

[0744] Encryption method: Encrypt the authentication information to be stored.

[0745] Method of provision: Search for stored authentication information and provide it to the robot as needed.

[0746] Hardware and software usage

[0747] This system is designed to work in conjunction with robots located within the factory. The following are specific examples of hardware and software usage:

[0748] Server: The central management server within the factory performs request receiving, searching, notification, storage, encryption, and provisioning functions.

[0749] Database: Internal databases are used to store computer system information, query sources, and authentication information. SQLite is a concrete example.

[0750] Encryption library: The Python cryptography library is used to encrypt authentication information.

[0751] Program processing

[0752] When the server receives a request from a user, it searches its internal database for the most suitable computing system to meet that request. The server promptly notifies the user of the search results, as well as the robot that received the request. If the robot requires authentication information, the server provides it in encrypted form. These features enable the robot to efficiently utilize multiple systems and obtain authentication information securely and quickly.

[0753] Specific example

[0754] For example, consider a scenario where robot A in a factory wants to procure parts using a parts supply system. Robot A sends a request to a server. Upon receiving this request, the server searches its database for the most suitable computing system for the parts supply system and notifies robot A of the result. If necessary, it also provides robot A with encrypted authentication information. This allows robot A to procure parts quickly and improve production efficiency.

[0755] Example of a prompt

[0756] An example of a prompt for the generated AI model is: "Create a program that searches for the optimal system and contact information when a robot operating in a factory wants to use a parts supply system, and notifies the robot of that information. Also, ensure that it can store and retrieve authentication information."

[0757] The above describes specific embodiments for carrying out the present invention. This invention makes it possible for robots in factories to efficiently utilize a variety of systems and perform tasks safely and quickly.

[0758] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0759] Step 1:

[0760] A user sends a request to a server to use a specific service (e.g., a "parts supply system"). The request contains the details of the application. The server receives this request through a request receiving mechanism. The input is the user's request, and the output is the received request content.

[0761] Step 2:

[0762] The server searches its internal database for the most suitable computing system based on the received request. This search is performed using a search mechanism. The input is the received request, and the output is information about the best computing system found.

[0763] Step 3:

[0764] The server notifies the user of the best-finded computing system through a notification system. The input is information about the searched computing system, and the output is the notification sent to the user.

[0765] Step 4:

[0766] The server then searches its internal database for the source of the query for the relevant computing system. This search is also performed using a search mechanism. The input is information about the optimal computing system, and the output is information about the query source.

[0767] Step 5:

[0768] The server notifies the user of the source of the inquiry through a notification system. The input is the source of the inquiry, and the output is the notification content sent to the user.

[0769] Step 6:

[0770] The robot that receives the request sends a request to the server to obtain the necessary authentication information. The server receives this request and retrieves the authentication information from its internal database. The input is the request from the robot, and the output is the stored authentication information.

[0771] Step 7:

[0772] The server encrypts the retrieved authentication information and provides it to the robot. This process is carried out using encryption and provisioning methods. The input is the stored authentication information, and the output is the encrypted authentication information.

[0773] Step 8:

[0774] The server notifies the robot that sent the request of the encrypted authentication information obtained as a result of the processing via the robot notification mechanism. The input is the encrypted authentication information, and the output is the content of the notification to the robot.

[0775] The above describes the system's processing flow based on an application example. This enables robots within a factory to efficiently utilize the computer system and obtain necessary authentication information safely and quickly.

[0776] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0777] The system of the present invention assists users in selecting the optimal system when using multiple internal systems, enabling them to perform their tasks quickly and accurately. Furthermore, the system incorporates an emotion engine that recognizes the user's emotions and adjusts its response accordingly. Specific embodiments are described below.

[0778] 1. System Configuration

[0779] The system of the present invention includes the following main components:

[0780] Request receiving method: Receives application details and requests from users.

[0781] Search method: The system corresponding to the application content is searched from the internal database.

[0782] Notification method: Notify the user of the most suitable system and the appropriate contact point.

[0783] Storage method: Stores user authentication information.

[0784] Search method: Search for saved authentication information.

[0785] Delivery method: Provide search results to the user.

[0786] Encryption method: Authentication information is encrypted and stored.

[0787] Emotion Engine: Recognizes the user's emotions and selects the optimal response based on them.

[0788] 2. How to operate the system

[0789] The user's workflow for operating the system is as follows:

[0790] Request received:

[0791] Users use their devices to enter requests such as "leave requests" and send them to the support system.

[0792] System selection:

[0793] The server receives the request and searches its internal database for the corresponding system (in this case, it searches for the "Leave Management System").

[0794] The server notifies the user of the selected system.

[0795] Contact information:

[0796] The server searches its internal database for contact information related to the "Leave Management System" and notifies the user of the "Human Resources Department".

[0797] Storing authentication information:

[0798] The user enters their authentication information (ID and password) for the "vacation management system" and sends a save request to the system.

[0799] The server stores authentication information using encryption and notifies the user of the result.

[0800] Obtaining authentication information:

[0801] The user sends a request to retrieve previously saved credentials.

[0802] The server searches for stored authentication information and provides the results to the user.

[0803] If the server cannot find the relevant information, it will notify the user accordingly.

[0804] Emotion recognition and response:

[0805] Users input voice and facial expression data through the microphone and camera on their device.

[0806] The server's emotion engine analyzes the input data and recognizes the user's emotional state.

[0807] For example, if the emotion engine detects stress from the user's voice, it will offer the user suggestions for relaxation.

[0808] Furthermore, if we determine from the user's facial expression that they are dissatisfied, we will promptly encourage them to contact a support representative.

[0809] 3. Specific Examples

[0810] For example, the procedure for a user to submit a "leave request" is as follows:

[0811] 1. The user enters a "leave request" and submits the request to the support system.

[0812] 2. The server receives the request, searches for and selects the "vacation management system," and notifies the user.

[0813] 3. The server searches for the contact information for inquiries regarding the "Leave Management System" and notifies the user of the "Human Resources Department".

[0814] Next, the procedure for users to save their credentials is as follows:

[0815] 1. The user enters their ID and password for the "Leave Management System" and submits a save request.

[0816] 2. The server receives the request, encrypts and stores the authentication information, and notifies the user of the result.

[0817] Furthermore, the procedure for users to utilize the emotion engine is as follows:

[0818] 1. The user inputs voice and facial expression data using the microphone and camera on their device.

[0819] 2. The server's emotion engine analyzes this and recognizes the user's emotions.

[0820] 3. The server provides the user with the most appropriate response based on the emotions it recognizes.

[0821] These features allow users to quickly and accurately identify the most suitable system or contact point, while also managing their authentication information securely. Furthermore, by utilizing an emotion engine, users can receive appropriate support tailored to their emotions.

[0822] The following describes the processing flow.

[0823] When a user submits a leave request

[0824] Step 1:

[0825] The user uses their device to type "leave request" and sends the request to the support system.

[0826] Step 2:

[0827] The server receives the request.

[0828] Step 3:

[0829] Based on the application received by the server, it searches the internal database for the corresponding system (in this case, the "Leave Management System").

[0830] Step 4:

[0831] The server selects the most suitable system, the "vacation management system," based on the search results and notifies the user of that information.

[0832] Step 5:

[0833] The server then searches its internal database for contact information related to the "vacation management system."

[0834] Step 6:

[0835] The server finds the contact point, "Human Resources Department," and notifies the user of that information.

[0836] When saving authentication information

[0837] Step 1:

[0838] The user uses a terminal to enter their ID and password for the "Leave Management System" and sends a request to the support system to save their authentication information.

[0839] Step 2:

[0840] The server receives this request.

[0841] Step 3:

[0842] The server encrypts the received ID and password.

[0843] Step 4:

[0844] The server stores encrypted authentication information in its internal database.

[0845] Step 5:

[0846] The server notifies the user of the saved results.

[0847] When obtaining authentication information

[0848] Step 1:

[0849] The user uses their device to send a request to retrieve previously saved credentials for the "Leave Management System".

[0850] Step 2:

[0851] The server receives this request.

[0852] Step 3:

[0853] The server searches its internal database for the corresponding authentication information.

[0854] Step 4:

[0855] The server provides the user with the relevant authentication information based on the search results (in this case, the information is decrypted before being provided).

[0856] Step 5:

[0857] If the server cannot find the corresponding authentication information, it will notify the user accordingly.

[0858] When using an emotion engine

[0859] Step 1:

[0860] The user inputs voice and facial expression data using the microphone and camera on their device.

[0861] Step 2:

[0862] The server's emotion engine analyzes the input data and recognizes the user's emotional state.

[0863] Step 3:

[0864] The server selects the most appropriate response based on the emotions it perceives.

[0865] Step 4:

[0866] The server will be selected and the user will be notified of the corresponding action.

[0867] Specific example

[0868] For example, here is a specific example of when a user submits a "leave request":

[0869] 1. The user enters a "leave request" and submits the request to the support system.

[0870] 2. The server receives the request, searches for and selects the "vacation management system," and notifies the user of that information.

[0871] 3. The server searches for the contact person for inquiries regarding the "Leave Management System" and notifies the "Human Resources Department".

[0872] Next, here is a specific example of when a user saves their authentication information:

[0873] 1. The user enters their ID and password for the "Leave Management System" and submits a save request.

[0874] 2. The server receives the request, encrypts and stores the authentication information, and notifies the result.

[0875] Furthermore, specific examples of how users utilize the emotion engine are as follows:

[0876] 1. The user inputs voice and facial expression data using the microphone and camera on their device.

[0877] 2. The server's emotion engine analyzes the user's voice, for example, and if it detects stress, it analyzes that information.

[0878] 3. Based on the emotions the server recognizes, it will notify the user with suggestions, such as relaxation techniques.

[0879] (Example 2)

[0880] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0881] Currently, it is difficult for users to quickly and accurately select the optimal system when using multiple internal systems. Furthermore, mechanisms for securely managing user authentication information and providing appropriate responses tailored to user emotions are insufficient. As a result, problems such as decreased work efficiency and increased user stress are occurring.

[0882] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0883] In this invention, the server includes a request receiving means for selecting the optimal information processing device based on the user's request; a search means for searching for an information processing device corresponding to the request from internal storage; a notification means for notifying the user of the selected information processing device; a search means for searching for the contact point for the relevant information processing device from internal storage; a notification means for notifying the user of the contact point; and an emotion recognition means for recognizing the user's emotions and adjusting the response accordingly. As a result, the user can not only quickly and accurately identify the optimal system and contact point, but also receive an appropriate response that is in line with their emotions.

[0884] A "request receiving means" is a device or system for receiving application details or requests from users.

[0885] A "search method" refers to a device or system for finding the most suitable information processing device or contact point from internal storage based on the received application content.

[0886] "Notification means" refers to a device or system that informs the user of the retrieved information processing device or contact information.

[0887] An "emotion recognition means" is a device or system that analyzes a user's voice and facial expression data to recognize their emotional state and determine a response appropriate to that state.

[0888] "Storage means" refers to a device or system for storing user authentication information.

[0889] "Means of provision" refers to a device or system for retrieving stored authentication information and providing the results to the user.

[0890] "Encryption means" refers to a device or system for encrypting user authentication information and securely storing that information.

[0891] Modes for carrying out the invention

[0892] The system of the present invention aims to help users quickly and accurately access multiple internal systems. In particular, the system incorporates an emotion engine that recognizes the user's emotions and adjusts its response accordingly.

[0893] Hardware and software to be used

[0894] Server: Responsible for the main processing. Specifically, it handles request reception, system lookups, notifications, query lookups, authentication information storage and retrieval, and sentiment recognition. Database operations and encryption processing are also performed here.

[0895] Terminal: An input device used by a user. This includes PCs and smartphones.

[0896] Internal storage: Connected to the server, including a database that stores system information, contact details, and authentication information.

[0897] Encryption device: Encrypts authentication information using encryption algorithms such as AES or RSA.

[0898] System Configuration

[0899] The system of the present invention includes the following main components:

[0900] Request reception method: Users use their devices to input application details and requests via a browser or dedicated application and send them to the server.

[0901] Search method: After the server receives a request from a user, it searches its internal storage for the corresponding system. SQL queries and NoSQL queries are used as search algorithms.

[0902] Notification method: The server notifies the user of the search results. Information is sent to the user using HTTP responses or WebSockets.

[0903] Inquiry contact search method: The server searches its internal storage for contact information related to the system in question and notifies the user of the results.

[0904] Storage method: The user enters authentication information (ID and password) using a terminal and sends it to the server. The server receives this information, encrypts it using an encryption device, and stores it in its internal storage device.

[0905] Emotion recognition method: User voice and facial expression data are input through the device's microphone and camera and sent to the server. The emotion engine analyzes this data and responds based on the user's emotional state.

[0906] Usage example

[0907] For example, the procedure for a user to submit a "leave request" is as follows:

[0908] 1. The user enters a "leave request" and submits the request to the support system.

[0909] 2. The server receives the request, searches for and selects the "vacation management system," and notifies the user.

[0910] 3. The server searches for the contact information for inquiries regarding the "Leave Management System" and notifies the user of the "Human Resources Department".

[0911] Next, the procedure for users to save their credentials is as follows:

[0912] 1. The user enters their ID and password for the "Leave Management System" and submits a save request.

[0913] 2. The server receives the save request, encrypts and saves the authentication information, and notifies the server of the result.

[0914] Furthermore, the procedure for users to utilize the emotion engine is as follows:

[0915] 1. The user inputs voice and facial expression data using the microphone and camera on their device.

[0916] 2. The server's emotion engine analyzes this and recognizes the user's emotions.

[0917] 3. The server provides the user with the most appropriate response based on the emotions it recognizes.

[0918] Example of a prompt

[0919] The following are specific examples of prompt statements for generative AI models:

[0920] "Please provide a detailed description of the user's vacation request process. In particular, please explain in detail how the request is received, how the system is selected, how contact information is provided, how authentication information is stored and retrieved, and how sentiment recognition and response are handled."

[0921] This allows users to quickly and accurately identify the most suitable system or contact point, as well as receive appropriate responses that are tailored to their emotional needs.

[0922] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0923] Step 1:

[0924] Request Input

[0925] The user uses a terminal to log in to the support system interface. For example, the user enters request information, such as a "leave request," through a browser or dedicated application and presses the "submit" button. This sends the request data to the server. The input is the request information made by the user, and the output is an HTTP request containing the user's input data.

[0926] Step 2:

[0927] Request received

[0928] The server receives a request from the user. Specifically, the server receives an HTTP request and parses its contents. The request data is temporarily stored in memory. The input is the HTTP request sent by the user, and the output is the parsed request data.

[0929] Step 3:

[0930] System Search

[0931] Based on the request data received by the server, it searches its internal storage for the corresponding information processing device. For example, if the request is "leave request," the server searches for "leave management system." It uses SQL queries or NoSQL queries to retrieve the matching system from the database. The input is the request data, and the output is the search result, "leave management system."

[0932] Step 4:

[0933] System Notification

[0934] The server notifies the user of the search results. Specifically, the server generates a message such as "A vacation management system has been selected" and sends it to the user's terminal. Notifications are made using HTTP responses or WebSockets. The input is the search results, and the output is the notification message to the user.

[0935] Step 5:

[0936] Contact information search

[0937] The server searches its internal storage for contact information related to the "Leave Management System" (e.g., Human Resources Department). The server then uses SQL or NoSQL queries to retrieve the appropriate contact information. The input is information about the "Leave Management System," and the output is the retrieved contact information.

[0938] Step 6:

[0939] Contact information notification

[0940] The server retrieves contact information and notifies the user. HTTP responses and WebSockets are used as notification methods. The input is the contact information, and the output is the notification message to the user.

[0941] Step 7:

[0942] Enter authentication information

[0943] The user enters their authentication information (ID and password) for the "Leave Management System" into the interface and sends a save request. This sends the authentication information to the server. The input is the authentication information entered by the user, and the output is the save request sent to the server.

[0944] Step 8:

[0945] Authentication information storage

[0946] The server receives a save request and encrypts the authentication information. Specifically, it encrypts the authentication information using an encryption algorithm such as AES or RSA, and then saves it to internal storage. Once saving is complete, it notifies the user of the result. The input is the user's authentication information and save request, and the output is the encrypted authentication information and the saving result notification.

[0947] Step 9:

[0948] Authentication information acquisition

[0949] A request is sent to retrieve previously saved authentication information from the user. The user presses the "Retrieve Authentication Information" button to send a request to the server. The input is the user's retrieval request, and the output is the request data sent to the server.

[0950] Step 10:

[0951] Authentication Information Search

[0952] The server searches its internal storage for stored authentication information. If the matching authentication information is found, it is decrypted and provided to the user. If it is not found, the user is notified accordingly. The input is the user's retrieval request and the encrypted authentication information, and the output is the decrypted authentication information or a notification stating "Information not found."

[0953] Step 11:

[0954] Emotional data entry

[0955] The user inputs voice and facial expression data using the microphone and camera on their device. The input data is sent to the server in real time. The input is the user's voice and facial expression data, and the output is the emotion data sent to the server.

[0956] Step 12:

[0957] emotion recognition

[0958] The server's emotion engine analyzes input data and recognizes the user's emotional state. Specifically, it uses machine learning models or deep learning models to identify emotions from voice and facial expressions. The input is the user's voice and facial expression data, and the output is data of the recognized emotional state.

[0959] Step 13:

[0960] Emotion-based responses

[0961] The server provides the user with the most appropriate response based on the emotions it recognizes. For example, if stress is detected, it offers suggestions for relaxation. If the user is feeling dissatisfied, it prompts them to contact support immediately. The input is recognized emotional state data, and the output is suggested responses or notifications to the user.

[0962] (Application Example 2)

[0963] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0964] In factory and other work environments, prompt and accurate responses to various applications and inquiries are required, but reducing the psychological burden on workers is also a crucial issue. While conventional systems can select the most appropriate system and notify contact information based on the application content, they cannot respond based on the emotional state of the workers. Therefore, it is difficult for workers to receive appropriate support when they experience stress or dissatisfaction.

[0965] In Application Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes a request receiving means for selecting the optimal system based on the content of the application from the user, a search means for searching an internal database for a system corresponding to the content of the application, a notification means for notifying the user of the selected system, a search means for searching an internal database for the contact point of the relevant system, a notification means for notifying the user of the contact point, an emotion engine means for recognizing the user's emotions and adjusting the response based on the emotional state, and an image acquisition means for acquiring an image using a camera and providing the image data to the emotion engine. As a result, workers can not only make applications and inquiries quickly and accurately, but also receive appropriate support according to their emotional state.

[0966] A "request receiving means" is a device or function that receives application details from a user and acquires data for processing those details.

[0967] A "search tool" is a device or function that retrieves corresponding information from a predetermined database based on the user's application details.

[0968] "Notification means" refers to a device or function used to communicate information retrieved by the system to the user.

[0969] An "emotion engine" is a device or function that analyzes data such as a user's voice and facial expressions to recognize their emotions and psychological state.

[0970] "Image acquisition means" refers to a device or function that acquires image data using a camera or similar device and processes it.

[0971] "Storage means" refers to a device or function for securely storing user authentication information and other data.

[0972] "Authentication means" refers to a device or function that verifies and grants access rights using authentication information entered by the user.

[0973] "Encryption means" refers to a device or function that prevents unauthorized access by third parties by encrypting stored authentication information and other data.

[0974] "Means of provision" refers to a device or function that provides users with acquired data, such as retrieved information or authentication information.

[0975] This invention is a system that assists users in selecting the optimal system and responding quickly when making various requests or inquiries within a factory. This system includes a request receiving means, a search means, a notification means, an emotion engine means, an image acquisition means, a storage means, an authentication means, an encryption means, and a provision means.

[0976] System Configuration

[0977] The system includes the following main components:

[0978] 1. Request receiving method: Receives application details from the user's terminal (smart glasses).

[0979] 2. Search method: The system corresponding to the request is searched from the internal database.

[0980] 3. Notification method: The user will be notified of the selected system and the appropriate contact point.

[0981] 4. Emotion Engine: Uses cameras and microphones to recognize the user's emotions and adjusts responses accordingly.

[0982] 5. Image acquisition means: Image data is acquired using a camera built into the smart glasses and provided to the emotion engine means.

[0983] 6. Storage method: Store user authentication information.

[0984] 7. Authentication method: Access permission is verified and granted using the user's authentication information.

[0985] 8. Encryption method: Encrypt the stored authentication information.

[0986] 9. Means of delivery: Provide search results and acquired data to the user.

[0987] Operation overview

[0988] When a user uses smart glasses to submit a request or inquiry within the factory, the system operates as follows: First, the user uses the smart glasses to input the request details (e.g., "Request assistance for machine malfunction") and submits the request. The request receiving device receives this request, and the search device searches the internal database for a corresponding system. Once a system is selected, the notification device notifies the user of the selection result and the contact information.

[0989] Furthermore, this system uses the smart glasses' camera and microphone to capture the user's facial expressions and voice in order to recognize the user's emotions and take appropriate action based on their emotional state. The image acquisition means provides this data to the emotion engine means, which analyzes the user's emotional state. For example, if the user is feeling stressed, the emotion engine means will provide suggestions to promote relaxation.

[0990] As a concrete example, consider a scenario where a factory worker requests support regarding a machine malfunction. The user uses smart glasses to type, "The packaging machine on line 5 has malfunctioned. I request technical assistance," and sends the request. The system receives this request, selects the appropriate maintenance system, and notifies the user. Furthermore, it uses a camera to capture the situation on-site, and an emotion engine analyzes this data. If it determines that the user is experiencing significant stress, it immediately prompts them to contact a support representative. Specific examples of prompt messages include the following:

[0991] "Currently, the packaging machine on Line 5 has malfunctioned. We request technical assistance."

[0992] "Error code 123 is being displayed at the site."

[0993] "I'm showing the problem area to the camera on my smart glasses."

[0994] In this way, users can submit applications quickly and accurately, receive appropriate support, and even receive responses tailored to their emotional state.

[0995] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0996] Step 1:

[0997] The user enters the application details using smart glasses. An example of the input is an application requesting assistance with a machine malfunction. This input is sent to the request receiving system via the smart glasses' UI. The input data is in text format and is received by the server.

[0998] Step 2:

[0999] The server receives the application details sent by the user using a request receiving mechanism. Here, the application details are received as a string, and data processing is performed to parse the type of request. The received data is temporarily stored within the system.

[1000] Step 3:

[1001] The server's search mechanism uses an internal database to search for a corresponding system based on the received application content. In this step, keyword matching is performed on the application content to identify the relevant system (e.g., "maintenance system"). The search results are read from the database, and the relevant system is selected.

[1002] Step 4:

[1003] The server's notification system notifies the user of the selected system. At the same time, the system also retrieves the contact information for that system (e.g., "Maintenance Department") from its internal database and notifies the user accordingly. The notification content is sent as a text message to the user's smart glasses.

[1004] Step 5:

[1005] The user uses the camera and microphone on their smart glasses to record the situation on site and sends the data to the server. Audio and video data are input in this step. The input data is sent from the user's device to the server.

[1006] Step 6:

[1007] The server's image acquisition mechanism receives video and audio data sent from the user. The received data is temporarily stored. In this step, data processing such as video data compression and audio data noise reduction is performed.

[1008] Step 7:

[1009] The server's emotion engine analyzes the received video and audio data to recognize the user's emotions. In this step, a generative AI model is used to identify emotions (e.g., "stress" or "dissatisfaction") from the user's facial expressions and voice. The analysis results are output as numerical data.

[1010] Step 8:

[1011] The server determines the appropriate response based on the emotional state recognized by the emotion engine. For example, if the user is feeling stressed, it will offer suggestions for relaxation (e.g., "Take a deep breath"). This response is generated in text format.

[1012] Step 9:

[1013] The server sends the generated response details to the user via a notification system. The response details are displayed as a text notification on the user's smart glasses. This notification ensures that appropriate support is provided.

[1014] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1015] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1016] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[1017] [Third Embodiment]

[1018] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[1019] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1020] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1021] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[1022] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1023] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1024] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1025] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1026] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1027] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1028] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1029] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[1030] The system of the present invention helps users select the optimal system when using multiple internal systems, enabling them to perform their tasks quickly and accurately. Specific embodiments are described below.

[1031] 1. System Configuration

[1032] The system of the present invention includes the following main components:

[1033] Request receiving method: Receives application details and requests from users.

[1034] Search method: The system corresponding to the application content is searched from the internal database.

[1035] Notification method: Notify the user of the most suitable system and the appropriate contact point.

[1036] Storage method: Stores user authentication information.

[1037] Search method: Search for saved authentication information.

[1038] Delivery method: Provide search results to the user.

[1039] Encryption method: Authentication information is encrypted and stored.

[1040] 2. How to operate the system

[1041] The user's workflow for operating the system is as follows:

[1042] Request received:

[1043] Users want to perform specific tasks and input the details into the system (for example, "leave request" or "expense reimbursement").

[1044] System selection:

[1045] The server receives requests from users.

[1046] The server searches its internal database for the most suitable system corresponding to the application details.

[1047] The server notifies the user of the selected system.

[1048] Contact information:

[1049] The server searches its internal database for contact information related to the selected system.

[1050] The server will notify the user of the contact information.

[1051] Storing authentication information:

[1052] The user enters authentication information (ID and password) for a specific system and sends a request to save it to the system.

[1053] The server receives the authentication information and stores it using encryption.

[1054] The server notifies the user of the saved results.

[1055] Obtaining authentication information:

[1056] The user sends a request to the system to retrieve previously saved credentials.

[1057] The server searches for stored authentication information and provides the search results to the user.

[1058] If the server cannot find the appropriate authentication information, it will notify the user that the information could not be found.

[1059] 3. Specific Examples

[1060] Specific examples are given below.

[1061] For example, the procedure for a user to submit a "leave request" is as follows:

[1062] 1. The user enters "leave request" and submits a request to the support system.

[1063] 2. The server receives the request and searches its internal database for the "leave management system" corresponding to the "leave request".

[1064] 3. The server selects a "vacation management system" and notifies the user.

[1065] 4. The server then searches for a contact point regarding the "Leave Management System" and notifies the user that it is the "Human Resources Department".

[1066] Next, the procedure for users to save their credentials is as follows:

[1067] 1. The user enters their ID and password for the "Leave Management System" and sends a save request to the support system.

[1068] 2. The server receives the request and stores the authentication information in an encrypted form.

[1069] 3. The server notifies the user of the saved results.

[1070] Furthermore, the procedure for users to obtain their authentication credentials is as follows:

[1071] 1. The user sends a request to retrieve previously saved authentication information for the "Leave Management System".

[1072] 2. The server retrieves the stored authentication information and provides it to the user.

[1073] 3. If the server cannot find the relevant information, it will notify the user accordingly.

[1074] The above describes a specific embodiment for carrying out the present invention. This allows users to quickly identify the optimal system, find the correct contact point, and securely manage their authentication information.

[1075] The following describes the processing flow.

[1076] When a user submits a leave request

[1077] Step 1:

[1078] The user uses their device to type "leave request" and sends the request to the support system.

[1079] Step 2:

[1080] The server receives this request.

[1081] Step 3:

[1082] Based on the application received by the server, it searches the internal database for the corresponding system (in this case, the "Leave Management System").

[1083] Step 4:

[1084] The server selects the most suitable system, the "vacation management system," based on the search results and notifies the user of that information.

[1085] Step 5:

[1086] The server then searches its internal database for contact information related to the "vacation management system."

[1087] Step 6:

[1088] The server finds the contact point, "Human Resources Department," and notifies the user of that information.

[1089] When saving authentication information

[1090] Step 1:

[1091] The user uses a terminal to enter their ID and password for the "Leave Management System" and sends a request to the support system to save their authentication information.

[1092] Step 2:

[1093] The server receives this request.

[1094] Step 3:

[1095] The server encrypts the received ID and password.

[1096] Step 4:

[1097] The server stores encrypted authentication information in its internal database.

[1098] Step 5:

[1099] The server notifies the user of the saved results.

[1100] When obtaining authentication information

[1101] Step 1:

[1102] The user uses their device to send a request to retrieve previously saved credentials for the "Leave Management System".

[1103] Step 2:

[1104] The server receives this request.

[1105] Step 3:

[1106] The server searches its internal database for the corresponding authentication information.

[1107] Step 4:

[1108] The server provides the user with the relevant authentication information based on the search results (in this case, the information is decrypted before being provided).

[1109] Step 5:

[1110] If the server cannot find the corresponding authentication information, it will notify the user accordingly.

[1111] These steps allow users to quickly and accurately learn the optimal way to use the system and who to contact for support, while also enabling them to manage their authentication information securely.

[1112] (Example 1)

[1113] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1114] In today's business environment, users need to efficiently utilize multiple internal systems. However, these systems each require different authentication credentials, making it difficult to determine which system to use. Furthermore, finding the appropriate contact point is time-consuming, hindering work efficiency. Therefore, there is a need for a system that helps users quickly and accurately select the optimal system and perform their tasks effectively.

[1115] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1116] In this invention, the server includes a request receiving means for selecting the optimal means based on the user's application; a search means for searching for means corresponding to the application from internal storage; a notification means for notifying the user of the selected means; a search means for searching for the contact point for the relevant means from internal storage; a notification means for notifying the user of the contact point; a storage means for storing the user's authentication information; a search means for searching the stored authentication information; a providing means for providing the search results to the user; and an encryption means for encrypting and storing the authentication information. This enables the user to efficiently select the optimal system, obtain appropriate contact information, and securely manage their authentication information.

[1117] A "user" refers to an individual or group that performs operations or inputs into a system.

[1118] "Application details" refers to the detailed information of a specific request or task that a user submits to the system.

[1119] "Optimal means" refers to systems and services that best suit the user's application and respond efficiently.

[1120] "Request receiving means" refers to a process or device for receiving requests sent by a user.

[1121] "Search means" refers to a process or device for retrieving information from an internal storage device based on specific conditions.

[1122] "Notification means" refers to a process or device for conveying retrieved information or systems to the user.

[1123] "Internal storage device" refers to a storage medium or system that can store data and retrieve it as needed.

[1124] "Contact point" refers to the department or person responsible for providing additional information and support regarding the selected system.

[1125] "Storage means" refers to a process or device for securely storing user authentication information.

[1126] "Means of provision" refers to a process or device for providing search results to a user.

[1127] "Encryption means" refers to a process or device that encrypts data in order to protect user authentication information from unauthorized access.

[1128] This invention provides a system for users to efficiently utilize multiple internal systems, and in particular, it has functions to quickly and accurately select the optimal system, notify contact information, and store and retrieve authentication information. This system consists of a server including request receiving means, search means, notification means, storage means, provision means, and encryption means.

[1129] The following are the main components for generating the program for this system:

[1130] 1. Method of receiving requests:

[1131] Users want to perform a specific task and input the details into the system. They use a terminal to input the task details (e.g., "leave request," "expense reimbursement") and send a request to the server. Typical devices used are PCs and smartphones.

[1132] 2. Search methods:

[1133] The server receives a request and searches its internal database for the system best suited to the request. SQL or NoSQL databases are used. For example, if the server receives a "leave request," it uses an SQL query to search for the "leave management system."

[1134] 3. Means of notification:

[1135] The server notifies the user of the selected system. It returns information to the user using an HTTP response. Furthermore, it searches for and notifies the contact person for inquiries regarding the relevant system. For example, it might notify the user that the "Human Resources Department" is the contact person for inquiries regarding the "Leave Management System".

[1136] 4. Preservation means:

[1137] The user enters authentication information (ID and password) for a specific system and sends a save request to the server. The server receives the authentication information and stores it using encryption.

[1138] 5. Means of provision:

[1139] The user sends a request to retrieve previously saved credentials. The server searches for the saved credentials and provides the search results to the user. If no suitable credentials are found, the server notifies the user accordingly.

[1140] 6. Encryption methods:

[1141] The server encrypts authentication information using encryption algorithms such as AES and stores it in an internal database. This process ensures that user authentication information is managed securely.

[1142] Specific example:

[1143] For example, the procedure for a user to submit a "leave request" is as follows:

[1144] 1. The user enters "leave request" and submits the request to the system.

[1145] 2. The server receives the request and searches its internal database for the "leave management system" corresponding to the "leave request".

[1146] 3. The server selects a "vacation management system" and notifies the user.

[1147] 4. The server then searches for a contact point regarding the "Leave Management System" and notifies the user that it is the "Human Resources Department".

[1148] Next, the procedure for users to save their credentials is as follows:

[1149] 1. The user enters their ID and password for the "Leave Management System" and sends a save request to the support system.

[1150] 2. The server receives the request and encrypts the authentication information using the AES encryption algorithm.

[1151] 3. The server stores encrypted authentication information in an internal database.

[1152] 4. The server notifies the user of the saved results.

[1153] Furthermore, the procedure for users to obtain their authentication credentials is as follows:

[1154] 1. The user sends a request to retrieve previously saved authentication information for the "Leave Management System".

[1155] 2. The server retrieves the stored authentication information from its internal database and provides it to the user.

[1156] 3. If the server cannot find the relevant information, it will notify the user accordingly.

[1157] This system allows users to efficiently select the optimal system, obtain appropriate contact information, and securely manage their authentication information.

[1158] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1159] Step 1:

[1160] The user uses a terminal to input the details of the task they want to perform and sends a request to the server. Input: Task details (e.g., "Leave Request"). Output: Request data sent to the server.

[1161] Specific actions:

[1162] The user fills in the details of their work, such as "leave request," in the input form on the terminal and clicks the "submit" button. The terminal sends this input data to the server as an HTTP POST request.

[1163] Step 2:

[1164] The server receives requests from users and parses their contents. Input: Request data. Output: Parsing result (e.g., "Leave Request").

[1165] Specific actions:

[1166] The server receives an HTTP POST request, extracts the business details from the data, and parses it. For example, the request data is received in JSON format as {"request": "leave request"}, and the server uses a JSON parser to extract the keyword "leave request".

[1167] Step 3:

[1168] The server searches its internal database to find the most suitable system for the application. Input: Analysis result (e.g., "Leave Request"). Output: Optimal system information (e.g., "Leave Management System").

[1169] Specific actions:

[1170] The server generates an SQL query and searches the database. For example, it executes a query like SELECT FROM systems WHERE request = 'Leave Request' to retrieve records corresponding to "Leave Management System".

[1171] Step 4:

[1172] The server notifies the user of the selected system. Input: Optimal system information (e.g., "Leave Management System"). Output: Notification content to the user.

[1173] Specific actions:

[1174] The server returns the selected system information to the user as an HTTP response. For example, the response body might say, "Please use the 'Leave Management System' for your leave requests."

[1175] Step 5:

[1176] The server searches its internal database for contact information related to the system in question. Input: Optimal system information (e.g., "Leave Management System"). Output: Contact information (e.g., "Human Resources Department").

[1177] Specific actions:

[1178] The server generates an SQL query to search for the contact information. For example, it executes a query like SELECT FROM contacts WHERE system = 'Leave Management System' to retrieve records corresponding to "Human Resources Department".

[1179] Step 6:

[1180] The server notifies the user of the contact information. Input: Contact information (e.g., "Human Resources Department"). Output: Content of the notification to the user.

[1181] Specific actions:

[1182] The server returns the retrieved contact information to the user as an HTTP response. For example, it might say, "Please direct inquiries regarding the 'Leave Management System' to the 'Human Resources Department'."

[1183] Step 7:

[1184] The user enters authentication information (ID and password) for a specific system and sends a save request to the server. Input: Authentication information (e.g., ID, password). Output: Save request sent to the server.

[1185] Specific actions:

[1186] The user enters authentication information for the "Leave Management System" into the input form on the terminal and clicks the "Save" button. The terminal sends this data to the server as an HTTP POST request.

[1187] Step 8:

[1188] The server receives the request and encrypts the authentication information. Input: Saved request (authentication information). Output: Encrypted authentication information.

[1189] Specific actions:

[1190] The server receives an HTTP POST request and encrypts the received authentication information using the AES encryption algorithm. The encrypted data is then temporarily stored in memory.

[1191] Step 9:

[1192] The server stores encrypted authentication information in the database. Input: Encrypted authentication information. Output: Saved result.

[1193] Specific actions:

[1194] The server generates an INSERT statement and saves the encrypted authentication information to the database. For example, it executes a query such as INSERT INTO credentials (system, id, password) VALUES ('Leave Management System', 'encrypted_id', 'encrypted_password').

[1195] Step 10:

[1196] The server notifies the user of the saved result. Input: Saved result. Output: Notification content to the user.

[1197] Specific actions:

[1198] If the saving process is successful, the server will notify the user of the result via an HTTP response. For example, it might state, "Authentication information saved successfully."

[1199] Step 11:

[1200] The user sends a request to the server to retrieve previously saved authentication information. Input: System name (e.g., "Leave Management System"). Output: Retrieval request sent to the server.

[1201] Specific actions:

[1202] The user enters the system name into the input form on the terminal and clicks the "Get" button. The terminal sends this data to the server as an HTTP POST request.

[1203] Step 12:

[1204] The server receives the request and retrieves the stored authentication information from its internal database. Input: Retrieval request (system name). Output: Search results (encrypted authentication information).

[1205] Specific actions:

[1206] The server parses the received request and searches its internal database for the authentication information of the relevant system. For example, it might execute a query like SELECT FROM credentials WHERE system = 'Leave Management System'.

[1207] Step 13:

[1208] The server provides the retrieved authentication information to the user. Input: Search results (encrypted authentication information). Output: Notification content to the user.

[1209] Specific actions:

[1210] The server decrypts the search results and provides them to the user. For example, it might display "ID: decrypted_id, Password: decrypted_password".

[1211] Step 14:

[1212] The server notifies the user if no matching information is found. Input: Search results (no results found). Output: Notification sent to the user.

[1213] Specific actions:

[1214] If the server cannot find the corresponding authentication credentials, it will notify the user via an HTTP response. For example, it might state, "Certificate credentials could not be found."

[1215] (Application Example 1)

[1216] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1217] Robots operating in factories need to work in conjunction with numerous different systems. However, currently, selecting the optimal system for each robot and obtaining authentication information quickly is difficult, leading to decreased work efficiency. Furthermore, secure management of authentication information is also required.

[1218] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1219] In this invention, the server includes: a request receiving means for selecting the optimal computer system based on the user's application; a search means for searching an internal database for a computer system corresponding to the application; a notification means for notifying the user of the selected computer system; a search means for searching an internal database for the source of the inquiry for the relevant computer system; a notification means for notifying the user of the source of the inquiry; a robot notification means for notifying the robot that received the request of the optimal system and source of the inquiry; a storage means for storing authentication information; an encryption means for encrypting and storing the stored authentication information; and a provision means for searching the stored authentication information and providing it to the robot as needed. This enables the robot to efficiently utilize multiple systems, safely and quickly acquire the necessary authentication information, and perform its tasks.

[1220] "User" refers to the factory operators or robots that utilize this system.

[1221] "Application details" refers to the specific tasks or operations that the user requests from the system.

[1222] An "optimal computing system" refers to a system that provides the most suitable response to the user's request.

[1223] A "request receiving method" is a means of receiving application details from a user.

[1224] A "search method" is a means of searching for a computer system corresponding to the application content within an internal database.

[1225] "Notification means" refers to the means of communicating selected computing systems and inquiry source information to users or robots.

[1226] "Inquiry source" refers to the organization or contact that receives inquiries related to computer systems.

[1227] A "robot notification method" is a means of notifying a robot that has received a request of the optimal system and source of the inquiry.

[1228] "Storage means" refers to means of storing authentication information for robots and users.

[1229] "Encryption means" refers to a method for encrypting the authentication information that is stored.

[1230] "Means of provision" refers to means of searching for stored authentication information and providing it to the robot as needed.

[1231] Modes for carrying out the invention

[1232] The embodiments for carrying out the present invention will be described in detail below.

[1233] System configuration and program execution order

[1234] The system of the present invention provides a set of functions for receiving requests from users, selecting the optimal computing system, and notifying the user. Specifically, it includes the following main components:

[1235] Request receiving method: Receives application details from users.

[1236] Search method: The system corresponding to the application content is searched from the internal database.

[1237] Notification method: Notify users and robots of the selected computing system and the source of the inquiry.

[1238] Robot notification mechanism: Notifies the robot that received the request of the optimal system and source of the inquiry.

[1239] Storage method: Store authentication information.

[1240] Encryption method: Encrypt the authentication information to be stored.

[1241] Method of provision: Search for stored authentication information and provide it to the robot as needed.

[1242] Hardware and software usage

[1243] This system is designed to work in conjunction with robots located within the factory. The following are specific examples of hardware and software usage:

[1244] Server: The central management server within the factory performs request receiving, searching, notification, storage, encryption, and provisioning functions.

[1245] Database: Internal databases are used to store computer system information, query sources, and authentication information. SQLite is a concrete example.

[1246] Encryption library: The Python cryptography library is used to encrypt authentication information.

[1247] Program processing

[1248] When the server receives a request from a user, it searches its internal database for the most suitable computing system to meet that request. The server promptly notifies the user of the search results, as well as the robot that received the request. If the robot requires authentication information, the server provides it in encrypted form. These features enable the robot to efficiently utilize multiple systems and obtain authentication information securely and quickly.

[1249] Specific example

[1250] For example, consider a scenario where robot A in a factory wants to procure parts using a parts supply system. Robot A sends a request to a server. Upon receiving this request, the server searches its database for the most suitable computing system for the parts supply system and notifies robot A of the result. If necessary, it also provides robot A with encrypted authentication information. This allows robot A to procure parts quickly and improve production efficiency.

[1251] Example of a prompt

[1252] An example of a prompt for the generated AI model is: "Create a program that searches for the optimal system and contact information when a robot operating in a factory wants to use a parts supply system, and notifies the robot of that information. Also, ensure that it can store and retrieve authentication information."

[1253] The above describes specific embodiments for carrying out the present invention. This invention makes it possible for robots in factories to efficiently utilize a variety of systems and perform tasks safely and quickly.

[1254] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1255] Step 1:

[1256] A user sends a request to a server to use a specific service (e.g., a "parts supply system"). The request contains the details of the application. The server receives this request through a request receiving mechanism. The input is the user's request, and the output is the received request content.

[1257] Step 2:

[1258] The server searches its internal database for the most suitable computing system based on the received request. This search is performed using a search mechanism. The input is the received request, and the output is information about the best computing system found.

[1259] Step 3:

[1260] The server notifies the user of the best-finded computing system through a notification system. The input is information about the searched computing system, and the output is the notification sent to the user.

[1261] Step 4:

[1262] The server then searches its internal database for the source of the query for the relevant computing system. This search is also performed using a search mechanism. The input is information about the optimal computing system, and the output is information about the query source.

[1263] Step 5:

[1264] The server notifies the user of the source of the inquiry through a notification system. The input is the source of the inquiry, and the output is the notification content sent to the user.

[1265] Step 6:

[1266] The robot that receives the request sends a request to the server to obtain the necessary authentication information. The server receives this request and retrieves the authentication information from its internal database. The input is the request from the robot, and the output is the stored authentication information.

[1267] Step 7:

[1268] The server encrypts the retrieved authentication information and provides it to the robot. This process is carried out using encryption and provisioning methods. The input is the stored authentication information, and the output is the encrypted authentication information.

[1269] Step 8:

[1270] The server notifies the robot that sent the request of the encrypted authentication information obtained as a result of the processing via the robot notification mechanism. The input is the encrypted authentication information, and the output is the content of the notification to the robot.

[1271] The above describes the system's processing flow based on an application example. This enables robots within a factory to efficiently utilize the computer system and obtain necessary authentication information safely and quickly.

[1272] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1273] The system of the present invention assists users in selecting the optimal system when using multiple internal systems, enabling them to perform their tasks quickly and accurately. Furthermore, the system incorporates an emotion engine that recognizes the user's emotions and adjusts its response accordingly. Specific embodiments are described below.

[1274] 1. System Configuration

[1275] The system of the present invention includes the following main components:

[1276] Request receiving method: Receives application details and requests from users.

[1277] Search method: The system corresponding to the application content is searched from the internal database.

[1278] Notification method: Notify the user of the most suitable system and the appropriate contact point.

[1279] Storage method: Stores user authentication information.

[1280] Search method: Search for saved authentication information.

[1281] Delivery method: Provide search results to the user.

[1282] Encryption method: Authentication information is encrypted and stored.

[1283] Emotion Engine: Recognizes the user's emotions and selects the optimal response based on them.

[1284] 2. How to operate the system

[1285] The user's workflow for operating the system is as follows:

[1286] Request received:

[1287] Users use their devices to enter requests such as "leave requests" and send them to the support system.

[1288] System selection:

[1289] The server receives the request and searches its internal database for the corresponding system (in this case, it searches for the "Leave Management System").

[1290] The server notifies the user of the selected system.

[1291] Contact information:

[1292] The server searches its internal database for contact information related to the "Leave Management System" and notifies the user of the "Human Resources Department".

[1293] Storing authentication information:

[1294] The user enters their authentication information (ID and password) for the "vacation management system" and sends a save request to the system.

[1295] The server stores authentication information using encryption and notifies the user of the result.

[1296] Obtaining authentication information:

[1297] The user sends a request to retrieve previously saved credentials.

[1298] The server searches for stored authentication information and provides the results to the user.

[1299] If the server cannot find the relevant information, it will notify the user accordingly.

[1300] Emotion recognition and response:

[1301] Users input voice and facial expression data through the microphone and camera on their device.

[1302] The server's emotion engine analyzes the input data and recognizes the user's emotional state.

[1303] For example, if the emotion engine detects stress from the user's voice, it will offer the user suggestions for relaxation.

[1304] Furthermore, if we determine from the user's facial expression that they are dissatisfied, we will promptly encourage them to contact a support representative.

[1305] 3. Specific Examples

[1306] For example, the procedure for a user to submit a "leave request" is as follows:

[1307] 1. The user enters a "leave request" and submits the request to the support system.

[1308] 2. The server receives the request, searches for and selects the "vacation management system," and notifies the user.

[1309] 3. The server searches for the contact information for inquiries regarding the "Leave Management System" and notifies the user of the "Human Resources Department".

[1310] Next, the procedure for users to save their credentials is as follows:

[1311] 1. The user enters their ID and password for the "Leave Management System" and submits a save request.

[1312] 2. The server receives the request, encrypts and stores the authentication information, and notifies the user of the result.

[1313] Furthermore, the procedure for users to utilize the emotion engine is as follows:

[1314] 1. The user inputs voice and facial expression data using the microphone and camera on their device.

[1315] 2. The server's emotion engine analyzes this and recognizes the user's emotions.

[1316] 3. The server provides the user with the most appropriate response based on the emotions it recognizes.

[1317] These features allow users to quickly and accurately identify the most suitable system or contact point, while also managing their authentication information securely. Furthermore, by utilizing an emotion engine, users can receive appropriate support tailored to their emotions.

[1318] The following describes the processing flow.

[1319] When a user submits a leave request

[1320] Step 1:

[1321] The user uses their device to type "leave request" and sends the request to the support system.

[1322] Step 2:

[1323] The server receives the request.

[1324] Step 3:

[1325] Based on the application received by the server, it searches the internal database for the corresponding system (in this case, the "Leave Management System").

[1326] Step 4:

[1327] The server selects the most suitable system, the "vacation management system," based on the search results and notifies the user of that information.

[1328] Step 5:

[1329] The server then searches its internal database for contact information related to the "vacation management system."

[1330] Step 6:

[1331] The server finds the contact point, "Human Resources Department," and notifies the user of that information.

[1332] When saving authentication information

[1333] Step 1:

[1334] The user uses a terminal to enter their ID and password for the "Leave Management System" and sends a request to the support system to save their authentication information.

[1335] Step 2:

[1336] The server receives this request.

[1337] Step 3:

[1338] The server encrypts the received ID and password.

[1339] Step 4:

[1340] The server stores encrypted authentication information in its internal database.

[1341] Step 5:

[1342] The server notifies the user of the saved results.

[1343] When obtaining authentication information

[1344] Step 1:

[1345] The user uses their device to send a request to retrieve previously saved credentials for the "Leave Management System".

[1346] Step 2:

[1347] The server receives this request.

[1348] Step 3:

[1349] The server searches its internal database for the corresponding authentication information.

[1350] Step 4:

[1351] The server provides the user with the relevant authentication information based on the search results (in this case, the information is decrypted before being provided).

[1352] Step 5:

[1353] If the server cannot find the corresponding authentication information, it will notify the user accordingly.

[1354] When using an emotion engine

[1355] Step 1:

[1356] The user inputs voice and facial expression data using the microphone and camera on their device.

[1357] Step 2:

[1358] The server's emotion engine analyzes the input data and recognizes the user's emotional state.

[1359] Step 3:

[1360] The server selects the most appropriate response based on the emotions it perceives.

[1361] Step 4:

[1362] The server will be selected and the user will be notified of the corresponding action.

[1363] Specific example

[1364] For example, here is a specific example of when a user submits a "leave request":

[1365] 1. The user enters a "leave request" and submits the request to the support system.

[1366] 2. The server receives the request, searches for and selects the "vacation management system," and notifies the user of that information.

[1367] 3. The server searches for the contact person for inquiries regarding the "Leave Management System" and notifies the "Human Resources Department".

[1368] Next, here is a specific example of when a user saves their authentication information:

[1369] 1. The user enters their ID and password for the "Leave Management System" and submits a save request.

[1370] 2. The server receives the request, encrypts and stores the authentication information, and notifies the result.

[1371] Furthermore, specific examples of how users utilize the emotion engine are as follows:

[1372] 1. The user inputs voice and facial expression data using the microphone and camera on their device.

[1373] 2. The server's emotion engine analyzes the user's voice, for example, and if it detects stress, it analyzes that information.

[1374] 3. Based on the emotions the server recognizes, it will notify the user with suggestions, such as relaxation techniques.

[1375] (Example 2)

[1376] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1377] Currently, it is difficult for users to quickly and accurately select the optimal system when using multiple internal systems. Furthermore, mechanisms for securely managing user authentication information and providing appropriate responses tailored to user emotions are insufficient. As a result, problems such as decreased work efficiency and increased user stress are occurring.

[1378] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1379] In this invention, the server includes a request receiving means for selecting the optimal information processing device based on the user's request; a search means for searching for an information processing device corresponding to the request from internal storage; a notification means for notifying the user of the selected information processing device; a search means for searching for the contact point for the relevant information processing device from internal storage; a notification means for notifying the user of the contact point; and an emotion recognition means for recognizing the user's emotions and adjusting the response accordingly. As a result, the user can not only quickly and accurately identify the optimal system and contact point, but also receive an appropriate response that is in line with their emotions.

[1380] A "request receiving means" is a device or system for receiving application details or requests from users.

[1381] A "search method" refers to a device or system for finding the most suitable information processing device or contact point from internal storage based on the received application content.

[1382] "Notification means" refers to a device or system that informs the user of the retrieved information processing device or contact information.

[1383] An "emotion recognition means" is a device or system that analyzes a user's voice and facial expression data to recognize their emotional state and determine a response appropriate to that state.

[1384] "Storage means" refers to a device or system for storing user authentication information.

[1385] "Means of provision" refers to a device or system for retrieving stored authentication information and providing the results to the user.

[1386] "Encryption means" refers to a device or system for encrypting user authentication information and securely storing that information.

[1387] Modes for carrying out the invention

[1388] The system of the present invention aims to help users quickly and accurately access multiple internal systems. In particular, the system incorporates an emotion engine that recognizes the user's emotions and adjusts its response accordingly.

[1389] Hardware and software to be used

[1390] Server: Responsible for the main processing. Specifically, it handles request reception, system lookups, notifications, query lookups, authentication information storage and retrieval, and sentiment recognition. Database operations and encryption processing are also performed here.

[1391] Terminal: An input device used by a user. This includes PCs and smartphones.

[1392] Internal storage: Connected to the server, including a database that stores system information, contact details, and authentication information.

[1393] Encryption device: Encrypts authentication information using encryption algorithms such as AES or RSA.

[1394] System Configuration

[1395] The system of the present invention includes the following main components:

[1396] Request reception method: Users use their devices to input application details and requests via a browser or dedicated application and send them to the server.

[1397] Search method: After the server receives a request from a user, it searches its internal storage for the corresponding system. SQL queries and NoSQL queries are used as search algorithms.

[1398] Notification method: The server notifies the user of the search results. Information is sent to the user using HTTP responses or WebSockets.

[1399] Inquiry contact search method: The server searches its internal storage for contact information related to the system in question and notifies the user of the results.

[1400] Storage method: The user enters authentication information (ID and password) using a terminal and sends it to the server. The server receives this information, encrypts it using an encryption device, and stores it in its internal storage device.

[1401] Emotion recognition method: User voice and facial expression data are input through the device's microphone and camera and sent to the server. The emotion engine analyzes this data and responds based on the user's emotional state.

[1402] Usage example

[1403] For example, the procedure for a user to submit a "leave request" is as follows:

[1404] 1. The user enters a "leave request" and submits the request to the support system.

[1405] 2. The server receives the request, searches for and selects the "vacation management system," and notifies the user.

[1406] 3. The server searches for the contact information for inquiries regarding the "Leave Management System" and notifies the user of the "Human Resources Department".

[1407] Next, the procedure for users to save their credentials is as follows:

[1408] 1. The user enters their ID and password for the "Leave Management System" and submits a save request.

[1409] 2. The server receives the save request, encrypts and saves the authentication information, and notifies the server of the result.

[1410] Furthermore, the procedure for users to utilize the emotion engine is as follows:

[1411] 1. The user inputs voice and facial expression data using the microphone and camera on their device.

[1412] 2. The server's emotion engine analyzes this and recognizes the user's emotions.

[1413] 3. The server provides the user with the most appropriate response based on the emotions it recognizes.

[1414] Example of a prompt

[1415] The following are specific examples of prompt statements for generative AI models:

[1416] "Please provide a detailed description of the user's vacation request process. In particular, please explain in detail how the request is received, how the system is selected, how contact information is provided, how authentication information is stored and retrieved, and how sentiment recognition and response are handled."

[1417] This allows users to quickly and accurately identify the most suitable system or contact point, as well as receive appropriate responses that are tailored to their emotional needs.

[1418] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1419] Step 1:

[1420] Request Input

[1421] The user uses a terminal to log in to the support system interface. For example, the user enters request information, such as a "leave request," through a browser or dedicated application and presses the "submit" button. This sends the request data to the server. The input is the request information made by the user, and the output is an HTTP request containing the user's input data.

[1422] Step 2:

[1423] Request received

[1424] The server receives a request from the user. Specifically, the server receives an HTTP request and parses its contents. The request data is temporarily stored in memory. The input is the HTTP request sent by the user, and the output is the parsed request data.

[1425] Step 3:

[1426] System Search

[1427] Based on the request data received by the server, it searches its internal storage for the corresponding information processing device. For example, if the request is "leave request," the server searches for "leave management system." It uses SQL queries or NoSQL queries to retrieve the matching system from the database. The input is the request data, and the output is the search result, "leave management system."

[1428] Step 4:

[1429] System Notification

[1430] The server notifies the user of the search results. Specifically, the server generates a message such as "A vacation management system has been selected" and sends it to the user's terminal. Notifications are made using HTTP responses or WebSockets. The input is the search results, and the output is the notification message to the user.

[1431] Step 5:

[1432] Contact information search

[1433] The server searches its internal storage for contact information related to the "Leave Management System" (e.g., Human Resources Department). The server then uses SQL or NoSQL queries to retrieve the appropriate contact information. The input is information about the "Leave Management System," and the output is the retrieved contact information.

[1434] Step 6:

[1435] Contact information notification

[1436] The server retrieves contact information and notifies the user. HTTP responses and WebSockets are used as notification methods. The input is the contact information, and the output is the notification message to the user.

[1437] Step 7:

[1438] Enter authentication information

[1439] The user enters their authentication information (ID and password) for the "Leave Management System" into the interface and sends a save request. This sends the authentication information to the server. The input is the authentication information entered by the user, and the output is the save request sent to the server.

[1440] Step 8:

[1441] Authentication information storage

[1442] The server receives a save request and encrypts the authentication information. Specifically, it encrypts the authentication information using an encryption algorithm such as AES or RSA, and then saves it to internal storage. Once saving is complete, it notifies the user of the result. The input is the user's authentication information and save request, and the output is the encrypted authentication information and the saving result notification.

[1443] Step 9:

[1444] Authentication information acquisition

[1445] A request is sent to retrieve previously saved authentication information from the user. The user presses the "Retrieve Authentication Information" button to send a request to the server. The input is the user's retrieval request, and the output is the request data sent to the server.

[1446] Step 10:

[1447] Authentication Information Search

[1448] The server searches its internal storage for stored authentication information. If the matching authentication information is found, it is decrypted and provided to the user. If it is not found, the user is notified accordingly. The input is the user's retrieval request and the encrypted authentication information, and the output is the decrypted authentication information or a notification stating "Information not found."

[1449] Step 11:

[1450] Emotional data entry

[1451] The user inputs voice and facial expression data using the microphone and camera on their device. The input data is sent to the server in real time. The input is the user's voice and facial expression data, and the output is the emotion data sent to the server.

[1452] Step 12:

[1453] emotion recognition

[1454] The server's emotion engine analyzes input data and recognizes the user's emotional state. Specifically, it uses machine learning models or deep learning models to identify emotions from voice and facial expressions. The input is the user's voice and facial expression data, and the output is data of the recognized emotional state.

[1455] Step 13:

[1456] Emotion-based responses

[1457] The server provides the user with the most appropriate response based on the emotions it recognizes. For example, if stress is detected, it offers suggestions for relaxation. If the user is feeling dissatisfied, it prompts them to contact support immediately. The input is recognized emotional state data, and the output is suggested responses or notifications to the user.

[1458] (Application Example 2)

[1459] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1460] In factory and other work environments, prompt and accurate responses to various applications and inquiries are required, but reducing the psychological burden on workers is also a crucial issue. While conventional systems can select the most appropriate system and notify contact information based on the application content, they cannot respond based on the emotional state of the workers. Therefore, it is difficult for workers to receive appropriate support when they experience stress or dissatisfaction.

[1461] In Application Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes a request receiving means for selecting the optimal system based on the content of the application from the user, a search means for searching an internal database for a system corresponding to the content of the application, a notification means for notifying the user of the selected system, a search means for searching an internal database for the contact point of the relevant system, a notification means for notifying the user of the contact point, an emotion engine means for recognizing the user's emotions and adjusting the response based on the emotional state, and an image acquisition means for acquiring an image using a camera and providing the image data to the emotion engine. As a result, workers can not only make applications and inquiries quickly and accurately, but also receive appropriate support according to their emotional state.

[1462] A "request receiving means" is a device or function that receives application details from a user and acquires data for processing those details.

[1463] A "search tool" is a device or function that retrieves corresponding information from a predetermined database based on the user's application details.

[1464] "Notification means" refers to a device or function used to communicate information retrieved by the system to the user.

[1465] An "emotion engine" is a device or function that analyzes data such as a user's voice and facial expressions to recognize their emotions and psychological state.

[1466] "Image acquisition means" refers to a device or function that acquires image data using a camera or similar device and processes it.

[1467] "Storage means" refers to a device or function for securely storing user authentication information and other data.

[1468] "Authentication means" refers to a device or function that verifies and grants access rights using authentication information entered by the user.

[1469] "Encryption means" refers to a device or function that prevents unauthorized access by third parties by encrypting stored authentication information and other data.

[1470] "Means of provision" refers to a device or function that provides users with acquired data, such as retrieved information or authentication information.

[1471] This invention is a system that assists users in selecting the optimal system and responding quickly when making various requests or inquiries within a factory. This system includes a request receiving means, a search means, a notification means, an emotion engine means, an image acquisition means, a storage means, an authentication means, an encryption means, and a provision means.

[1472] System Configuration

[1473] The system includes the following main components:

[1474] 1. Request receiving method: Receives application details from the user's terminal (smart glasses).

[1475] 2. Search method: The system corresponding to the request is searched from the internal database.

[1476] 3. Notification method: The user will be notified of the selected system and the appropriate contact point.

[1477] 4. Emotion Engine: Uses cameras and microphones to recognize the user's emotions and adjusts responses accordingly.

[1478] 5. Image acquisition means: Image data is acquired using a camera built into the smart glasses and provided to the emotion engine means.

[1479] 6. Storage method: Store user authentication information.

[1480] 7. Authentication method: Access permission is verified and granted using the user's authentication information.

[1481] 8. Encryption method: Encrypt the stored authentication information.

[1482] 9. Means of delivery: Provide search results and acquired data to the user.

[1483] Operation overview

[1484] When a user uses smart glasses to submit a request or inquiry within the factory, the system operates as follows: First, the user uses the smart glasses to input the request details (e.g., "Request assistance for machine malfunction") and submits the request. The request receiving device receives this request, and the search device searches the internal database for a corresponding system. Once a system is selected, the notification device notifies the user of the selection result and the contact information.

[1485] Furthermore, this system uses the smart glasses' camera and microphone to capture the user's facial expressions and voice in order to recognize the user's emotions and take appropriate action based on their emotional state. The image acquisition means provides this data to the emotion engine means, which analyzes the user's emotional state. For example, if the user is feeling stressed, the emotion engine means will provide suggestions to promote relaxation.

[1486] As a concrete example, consider a scenario where a factory worker requests support regarding a machine malfunction. The user uses smart glasses to type, "The packaging machine on line 5 has malfunctioned. I request technical assistance," and sends the request. The system receives this request, selects the appropriate maintenance system, and notifies the user. Furthermore, it uses a camera to capture the situation on-site, and an emotion engine analyzes this data. If it determines that the user is experiencing significant stress, it immediately prompts them to contact a support representative. Specific examples of prompt messages include the following:

[1487] "Currently, the packaging machine on Line 5 has malfunctioned. We request technical assistance."

[1488] "Error code 123 is being displayed at the site."

[1489] "I'm showing the problem area to the camera on my smart glasses."

[1490] In this way, users can submit applications quickly and accurately, receive appropriate support, and even receive responses tailored to their emotional state.

[1491] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1492] Step 1:

[1493] The user enters the application details using smart glasses. An example of the input is an application requesting assistance with a machine malfunction. This input is sent to the request receiving system via the smart glasses' UI. The input data is in text format and is received by the server.

[1494] Step 2:

[1495] The server receives the application details sent by the user using a request receiving mechanism. Here, the application details are received as a string, and data processing is performed to parse the type of request. The received data is temporarily stored within the system.

[1496] Step 3:

[1497] The server's search mechanism uses an internal database to search for a corresponding system based on the received application content. In this step, keyword matching is performed on the application content to identify the relevant system (e.g., "maintenance system"). The search results are read from the database, and the relevant system is selected.

[1498] Step 4:

[1499] The server's notification system notifies the user of the selected system. At the same time, the system also retrieves the contact information for that system (e.g., "Maintenance Department") from its internal database and notifies the user accordingly. The notification content is sent as a text message to the user's smart glasses.

[1500] Step 5:

[1501] The user uses the camera and microphone on their smart glasses to record the situation on site and sends the data to the server. Audio and video data are input in this step. The input data is sent from the user's device to the server.

[1502] Step 6:

[1503] The server's image acquisition mechanism receives video and audio data sent from the user. The received data is temporarily stored. In this step, data processing such as video data compression and audio data noise reduction is performed.

[1504] Step 7:

[1505] The server's emotion engine analyzes the received video and audio data to recognize the user's emotions. In this step, a generative AI model is used to identify emotions (e.g., "stress" or "dissatisfaction") from the user's facial expressions and voice. The analysis results are output as numerical data.

[1506] Step 8:

[1507] The server determines the appropriate response based on the emotional state recognized by the emotion engine. For example, if the user is feeling stressed, it will offer suggestions for relaxation (e.g., "Take a deep breath"). This response is generated in text format.

[1508] Step 9:

[1509] The server sends the generated response details to the user via a notification system. The response details are displayed as a text notification on the user's smart glasses. This notification ensures that appropriate support is provided.

[1510] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1511] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1512] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1513] [Fourth Embodiment]

[1514] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1515] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1516] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1517] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1518] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1519] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1520] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1521] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1522] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1523] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1524] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1525] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1526] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1527] The system of the present invention helps users select the optimal system when using multiple internal systems, enabling them to perform their tasks quickly and accurately. Specific embodiments are described below.

[1528] 1. System Configuration

[1529] The system of the present invention includes the following main components:

[1530] Request receiving method: Receives application details and requests from users.

[1531] Search method: The system corresponding to the application content is searched from the internal database.

[1532] Notification method: Notify the user of the most suitable system and the appropriate contact point.

[1533] Storage method: Stores user authentication information.

[1534] Search method: Search for saved authentication information.

[1535] Delivery method: Provide search results to the user.

[1536] Encryption method: Authentication information is encrypted and stored.

[1537] 2. How to operate the system

[1538] The user's workflow for operating the system is as follows:

[1539] Request received:

[1540] Users want to perform specific tasks and input the details into the system (for example, "leave request" or "expense reimbursement").

[1541] System selection:

[1542] The server receives requests from users.

[1543] The server searches its internal database for the most suitable system corresponding to the application details.

[1544] The server notifies the user of the selected system.

[1545] Contact information:

[1546] The server searches its internal database for contact information related to the selected system.

[1547] The server will notify the user of the contact information.

[1548] Storing authentication information:

[1549] The user enters authentication information (ID and password) for a specific system and sends a request to save it to the system.

[1550] The server receives the authentication information and stores it using encryption.

[1551] The server notifies the user of the saved results.

[1552] Obtaining authentication information:

[1553] The user sends a request to the system to retrieve previously saved credentials.

[1554] The server searches for stored authentication information and provides the search results to the user.

[1555] If the server cannot find the appropriate authentication information, it will notify the user that the information could not be found.

[1556] 3. Specific Examples

[1557] Specific examples are given below.

[1558] For example, the procedure for a user to submit a "leave request" is as follows:

[1559] 1. The user enters "leave request" and submits a request to the support system.

[1560] 2. The server receives the request and searches its internal database for the "leave management system" corresponding to the "leave request".

[1561] 3. The server selects a "vacation management system" and notifies the user.

[1562] 4. The server then searches for a contact point regarding the "Leave Management System" and notifies the user that it is the "Human Resources Department".

[1563] Next, the procedure for users to save their credentials is as follows:

[1564] 1. The user enters their ID and password for the "Leave Management System" and sends a save request to the support system.

[1565] 2. The server receives the request and stores the authentication information in an encrypted form.

[1566] 3. The server notifies the user of the saved results.

[1567] Furthermore, the procedure for users to obtain their authentication credentials is as follows:

[1568] 1. The user sends a request to retrieve previously saved authentication information for the "Leave Management System".

[1569] 2. The server retrieves the stored authentication information and provides it to the user.

[1570] 3. If the server cannot find the relevant information, it will notify the user accordingly.

[1571] The above describes a specific embodiment for carrying out the present invention. This allows users to quickly identify the optimal system, find the correct contact point, and securely manage their authentication information.

[1572] The following describes the processing flow.

[1573] When a user submits a leave request

[1574] Step 1:

[1575] The user uses their device to type "leave request" and sends the request to the support system.

[1576] Step 2:

[1577] The server receives this request.

[1578] Step 3:

[1579] Based on the application received by the server, it searches the internal database for the corresponding system (in this case, the "Leave Management System").

[1580] Step 4:

[1581] The server selects the most suitable system, the "vacation management system," based on the search results and notifies the user of that information.

[1582] Step 5:

[1583] The server then searches its internal database for contact information related to the "vacation management system."

[1584] Step 6:

[1585] The server finds the contact point, "Human Resources Department," and notifies the user of that information.

[1586] When saving authentication information

[1587] Step 1:

[1588] The user uses a terminal to enter their ID and password for the "Leave Management System" and sends a request to the support system to save their authentication information.

[1589] Step 2:

[1590] The server receives this request.

[1591] Step 3:

[1592] The server encrypts the received ID and password.

[1593] Step 4:

[1594] The server stores encrypted authentication information in its internal database.

[1595] Step 5:

[1596] The server notifies the user of the saved results.

[1597] When obtaining authentication information

[1598] Step 1:

[1599] The user uses their device to send a request to retrieve previously saved credentials for the "Leave Management System".

[1600] Step 2:

[1601] The server receives this request.

[1602] Step 3:

[1603] The server searches its internal database for the corresponding authentication information.

[1604] Step 4:

[1605] The server provides the user with the relevant authentication information based on the search results (in this case, the information is decrypted before being provided).

[1606] Step 5:

[1607] If the server cannot find the corresponding authentication information, it will notify the user accordingly.

[1608] These steps allow users to quickly and accurately learn the optimal way to use the system and who to contact for support, while also enabling them to manage their authentication information securely.

[1609] (Example 1)

[1610] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1611] In today's business environment, users need to efficiently utilize multiple internal systems. However, these systems each require different authentication credentials, making it difficult to determine which system to use. Furthermore, finding the appropriate contact point is time-consuming, hindering work efficiency. Therefore, there is a need for a system that helps users quickly and accurately select the optimal system and perform their tasks effectively.

[1612] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1613] In this invention, the server includes a request receiving means for selecting the optimal means based on the user's application; a search means for searching for means corresponding to the application from internal storage; a notification means for notifying the user of the selected means; a search means for searching for the contact point for the relevant means from internal storage; a notification means for notifying the user of the contact point; a storage means for storing the user's authentication information; a search means for searching the stored authentication information; a providing means for providing the search results to the user; and an encryption means for encrypting and storing the authentication information. This enables the user to efficiently select the optimal system, obtain appropriate contact information, and securely manage their authentication information.

[1614] A "user" refers to an individual or group that performs operations or inputs into a system.

[1615] "Application details" refers to the detailed information of a specific request or task that a user submits to the system.

[1616] "Optimal means" refers to systems and services that best suit the user's application and respond efficiently.

[1617] "Request receiving means" refers to a process or device for receiving requests sent by a user.

[1618] "Search means" refers to a process or device for retrieving information from an internal storage device based on specific conditions.

[1619] "Notification means" refers to a process or device for conveying retrieved information or systems to the user.

[1620] "Internal storage device" refers to a storage medium or system that can store data and retrieve it as needed.

[1621] "Contact point" refers to the department or person responsible for providing additional information and support regarding the selected system.

[1622] "Storage means" refers to a process or device for securely storing user authentication information.

[1623] "Means of provision" refers to a process or device for providing search results to a user.

[1624] "Encryption means" refers to a process or device that encrypts data in order to protect user authentication information from unauthorized access.

[1625] This invention provides a system for users to efficiently utilize multiple internal systems, and in particular, it has functions to quickly and accurately select the optimal system, notify contact information, and store and retrieve authentication information. This system consists of a server including request receiving means, search means, notification means, storage means, provision means, and encryption means.

[1626] The following are the main components for generating the program for this system:

[1627] 1. Method of receiving requests:

[1628] Users want to perform a specific task and input the details into the system. They use a terminal to input the task details (e.g., "leave request," "expense reimbursement") and send a request to the server. Typical devices used are PCs and smartphones.

[1629] 2. Search methods:

[1630] The server receives a request and searches its internal database for the system best suited to the request. SQL or NoSQL databases are used. For example, if the server receives a "leave request," it uses an SQL query to search for the "leave management system."

[1631] 3. Means of notification:

[1632] The server notifies the user of the selected system. It returns information to the user using an HTTP response. Furthermore, it searches for and notifies the contact person for inquiries regarding the relevant system. For example, it might notify the user that the "Human Resources Department" is the contact person for inquiries regarding the "Leave Management System".

[1633] 4. Preservation means:

[1634] The user enters authentication information (ID and password) for a specific system and sends a save request to the server. The server receives the authentication information and stores it using encryption.

[1635] 5. Means of provision:

[1636] The user sends a request to retrieve previously saved credentials. The server searches for the saved credentials and provides the search results to the user. If no suitable credentials are found, the server notifies the user accordingly.

[1637] 6. Encryption methods:

[1638] The server encrypts authentication information using encryption algorithms such as AES and stores it in an internal database. This process ensures that user authentication information is managed securely.

[1639] Specific example:

[1640] For example, the procedure for a user to submit a "leave request" is as follows:

[1641] 1. The user enters "leave request" and submits the request to the system.

[1642] 2. The server receives the request and searches its internal database for the "leave management system" corresponding to the "leave request".

[1643] 3. The server selects a "vacation management system" and notifies the user.

[1644] 4. The server then searches for a contact point regarding the "Leave Management System" and notifies the user that it is the "Human Resources Department".

[1645] Next, the procedure for users to save their credentials is as follows:

[1646] 1. The user enters their ID and password for the "Leave Management System" and sends a save request to the support system.

[1647] 2. The server receives the request and encrypts the authentication information using the AES encryption algorithm.

[1648] 3. The server stores encrypted authentication information in an internal database.

[1649] 4. The server notifies the user of the saved results.

[1650] Furthermore, the procedure for users to obtain their authentication credentials is as follows:

[1651] 1. The user sends a request to retrieve previously saved authentication information for the "Leave Management System".

[1652] 2. The server retrieves the stored authentication information from its internal database and provides it to the user.

[1653] 3. If the server cannot find the relevant information, it will notify the user accordingly.

[1654] This system allows users to efficiently select the optimal system, obtain appropriate contact information, and securely manage their authentication information.

[1655] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1656] Step 1:

[1657] The user uses a terminal to input the details of the task they want to perform and sends a request to the server. Input: Task details (e.g., "Leave Request"). Output: Request data sent to the server.

[1658] Specific actions:

[1659] The user fills in the details of their work, such as "leave request," in the input form on the terminal and clicks the "submit" button. The terminal sends this input data to the server as an HTTP POST request.

[1660] Step 2:

[1661] The server receives requests from users and parses their contents. Input: Request data. Output: Parsing result (e.g., "Leave Request").

[1662] Specific actions:

[1663] The server receives an HTTP POST request, extracts the business details from the data, and parses it. For example, the request data is received in JSON format as {"request": "leave request"}, and the server uses a JSON parser to extract the keyword "leave request".

[1664] Step 3:

[1665] The server searches its internal database to find the most suitable system for the application. Input: Analysis result (e.g., "Leave Request"). Output: Optimal system information (e.g., "Leave Management System").

[1666] Specific actions:

[1667] The server generates an SQL query and searches the database. For example, it executes a query like SELECT FROM systems WHERE request = 'Leave Request' to retrieve records corresponding to "Leave Management System".

[1668] Step 4:

[1669] The server notifies the user of the selected system. Input: Optimal system information (e.g., "Leave Management System"). Output: Notification content to the user.

[1670] Specific actions:

[1671] The server returns the selected system information to the user as an HTTP response. For example, the response body might say, "Please use the 'Leave Management System' for your leave requests."

[1672] Step 5:

[1673] The server searches its internal database for contact information related to the system in question. Input: Optimal system information (e.g., "Leave Management System"). Output: Contact information (e.g., "Human Resources Department").

[1674] Specific actions:

[1675] The server generates an SQL query to search for the contact information. For example, it executes a query like SELECT FROM contacts WHERE system = 'Leave Management System' to retrieve records corresponding to "Human Resources Department".

[1676] Step 6:

[1677] The server notifies the user of the contact information. Input: Contact information (e.g., "Human Resources Department"). Output: Content of the notification to the user.

[1678] Specific actions:

[1679] The server returns the retrieved contact information to the user as an HTTP response. For example, it might say, "Please direct inquiries regarding the 'Leave Management System' to the 'Human Resources Department'."

[1680] Step 7:

[1681] The user enters authentication information (ID and password) for a specific system and sends a save request to the server. Input: Authentication information (e.g., ID, password). Output: Save request sent to the server.

[1682] Specific actions:

[1683] The user enters authentication information for the "Leave Management System" into the input form on the terminal and clicks the "Save" button. The terminal sends this data to the server as an HTTP POST request.

[1684] Step 8:

[1685] The server receives the request and encrypts the authentication information. Input: Saved request (authentication information). Output: Encrypted authentication information.

[1686] Specific actions:

[1687] The server receives an HTTP POST request and encrypts the received authentication information using the AES encryption algorithm. The encrypted data is then temporarily stored in memory.

[1688] Step 9:

[1689] The server stores encrypted authentication information in the database. Input: Encrypted authentication information. Output: Saved result.

[1690] Specific actions:

[1691] The server generates an INSERT statement and saves the encrypted authentication information to the database. For example, it executes a query such as INSERT INTO credentials (system, id, password) VALUES ('Leave Management System', 'encrypted_id', 'encrypted_password').

[1692] Step 10:

[1693] The server notifies the user of the saved result. Input: Saved result. Output: Notification content to the user.

[1694] Specific actions:

[1695] If the saving process is successful, the server will notify the user of the result via an HTTP response. For example, it might state, "Authentication information saved successfully."

[1696] Step 11:

[1697] The user sends a request to the server to retrieve previously saved authentication information. Input: System name (e.g., "Leave Management System"). Output: Retrieval request sent to the server.

[1698] Specific actions:

[1699] The user enters the system name into the input form on the terminal and clicks the "Get" button. The terminal sends this data to the server as an HTTP POST request.

[1700] Step 12:

[1701] The server receives the request and retrieves the stored authentication information from its internal database. Input: Retrieval request (system name). Output: Search results (encrypted authentication information).

[1702] Specific actions:

[1703] The server parses the received request and searches its internal database for the authentication information of the relevant system. For example, it might execute a query like SELECT FROM credentials WHERE system = 'Leave Management System'.

[1704] Step 13:

[1705] The server provides the retrieved authentication information to the user. Input: Search results (encrypted authentication information). Output: Notification content to the user.

[1706] Specific actions:

[1707] The server decrypts the search results and provides them to the user. For example, it might display "ID: decrypted_id, Password: decrypted_password".

[1708] Step 14:

[1709] The server notifies the user if no matching information is found. Input: Search results (no results found). Output: Notification sent to the user.

[1710] Specific actions:

[1711] If the server cannot find the corresponding authentication credentials, it will notify the user via an HTTP response. For example, it might state, "Certificate credentials could not be found."

[1712] (Application Example 1)

[1713] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1714] Robots operating in factories need to work in conjunction with numerous different systems. However, currently, selecting the optimal system for each robot and obtaining authentication information quickly is difficult, leading to decreased work efficiency. Furthermore, secure management of authentication information is also required.

[1715] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1716] In this invention, the server includes: a request receiving means for selecting the optimal computer system based on the user's application; a search means for searching an internal database for a computer system corresponding to the application; a notification means for notifying the user of the selected computer system; a search means for searching an internal database for the source of the inquiry for the relevant computer system; a notification means for notifying the user of the source of the inquiry; a robot notification means for notifying the robot that received the request of the optimal system and source of the inquiry; a storage means for storing authentication information; an encryption means for encrypting and storing the stored authentication information; and a provision means for searching the stored authentication information and providing it to the robot as needed. This enables the robot to efficiently utilize multiple systems, safely and quickly acquire the necessary authentication information, and perform its tasks.

[1717] "User" refers to the factory operators or robots that utilize this system.

[1718] "Application details" refers to the specific tasks or operations that the user requests from the system.

[1719] An "optimal computing system" refers to a system that provides the most suitable response to the user's request.

[1720] A "request receiving method" is a means of receiving application details from a user.

[1721] A "search method" is a means of searching for a computer system corresponding to the application content within an internal database.

[1722] "Notification means" refers to the means of communicating selected computing systems and inquiry source information to users or robots.

[1723] "Inquiry source" refers to the organization or contact that receives inquiries related to computer systems.

[1724] A "robot notification method" is a means of notifying a robot that has received a request of the optimal system and source of the inquiry.

[1725] "Storage means" refers to means of storing authentication information for robots and users.

[1726] "Encryption means" refers to a method for encrypting the authentication information that is stored.

[1727] "Means of provision" refers to means of searching for stored authentication information and providing it to the robot as needed.

[1728] Modes for carrying out the invention

[1729] The embodiments for carrying out the present invention will be described in detail below.

[1730] System configuration and program execution order

[1731] The system of the present invention provides a set of functions for receiving requests from users, selecting the optimal computing system, and notifying the user. Specifically, it includes the following main components:

[1732] Request receiving method: Receives application details from users.

[1733] Search method: The system corresponding to the application content is searched from the internal database.

[1734] Notification method: Notify users and robots of the selected computing system and the source of the inquiry.

[1735] Robot notification mechanism: Notifies the robot that received the request of the optimal system and source of the inquiry.

[1736] Storage method: Store authentication information.

[1737] Encryption method: Encrypt the authentication information to be stored.

[1738] Method of provision: Search for stored authentication information and provide it to the robot as needed.

[1739] Hardware and software usage

[1740] This system is designed to work in conjunction with robots located within the factory. The following are specific examples of hardware and software usage:

[1741] Server: The central management server within the factory performs request receiving, searching, notification, storage, encryption, and provisioning functions.

[1742] Database: Internal databases are used to store computer system information, query sources, and authentication information. SQLite is a concrete example.

[1743] Encryption library: The Python cryptography library is used to encrypt authentication information.

[1744] Program processing

[1745] When the server receives a request from a user, it searches its internal database for the most suitable computing system to meet that request. The server promptly notifies the user of the search results, as well as the robot that received the request. If the robot requires authentication information, the server provides it in encrypted form. These features enable the robot to efficiently utilize multiple systems and obtain authentication information securely and quickly.

[1746] Specific example

[1747] For example, consider a scenario where robot A in a factory wants to procure parts using a parts supply system. Robot A sends a request to a server. Upon receiving this request, the server searches its database for the most suitable computing system for the parts supply system and notifies robot A of the result. If necessary, it also provides robot A with encrypted authentication information. This allows robot A to procure parts quickly and improve production efficiency.

[1748] Example of a prompt

[1749] An example of a prompt for the generated AI model is: "Create a program that searches for the optimal system and contact information when a robot operating in a factory wants to use a parts supply system, and notifies the robot of that information. Also, ensure that it can store and retrieve authentication information."

[1750] The above describes specific embodiments for carrying out the present invention. This invention makes it possible for robots in factories to efficiently utilize a variety of systems and perform tasks safely and quickly.

[1751] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1752] Step 1:

[1753] A user sends a request to a server to use a specific service (e.g., a "parts supply system"). The request contains the details of the application. The server receives this request through a request receiving mechanism. The input is the user's request, and the output is the received request content.

[1754] Step 2:

[1755] The server searches its internal database for the most suitable computing system based on the received request. This search is performed using a search mechanism. The input is the received request, and the output is information about the best computing system found.

[1756] Step 3:

[1757] The server notifies the user of the best-finded computing system through a notification system. The input is information about the searched computing system, and the output is the notification sent to the user.

[1758] Step 4:

[1759] The server then searches its internal database for the source of the query for the relevant computing system. This search is also performed using a search mechanism. The input is information about the optimal computing system, and the output is information about the query source.

[1760] Step 5:

[1761] The server notifies the user of the source of the inquiry through a notification system. The input is the source of the inquiry, and the output is the notification content sent to the user.

[1762] Step 6:

[1763] The robot that receives the request sends a request to the server to obtain the necessary authentication information. The server receives this request and retrieves the authentication information from its internal database. The input is the request from the robot, and the output is the stored authentication information.

[1764] Step 7:

[1765] The server encrypts the retrieved authentication information and provides it to the robot. This process is carried out using encryption and provisioning methods. The input is the stored authentication information, and the output is the encrypted authentication information.

[1766] Step 8:

[1767] The server notifies the robot that sent the request of the encrypted authentication information obtained as a result of the processing via the robot notification mechanism. The input is the encrypted authentication information, and the output is the content of the notification to the robot.

[1768] The above describes the system's processing flow based on an application example. This enables robots within a factory to efficiently utilize the computer system and obtain necessary authentication information safely and quickly.

[1769] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1770] The system of the present invention assists users in selecting the optimal system when using multiple internal systems, enabling them to perform their tasks quickly and accurately. Furthermore, the system incorporates an emotion engine that recognizes the user's emotions and adjusts its response accordingly. Specific embodiments are described below.

[1771] 1. System Configuration

[1772] The system of the present invention includes the following main components:

[1773] Request receiving method: Receives application details and requests from users.

[1774] Search method: The system corresponding to the application content is searched from the internal database.

[1775] Notification method: Notify the user of the most suitable system and the appropriate contact point.

[1776] Storage method: Stores user authentication information.

[1777] Search method: Search for saved authentication information.

[1778] Delivery method: Provide search results to the user.

[1779] Encryption method: Authentication information is encrypted and stored.

[1780] Emotion Engine: Recognizes the user's emotions and selects the optimal response based on them.

[1781] 2. How to operate the system

[1782] The user's workflow for operating the system is as follows:

[1783] Request received:

[1784] Users use their devices to enter requests such as "leave requests" and send them to the support system.

[1785] System selection:

[1786] The server receives the request and searches its internal database for the corresponding system (in this case, it searches for the "Leave Management System").

[1787] The server notifies the user of the selected system.

[1788] Contact information:

[1789] The server searches its internal database for contact information related to the "Leave Management System" and notifies the user of the "Human Resources Department".

[1790] Storing authentication information:

[1791] The user enters their authentication information (ID and password) for the "vacation management system" and sends a save request to the system.

[1792] The server stores authentication information using encryption and notifies the user of the result.

[1793] Obtaining authentication information:

[1794] The user sends a request to retrieve previously saved credentials.

[1795] The server searches for stored authentication information and provides the results to the user.

[1796] If the server cannot find the relevant information, it will notify the user accordingly.

[1797] Emotion recognition and response:

[1798] Users input voice and facial expression data through the microphone and camera on their device.

[1799] The server's emotion engine analyzes the input data and recognizes the user's emotional state.

[1800] For example, if the emotion engine detects stress from the user's voice, it will offer the user suggestions for relaxation.

[1801] Furthermore, if we determine from the user's facial expression that they are dissatisfied, we will promptly encourage them to contact a support representative.

[1802] 3. Specific Examples

[1803] For example, the procedure for a user to submit a "leave request" is as follows:

[1804] 1. The user enters a "leave request" and submits the request to the support system.

[1805] 2. The server receives the request, searches for and selects the "vacation management system," and notifies the user.

[1806] 3. The server searches for the contact information for inquiries regarding the "Leave Management System" and notifies the user of the "Human Resources Department".

[1807] Next, the procedure for users to save their credentials is as follows:

[1808] 1. The user enters their ID and password for the "Leave Management System" and submits a save request.

[1809] 2. The server receives the request, encrypts and stores the authentication information, and notifies the user of the result.

[1810] Furthermore, the procedure for users to utilize the emotion engine is as follows:

[1811] 1. The user inputs voice and facial expression data using the microphone and camera on their device.

[1812] 2. The server's emotion engine analyzes this and recognizes the user's emotions.

[1813] 3. The server provides the user with the most appropriate response based on the emotions it recognizes.

[1814] These features allow users to quickly and accurately identify the most suitable system or contact point, while also managing their authentication information securely. Furthermore, by utilizing an emotion engine, users can receive appropriate support tailored to their emotions.

[1815] The following describes the processing flow.

[1816] When a user submits a leave request

[1817] Step 1:

[1818] The user uses their device to type "leave request" and sends the request to the support system.

[1819] Step 2:

[1820] The server receives the request.

[1821] Step 3:

[1822] Based on the application received by the server, it searches the internal database for the corresponding system (in this case, the "Leave Management System").

[1823] Step 4:

[1824] The server selects the most suitable system, the "vacation management system," based on the search results and notifies the user of that information.

[1825] Step 5:

[1826] The server then searches its internal database for contact information related to the "vacation management system."

[1827] Step 6:

[1828] The server finds the contact point, "Human Resources Department," and notifies the user of that information.

[1829] When saving authentication information

[1830] Step 1:

[1831] The user uses a terminal to enter their ID and password for the "Leave Management System" and sends a request to the support system to save their authentication information.

[1832] Step 2:

[1833] The server receives this request.

[1834] Step 3:

[1835] The server encrypts the received ID and password.

[1836] Step 4:

[1837] The server stores encrypted authentication information in its internal database.

[1838] Step 5:

[1839] The server notifies the user of the saved results.

[1840] When obtaining authentication information

[1841] Step 1:

[1842] The user uses their device to send a request to retrieve previously saved credentials for the "Leave Management System".

[1843] Step 2:

[1844] The server receives this request.

[1845] Step 3:

[1846] The server searches its internal database for the corresponding authentication information.

[1847] Step 4:

[1848] The server provides the user with the relevant authentication information based on the search results (in this case, the information is decrypted before being provided).

[1849] Step 5:

[1850] If the server cannot find the corresponding authentication information, it will notify the user accordingly.

[1851] When using an emotion engine

[1852] Step 1:

[1853] The user inputs voice and facial expression data using the microphone and camera on their device.

[1854] Step 2:

[1855] The server's emotion engine analyzes the input data and recognizes the user's emotional state.

[1856] Step 3:

[1857] The server selects the most appropriate response based on the emotions it perceives.

[1858] Step 4:

[1859] The server will be selected and the user will be notified of the corresponding action.

[1860] Specific example

[1861] For example, here is a specific example of when a user submits a "leave request":

[1862] 1. The user enters a "leave request" and submits the request to the support system.

[1863] 2. The server receives the request, searches for and selects the "vacation management system," and notifies the user of that information.

[1864] 3. The server searches for the contact person for inquiries regarding the "Leave Management System" and notifies the "Human Resources Department".

[1865] Next, here is a specific example of when a user saves their authentication information:

[1866] 1. The user enters their ID and password for the "Leave Management System" and submits a save request.

[1867] 2. The server receives the request, encrypts and stores the authentication information, and notifies the result.

[1868] Furthermore, specific examples of how users utilize the emotion engine are as follows:

[1869] 1. The user inputs voice and facial expression data using the microphone and camera on their device.

[1870] 2. The server's emotion engine analyzes the user's voice, for example, and if it detects stress, it analyzes that information.

[1871] 3. Based on the emotions the server recognizes, it will notify the user with suggestions, such as relaxation techniques.

[1872] (Example 2)

[1873] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1874] Currently, it is difficult for users to quickly and accurately select the optimal system when using multiple internal systems. Furthermore, mechanisms for securely managing user authentication information and providing appropriate responses tailored to user emotions are insufficient. As a result, problems such as decreased work efficiency and increased user stress are occurring.

[1875] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1876] In this invention, the server includes a request receiving means for selecting the optimal information processing device based on the user's request; a search means for searching for an information processing device corresponding to the request from internal storage; a notification means for notifying the user of the selected information processing device; a search means for searching for the contact point for the relevant information processing device from internal storage; a notification means for notifying the user of the contact point; and an emotion recognition means for recognizing the user's emotions and adjusting the response accordingly. As a result, the user can not only quickly and accurately identify the optimal system and contact point, but also receive an appropriate response that is in line with their emotions.

[1877] A "request receiving means" is a device or system for receiving application details or requests from users.

[1878] A "search method" refers to a device or system for finding the most suitable information processing device or contact point from internal storage based on the received application content.

[1879] "Notification means" refers to a device or system that informs the user of the retrieved information processing device or contact information.

[1880] An "emotion recognition means" is a device or system that analyzes a user's voice and facial expression data to recognize their emotional state and determine a response appropriate to that state.

[1881] "Storage means" refers to a device or system for storing user authentication information.

[1882] "Means of provision" refers to a device or system for retrieving stored authentication information and providing the results to the user.

[1883] "Encryption means" refers to a device or system for encrypting user authentication information and securely storing that information.

[1884] Modes for carrying out the invention

[1885] The system of the present invention aims to help users quickly and accurately access multiple internal systems. In particular, the system incorporates an emotion engine that recognizes the user's emotions and adjusts its response accordingly.

[1886] Hardware and software to be used

[1887] Server: Responsible for the main processing. Specifically, it handles request reception, system lookups, notifications, query lookups, authentication information storage and retrieval, and sentiment recognition. Database operations and encryption processing are also performed here.

[1888] Terminal: An input device used by a user. This includes PCs and smartphones.

[1889] Internal storage: Connected to the server, including a database that stores system information, contact details, and authentication information.

[1890] Encryption device: Encrypts authentication information using encryption algorithms such as AES or RSA.

[1891] System Configuration

[1892] The system of the present invention includes the following main components:

[1893] Request reception method: Users use their devices to input application details and requests via a browser or dedicated application and send them to the server.

[1894] Search method: After the server receives a request from a user, it searches its internal storage for the corresponding system. SQL queries and NoSQL queries are used as search algorithms.

[1895] Notification method: The server notifies the user of the search results. Information is sent to the user using HTTP responses or WebSockets.

[1896] Inquiry contact search method: The server searches its internal storage for contact information related to the system in question and notifies the user of the results.

[1897] Storage method: The user enters authentication information (ID and password) using a terminal and sends it to the server. The server receives this information, encrypts it using an encryption device, and stores it in its internal storage device.

[1898] Emotion recognition method: User voice and facial expression data are input through the device's microphone and camera and sent to the server. The emotion engine analyzes this data and responds based on the user's emotional state.

[1899] Usage example

[1900] For example, the procedure for a user to submit a "leave request" is as follows:

[1901] 1. The user enters a "leave request" and submits the request to the support system.

[1902] 2. The server receives the request, searches for and selects the "vacation management system," and notifies the user.

[1903] 3. The server searches for the contact information for inquiries regarding the "Leave Management System" and notifies the user of the "Human Resources Department".

[1904] Next, the procedure for users to save their credentials is as follows:

[1905] 1. The user enters their ID and password for the "Leave Management System" and submits a save request.

[1906] 2. The server receives the save request, encrypts and saves the authentication information, and notifies the server of the result.

[1907] Furthermore, the procedure for users to utilize the emotion engine is as follows:

[1908] 1. The user inputs voice and facial expression data using the microphone and camera on their device.

[1909] 2. The server's emotion engine analyzes this and recognizes the user's emotions.

[1910] 3. The server provides the user with the most appropriate response based on the emotions it recognizes.

[1911] Example of a prompt

[1912] The following are specific examples of prompt statements for generative AI models:

[1913] "Please provide a detailed description of the user's vacation request process. In particular, please explain in detail how the request is received, how the system is selected, how contact information is provided, how authentication information is stored and retrieved, and how sentiment recognition and response are handled."

[1914] This allows users to quickly and accurately identify the most suitable system or contact point, as well as receive appropriate responses that are tailored to their emotional needs.

[1915] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1916] Step 1:

[1917] Request Input

[1918] The user uses a terminal to log in to the support system interface. For example, the user enters request information, such as a "leave request," through a browser or dedicated application and presses the "submit" button. This sends the request data to the server. The input is the request information made by the user, and the output is an HTTP request containing the user's input data.

[1919] Step 2:

[1920] Request received

[1921] The server receives a request from the user. Specifically, the server receives an HTTP request and parses its contents. The request data is temporarily stored in memory. The input is the HTTP request sent by the user, and the output is the parsed request data.

[1922] Step 3:

[1923] System Search

[1924] Based on the request data received by the server, it searches its internal storage for the corresponding information processing device. For example, if the request is "leave request," the server searches for "leave management system." It uses SQL queries or NoSQL queries to retrieve the matching system from the database. The input is the request data, and the output is the search result, "leave management system."

[1925] Step 4:

[1926] System Notification

[1927] The server notifies the user of the search results. Specifically, the server generates a message such as "A vacation management system has been selected" and sends it to the user's terminal. Notifications are made using HTTP responses or WebSockets. The input is the search results, and the output is the notification message to the user.

[1928] Step 5:

[1929] Contact information search

[1930] The server searches its internal storage for contact information related to the "Leave Management System" (e.g., Human Resources Department). The server then uses SQL or NoSQL queries to retrieve the appropriate contact information. The input is information about the "Leave Management System," and the output is the retrieved contact information.

[1931] Step 6:

[1932] Contact information notification

[1933] The server retrieves contact information and notifies the user. HTTP responses and WebSockets are used as notification methods. The input is the contact information, and the output is the notification message to the user.

[1934] Step 7:

[1935] Enter authentication information

[1936] The user enters their authentication information (ID and password) for the "Leave Management System" into the interface and sends a save request. This sends the authentication information to the server. The input is the authentication information entered by the user, and the output is the save request sent to the server.

[1937] Step 8:

[1938] Authentication information storage

[1939] The server receives a save request and encrypts the authentication information. Specifically, it encrypts the authentication information using an encryption algorithm such as AES or RSA, and then saves it to internal storage. Once saving is complete, it notifies the user of the result. The input is the user's authentication information and save request, and the output is the encrypted authentication information and the saving result notification.

[1940] Step 9:

[1941] Authentication information acquisition

[1942] A request is sent to retrieve previously saved authentication information from the user. The user presses the "Retrieve Authentication Information" button to send a request to the server. The input is the user's retrieval request, and the output is the request data sent to the server.

[1943] Step 10:

[1944] Authentication Information Search

[1945] The server searches its internal storage for stored authentication information. If the matching authentication information is found, it is decrypted and provided to the user. If it is not found, the user is notified accordingly. The input is the user's retrieval request and the encrypted authentication information, and the output is the decrypted authentication information or a notification stating "Information not found."

[1946] Step 11:

[1947] Emotional data entry

[1948] The user inputs voice and facial expression data using the microphone and camera on their device. The input data is sent to the server in real time. The input is the user's voice and facial expression data, and the output is the emotion data sent to the server.

[1949] Step 12:

[1950] emotion recognition

[1951] The server's emotion engine analyzes input data and recognizes the user's emotional state. Specifically, it uses machine learning models or deep learning models to identify emotions from voice and facial expressions. The input is the user's voice and facial expression data, and the output is data of the recognized emotional state.

[1952] Step 13:

[1953] Emotion-based responses

[1954] The server provides the user with the most appropriate response based on the emotions it recognizes. For example, if stress is detected, it offers suggestions for relaxation. If the user is feeling dissatisfied, it prompts them to contact support immediately. The input is recognized emotional state data, and the output is suggested responses or notifications to the user.

[1955] (Application Example 2)

[1956] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1957] In factory and other work environments, prompt and accurate responses to various applications and inquiries are required, but reducing the psychological burden on workers is also a crucial issue. While conventional systems can select the most appropriate system and notify contact information based on the application content, they cannot respond based on the emotional state of the workers. Therefore, it is difficult for workers to receive appropriate support when they experience stress or dissatisfaction.

[1958] In Application Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes a request receiving means for selecting the optimal system based on the content of the application from the user, a search means for searching an internal database for a system corresponding to the content of the application, a notification means for notifying the user of the selected system, a search means for searching an internal database for the contact point of the relevant system, a notification means for notifying the user of the contact point, an emotion engine means for recognizing the user's emotions and adjusting the response based on the emotional state, and an image acquisition means for acquiring an image using a camera and providing the image data to the emotion engine. As a result, workers can not only make applications and inquiries quickly and accurately, but also receive appropriate support according to their emotional state.

[1959] A "request receiving means" is a device or function that receives application details from a user and acquires data for processing those details.

[1960] A "search tool" is a device or function that retrieves corresponding information from a predetermined database based on the user's application details.

[1961] "Notification means" refers to a device or function used to communicate information retrieved by the system to the user.

[1962] An "emotion engine" is a device or function that analyzes data such as a user's voice and facial expressions to recognize their emotions and psychological state.

[1963] "Image acquisition means" refers to a device or function that acquires image data using a camera or similar device and processes it.

[1964] "Storage means" refers to a device or function for securely storing user authentication information and other data.

[1965] "Authentication means" refers to a device or function that verifies and grants access rights using authentication information entered by the user.

[1966] "Encryption means" refers to a device or function that prevents unauthorized access by third parties by encrypting stored authentication information and other data.

[1967] "Means of provision" refers to a device or function that provides users with acquired data, such as retrieved information or authentication information.

[1968] This invention is a system that assists users in selecting the optimal system and responding quickly when making various requests or inquiries within a factory. This system includes a request receiving means, a search means, a notification means, an emotion engine means, an image acquisition means, a storage means, an authentication means, an encryption means, and a provision means.

[1969] System Configuration

[1970] The system includes the following main components:

[1971] 1. Request receiving method: Receives application details from the user's terminal (smart glasses).

[1972] 2. Search method: The system corresponding to the request is searched from the internal database.

[1973] 3. Notification method: The user will be notified of the selected system and the appropriate contact point.

[1974] 4. Emotion Engine: Uses cameras and microphones to recognize the user's emotions and adjusts responses accordingly.

[1975] 5. Image acquisition means: Image data is acquired using a camera built into the smart glasses and provided to the emotion engine means.

[1976] 6. Storage method: Store user authentication information.

[1977] 7. Authentication method: Access permission is verified and granted using the user's authentication information.

[1978] 8. Encryption method: Encrypt the stored authentication information.

[1979] 9. Means of delivery: Provide search results and acquired data to the user.

[1980] Operation overview

[1981] When a user uses smart glasses to submit a request or inquiry within the factory, the system operates as follows: First, the user uses the smart glasses to input the request details (e.g., "Request assistance for machine malfunction") and submits the request. The request receiving device receives this request, and the search device searches the internal database for a corresponding system. Once a system is selected, the notification device notifies the user of the selection result and the contact information.

[1982] Furthermore, this system uses the smart glasses' camera and microphone to capture the user's facial expressions and voice in order to recognize the user's emotions and take appropriate action based on their emotional state. The image acquisition means provides this data to the emotion engine means, which analyzes the user's emotional state. For example, if the user is feeling stressed, the emotion engine means will provide suggestions to promote relaxation.

[1983] As a concrete example, consider a scenario where a factory worker requests support regarding a machine malfunction. The user uses smart glasses to type, "The packaging machine on line 5 has malfunctioned. I request technical assistance," and sends the request. The system receives this request, selects the appropriate maintenance system, and notifies the user. Furthermore, it uses a camera to capture the situation on-site, and an emotion engine analyzes this data. If it determines that the user is experiencing significant stress, it immediately prompts them to contact a support representative. Specific examples of prompt messages include the following:

[1984] "Currently, the packaging machine on Line 5 has malfunctioned. We request technical assistance."

[1985] "Error code 123 is being displayed at the site."

[1986] "I'm showing the problem area to the camera on my smart glasses."

[1987] In this way, users can submit applications quickly and accurately, receive appropriate support, and even receive responses tailored to their emotional state.

[1988] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1989] Step 1:

[1990] The user enters the application details using smart glasses. An example of the input is an application requesting assistance with a machine malfunction. This input is sent to the request receiving system via the smart glasses' UI. The input data is in text format and is received by the server.

[1991] Step 2:

[1992] The server receives the application details sent by the user using a request receiving mechanism. Here, the application details are received as a string, and data processing is performed to parse the type of request. The received data is temporarily stored within the system.

[1993] Step 3:

[1994] The server's search mechanism uses an internal database to search for a corresponding system based on the received application content. In this step, keyword matching is performed on the application content to identify the relevant system (e.g., "maintenance system"). The search results are read from the database, and the relevant system is selected.

[1995] Step 4:

[1996] The server's notification system notifies the user of the selected system. At the same time, the system also retrieves the contact information for that system (e.g., "Maintenance Department") from its internal database and notifies the user accordingly. The notification content is sent as a text message to the user's smart glasses.

[1997] Step 5:

[1998] The user uses the camera and microphone on their smart glasses to record the situation on site and sends the data to the server. Audio and video data are input in this step. The input data is sent from the user's device to the server.

[1999] Step 6:

[2000] The server's image acquisition mechanism receives video and audio data sent from the user. The received data is temporarily stored. In this step, data processing such as video data compression and audio data noise reduction is performed.

[2001] Step 7:

[2002] The server's emotion engine analyzes the received video and audio data to recognize the user's emotions. In this step, a generative AI model is used to identify emotions (e.g., "stress" or "dissatisfaction") from the user's facial expressions and voice. The analysis results are output as numerical data.

[2003] Step 8:

[2004] The server determines the appropriate response based on the emotional state recognized by the emotion engine. For example, if the user is feeling stressed, it will offer suggestions for relaxation (e.g., "Take a deep breath"). This response is generated in text format.

[2005] Step 9:

[2006] The server sends the generated response details to the user via a notification system. The response details are displayed as a text notification on the user's smart glasses. This notification ensures that appropriate support is provided.

[2007] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[2008] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2009] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[2010] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2011] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[2012] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[2013] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[2014] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[2015] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[2016] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[2017] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[2018] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[2019] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[2020] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2021] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[2022] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[2023] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[2024] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[2025] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[2026] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[2027] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference.

[2028] The following is further disclosed regarding the embodiments described above.

[2029] (Claim 1)

[2030] To select the optimal system based on the user's application details.

[2031] Request receiving method,

[2032] A search method for searching the internal database for a system corresponding to the application content,

[2033] A notification method for informing the user of the selected system,

[2034] A search method for finding the contact information for the relevant system from the internal database,

[2035] A notification method for informing users of contact information,

[2036] A system that includes this.

[2037] (Claim 2)

[2038] A means of storing user authentication information,

[2039] A search method for searching for saved authentication information,

[2040] A means of providing search results to users,

[2041] The system according to claim 1, further comprising:

[2042] (Claim 3)

[2043] The system according to claim 2, comprising encryption means for encrypting and storing authentication information.

[2044] "Example 1"

[2045] (Claim 1)

[2046] A request receiving mechanism for selecting the most appropriate method based on the user's application details,

[2047] A search means for searching for means corresponding to the application content from internal storage,

[2048] A notification method for informing the user of the selected method,

[2049] A search means for searching for the contact information for the relevant means from the internal storage device,

[2050] A notification method for informing users of contact information,

[2051] A means of storing user authentication information,

[2052] A search method for searching for saved authentication information,

[2053] A means of providing search results to users,

[2054] An encryption method for encrypting and storing authentication information,

[2055] A system that includes this.

[2056] (Claim 2)

[2057] The system according to claim 1, which includes a process of receiving request data and searching for a system corresponding to the application content.

[2058] (Claim 3)

[2059] The system according to claim 1, which includes a process of notifying the user of query information retrieved from an internal storage device, and storing and retrieving encrypted authentication information.

[2060] "Application Example 1"

[2061] (Claim 1)

[2062] A means for receiving requests to select the optimal computing system based on the content of the user's application,

[2063] A search method for searching an internal database for a computer system corresponding to the application details,

[2064] A notification means for informing the user of the selected computer system,

[2065] A search method for retrieving the source of queries for the relevant computer system from an internal database,

[2066] A notification method to inform the user of the source of the inquiry,

[2067] A robot notification means for notifying the robot that received the request of the optimal system and the source of the inquiry,

[2068] A means of storing authentication information,

[2069] An encryption method for storing and encrypting the saved authentication information,

[2070] A means for searching for stored authentication information and providing it to the robot as needed,

[2071] A system that includes this.

[2072] (Claim 2)

[2073] The system according to claim 1, comprising means for notifying a robot that has received a request for an optimal computing system, and means for encrypting and storing authentication information.

[2074] (Claim 3)

[2075] The system according to claim 1, comprising means for searching for the optimal computing system and notifying the robot.

[2076] "Example 2 of combining an emotion engine"

[2077] (Claim 1)

[2078] A request receiving means for selecting the optimal information processing device based on the application content from the user,

[2079] A search means for searching for an information processing device corresponding to the application content from the internal storage device,

[2080] A notification means for notifying the user of the selected information processing device,

[2081] A search means for searching for the query destination of the relevant information processing device from its internal storage device,

[2082] A notification method for informing users of contact information,

[2083] An emotion recognition means for recognizing the user's emotions and adjusting responses according to those emotions,

[2084] A system that includes this.

[2085] (Claim 2)

[2086] A means of storing user authentication information,

[2087] A search method for searching for saved authentication information,

[2088] A means of providing search results to users,

[2089] The system according to claim 1, further comprising:

[2090] (Claim 3)

[2091] The system according to claim 2, comprising encryption means for encrypting and storing authentication information.

[2092] "Application example 2 when combining with an emotional engine"

[2093] (Claim 1)

[2094] A means for receiving requests to select the optimal system based on the content of the user's application,

[2095] A search method for retrieving a system corresponding to the application content from an internal database,

[2096] A notification method for informing the user of the selected system,

[2097] A search method for finding the contact information for the relevant system from the internal database,

[2098] A notification method for informing users of contact information,

[2099] An emotion engine means for recognizing the user's emotions and adjusting responses based on their emotional state,

[2100] An image acquisition means for acquiring images using a camera and providing the image data to an emotion engine,

[2101] A system that includes this.

[2102] (Claim 2)

[2103] A means of storing user authentication information,

[2104] A search method for retrieving saved authentication information,

[2105] A means of providing search results to users,

[2106] An authentication means for granting access permission to a specified system using authentication information,

[2107] The system according to claim 1, further comprising:

[2108] (Claim 3)

[2109] The system according to claim 2, comprising encryption means for encrypting and storing authentication information. [Explanation of Symbols]

[2110] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. To select the optimal system based on the user's application details. Request receiving method, A search method for searching the internal database for a system corresponding to the application content, A notification method for informing the user of the selected system, A search method for finding the contact information for the relevant system from the internal database, A notification method for informing users of contact information, A system that includes this.

2. A means of storing user authentication information, A search method for searching for saved authentication information, A means of providing search results to users, The system according to claim 1, further comprising:

3. The system according to claim 2, comprising encryption means for encrypting and storing authentication information.

Images