system

Abstract

We provide the system. [Solution] A means for inputting user authentication information, A means for sending the authentication information to a server and for the server to perform authentication, A means to obtain user profile information and display the main menu upon successful authentication, A means for obtaining the necessary data based on the function selected from the main menu and executing the function, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The operations of conventional administrative departments are diverse and complex, and it is difficult to process them efficiently, so there is a problem of imposing a heavy burden on the persons in charge. Specifically, there were many manual operations such as managing employee information and approving vacation applications, mistakes were likely to occur, and the progress of the operations might be delayed. In addition, the authentication process and data consistency might not be maintained, which might also affect the security and reliability of the company.

Means for Solving the Problems

[0005] The present invention provides a system for improving the efficiency of operations of administrative departments and reducing the burden on the persons in charge. Specifically, it provides a system including the following means.

[0006] The system includes means for the user to enter authentication information and send that information to the server, and means for the server to perform authentication, obtain the user's profile information if authentication is successful, and display the main menu. Furthermore, it includes means for obtaining the necessary data based on the function selected from the main menu and executing that function.

[0007] When a user selects the employee information management function, it provides means to view, edit, add, or delete employee information. This enables accurate and consistent management of employee information.

[0008] This system provides a means for users to input information for leave requests and send that information to a server, and a means for the server to store the request information in a database and send notifications to approvers. Furthermore, by providing a means for approvers to approve or reject the requests, it enables an efficient and accurate leave approval process. This improves the accuracy and efficiency of operations and reduces the burden on staff.

[0009] "User authentication information" refers to information used to verify the user's identity, and specifically includes the user ID and password.

[0010] A "server" is a computer system that provides services over a network, receives requests from users, and processes them.

[0011] A "device" is a device used by a user to operate something, and generally refers to a personal computer, tablet, or smartphone.

[0012] "Profile information" refers to data that includes personal information and settings about a user, and is used within the system to identify the user and manage their permissions.

[0013] The "main menu" is a list of options displayed after a user logs into the system, and serves as an interface for selecting various functions.

[0014] "Employee information management" refers to providing functions for inputting, displaying, editing, and deleting employees' personal information, work history, contact information, etc.

[0015] "CRUD operations" is an acronym for Create, Read, Update, and Delete, and refers to basic operations performed on data in a database.

[0016] "Leave application" is the process by which an employee enters application information to request leave and submits it to an approver.

[0017] A "notification" is a message sent from a server to a user or approver that informs them that a specific event or operation has occurred.

[0018] An "approver" is a user who has the authority to review applications such as leave requests and decide whether to approve or reject them.

[0019] A "database" is a system for efficiently storing, searching, and managing large amounts of data. [Brief explanation of the drawing]

[0020] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6]It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which a plurality of emotions are mapped. [Figure 10] It shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when an emotion engine is combined.

Embodiments for Carrying Out the Invention

[0021] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0022] First, the language used in the following description will be explained.

[0023] In the following embodiments, the signed processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Furthermore, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include CPU (Central Processing Unit), GPU (Graphics Processing Unit), GPGPU (General-Purpose computing on Graphics Processing Units), and APU (Accelerated Processing Unit).

[0024] In the following embodiments, signed RAM (Random Access Memory) is a memory that temporarily stores information and is used as work memory by the processor.

[0025] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0026] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0027] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0028] [First Embodiment]

[0029] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0030] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0031] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0032] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0033] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0034] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0035] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0036] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0037] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0038] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0039] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0040] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0041] This invention provides a system to streamline administrative operations and reduce the burden on staff. This system enables efficient and accurate work execution, starting with user authentication, followed by selection from the main menu, and processing of various tasks.

[0042] User authentication phase

[0043] The user enters their user ID and password on the login screen on their device. The device sends this authentication information to the server. The server queries its database for the received authentication information to verify its validity. If authentication is successful, the server returns the user's profile information to the device, the device displays a message indicating successful login, and then displays the main menu as the next step.

[0044] Displaying and selecting from the main menu

[0045] The server generates an appropriate main menu based on the user's job title and permissions and sends it to the terminal. The terminal displays the received main menu on its screen. The user selects the function they want to manage from the main menu, such as "Employee Information Management" or "Leave Approval." Based on the selected function, the server retrieves the necessary data from the database and sends it to the terminal.

[0046] Employee information management

[0047] For example, if a user selects the "Employee Information Management" function, the server retrieves information on all employees from the database and sends it to the terminal. The terminal displays a list of employee information, and the user can view, edit, add, or delete information on specific employees. The results of these operations are reflected in the database via the server.

[0048] Vacation Approval Process

[0049] When a user (employee) submits a leave request, they enter the necessary information on their terminal. Upon pressing the submit button, the terminal sends the information to the server. The server stores the information in its database and sends a notification to the approver. This notification is then sent from the server to the terminal, and the user (approver) reviews the details of the leave request before approving or rejecting it. The result of this action is again saved in the database, and the user (employee who submitted the request) is notified of the result.

[0050] Specific example

[0051] One day, an HR representative wants to log into the company's HR system to update employee information. Using their desktop computer, the HR representative enters their user ID and password on the login screen. Upon successful authentication, the main menu appears, and they select "Employee Information Management." The system displays a list of all employees, and the HR representative selects a specific employee and presses the "Edit" button. After updating the necessary information, they press the "Save" button, and the information is reflected in the database.

[0052] Furthermore, if another employee wishes to request leave, they open the leave request screen on their device, enter their request information, and press the submit button. The leave request is sent to the server, and a notification is sent to their supervisor. The supervisor reviews the request on their device and chooses to approve or reject it. Once the selection is complete, the result is notified to the applicant. In this way, various management tasks are performed efficiently and accurately.

[0053] The above describes the embodiment for carrying out the present invention. This system will improve the efficiency of the administrative department and reduce the burden on the staff. As a result, it is expected that the productivity of the entire organization will improve.

[0054] The following describes the processing flow.

[0055] User authentication phase

[0056] Step 1:

[0057] The user opens the login screen on their device and enters their user ID and password.

[0058] Step 2:

[0059] The terminal sends the entered authentication information to the server.

[0060] Step 3:

[0061] The server queries the database for the received authentication information to verify its accuracy.

[0062] Step 4:

[0063] If authentication is successful, the server retrieves the user's profile information.

[0064] Step 5:

[0065] The server sends a message to the terminal confirming successful authentication along with the user's profile information.

[0066] Step 6:

[0067] The device displays the main menu screen.

[0068] Displaying and selecting from the main menu

[0069] Step 1:

[0070] The server generates the main menu options based on the user's profile information.

[0071] Step 2:

[0072] The server sends the main menu options to the terminal.

[0073] Step 3:

[0074] The device displays the received main menu on its screen.

[0075] Step 4:

[0076] The user selects the desired function from the main menu.

[0077] Step 5:

[0078] The terminal sends the user's selection to the server.

[0079] Step 6:

[0080] The server retrieves the necessary data from the database based on the selected function.

[0081] Step 7:

[0082] The server sends the acquired data to the terminal.

[0083] Step 8:

[0084] The device displays a screen corresponding to the selected function.

[0085] Employee information management

[0086] Step 1:

[0087] The user selects the employee information management function.

[0088] Step 2:

[0089] The server retrieves information on all employees from the database.

[0090] Step 3:

[0091] The server sends the acquired employee information to the terminal.

[0092] Step 4:

[0093] The terminal displays a list of employee information on its screen.

[0094] Step 5:

[0095] Users can select specific employee information and perform actions such as viewing, editing, adding, or deleting it.

[0096] Step 6:

[0097] The terminal sends user actions to the server.

[0098] Step 7:

[0099] The server performs CRUD operations on the database based on the operation performed.

[0100] Step 8:

[0101] The server sends the operation results to the terminal.

[0102] Step 9:

[0103] The device updates the screen based on the operation result.

[0104] Vacation Approval Process

[0105] Step 1:

[0106] The user (employee) opens the leave request screen and enters the necessary information.

[0107] Step 2:

[0108] The terminal sends the entered application information to the server.

[0109] Step 3:

[0110] The server stores the application information in a database.

[0111] Step 4:

[0112] The server sends a notification of the leave request to the approver (supervisor).

[0113] Step 5:

[0114] The server sends the notification content to the approver's device.

[0115] Step 6:

[0116] The user (supervisor) checks the leave request notification on their terminal.

[0117] Step 7:

[0118] The user (supervisor) reviews the details of the leave request and chooses to approve or reject it.

[0119] Step 8:

[0120] The terminal sends the supervisor's selection to the server.

[0121] Step 9:

[0122] The server saves the selection results to the database.

[0123] Step 10:

[0124] The server sends a notification to the applicant.

[0125] Step 11:

[0126] The terminal displays the results to the applicant.

[0127] In this way, the administrative department's operations are streamlined, and a system is created that enables accurate data management and rapid leave approval.

[0128] (Example 1)

[0129] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0130] The administrative department's duties are diverse, requiring the management and approval of various types of information. However, traditional systems often involve manual operations, resulting in poor work efficiency and placing an excessive burden on staff. Furthermore, the lack of standardized processes poses a risk of data inaccuracy. In addition, it is difficult to grasp the status of various tasks in real time. Therefore, a system is needed to improve the efficiency and accuracy of administrative operations.

[0131] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0132] In this invention, the server includes means for inputting user authentication information, means for transmitting the authentication information to the server and for the server to perform authentication in cooperation with a database, means for obtaining user profile information upon successful authentication and generating and displaying a main menu based on the user's role and authority, and means for obtaining necessary data based on the function selected from the main menu and executing the function. This enables improved efficiency and accuracy in management operations and reduces the burden on the person in charge.

[0133] "User authentication information" refers to information that a user provides to identify themselves, and typically includes a user ID and password.

[0134] A "server" is a computer system that receives requests from client terminals on a network and performs data processing and responses.

[0135] A "database" is a system or software for organizing and storing data, and is managed in a way that allows for efficient searching and updating.

[0136] "Profile information" refers to user-specific information, including the user's job title, permissions, and personal information.

[0137] The "main menu" is a menu screen that is displayed to allow the user to select functions within the system.

[0138] "Position" refers to the job title or responsibilities a user holds within an organization.

[0139] "Permissions" refer to information that defines the range of operations a user can perform and the information they can access within a system.

[0140] A "function" is a program or module that performs a specific operation or process provided by a system.

[0141] "Employee information management" refers to system functions for registering, displaying, editing, or deleting employee personal data, work history, performance evaluation information, etc.

[0142] A "leave application" is the application process that an employee goes through to take leave for a certain period of time.

[0143] "Notification" refers to the transmission of information or messages from a system to a user, and is usually done via email or in-app notifications.

[0144] An "approver" is a user who has the authority to review and approve or reject submitted applications.

[0145] Modes for carrying out the invention

[0146] This invention is a system designed to streamline administrative tasks and reduce the burden on staff. This system enables efficient and accurate work execution, starting with user authentication, followed by selection from the main menu, and processing of various tasks. Specific embodiments are described in detail below.

[0147] User authentication phase

[0148] The user opens a browser (e.g., Google Chrome) on their desktop computer (e.g., Windows PC) or mobile device (e.g., iPhone®, Android® device) and enters their user ID and password on the login screen. The device sends this authentication information to the server using HTTPS. The server queries a database server (e.g., MySQL®) for the received authentication information to verify that the user ID and password match. If authentication is successful, the server sends the user's profile information to the device, which displays a message indicating successful login and then displays the main menu as the next step.

[0149] Displaying and selecting from the main menu

[0150] The server generates an appropriate main menu based on the user's job title and permissions. For example, administrators will see options such as "Employee Information Management" and "Leave Approval." The server sends the generated main menu to the terminal, which displays it on the screen. The user then selects the function they want to manage, such as "Employee Information Management" or "Leave Approval," from the main menu.

[0151] Employee information management

[0152] When a user selects the "Employee Information Management" function, the server retrieves information on all employees from the database and sends it to the terminal. The terminal displays a list of employee information, and the user selects a specific employee and performs actions such as "Edit," "Add New," or "Delete." The terminal receives these operations and sends the corresponding requests to the server. The server processes the requests and reflects the changes in the database.

[0153] Vacation Approval Process

[0154] When a user (employee) requests leave, they open the leave request screen on their device and enter the desired leave dates and reason. The device sends the entered request information to the server. The server stores the request information in a database and sends a notification to the approver (e.g., supervisor). This notification is sent using a mail server (e.g., Postfix) or a notification service (e.g., Firebase Cloud Messaging). The user (approver) reviews the details of the leave request on their device and approves or rejects it. The result of the action is again stored in the database, and the server sends the result to the device and notifies the user who submitted the request.

[0155] Specific examples of operation

[0156] One day, an HR representative wants to log into the company's HR system to update employee information. Using their desktop computer, the HR representative enters their user ID and password on the login screen. Upon successful authentication, the main menu appears, and they select "Employee Information Management." The system displays a list of all employees, and the HR representative selects a specific employee and presses the "Edit" button. After updating the necessary information, they press the "Save" button, and the information is reflected in the database.

[0157] Furthermore, if another employee wishes to request leave, they open the leave request screen on their device, enter their request information, and press the submit button. The leave request is sent to the server, and a notification is sent to their supervisor. The supervisor reviews the request on their device and chooses to approve or reject it. Once the selection is complete, the result is notified to the applicant. In this way, various management tasks are performed efficiently and accurately.

[0158] Examples of prompt statements

[0159] The following prompt sentences will be used as the generating AI model.

[0160] Please explain the program processing flow of the administrative department's business efficiency system, broken down into specific processing steps. Describe the user authentication, main menu display and selection, employee information management, and leave approval process, including their specific actions.

[0161] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0162] Step 1: Enter user authentication information

[0163] The user opens the login screen on their desktop or mobile device and enters their user ID and password. Based on this input, authentication information is generated. Specifically, the user enters the information using a keyboard or touchscreen.

[0164] Step 2: Submit authentication information

[0165] The terminal sends the entered authentication information to the server via HTTPS. In this process, encrypted data is sent to the server over the network. The terminal does this using its network interface.

[0166] Step 3: Verifying Authentication Information

[0167] The server verifies the received authentication information by querying the database. During this process, it executes a database query to confirm that the user ID and password match. The input is the authentication information, and the output is the authentication result. Specifically, the server executes an SQL query.

[0168] Step 4: Return of authentication results

[0169] If authentication is successful, the server retrieves the user's profile information from the database and sends it to the terminal. The input is the authentication result, and the output is the user's profile information. The server generates and sends the profile information in JSON format.

[0170] Step 5: Display the main menu

[0171] The terminal displays a user-specific main menu on its screen based on the received profile information. The input is profile information, and the output is the main menu screen. Specifically, the terminal generates a visual menu using HTML and JavaScript (registered trademark).

[0172] Step 6: Select a menu item

[0173] The user selects the function they want to manage from the main menu (e.g., employee information management, leave approval). The selected information is sent from the terminal to the server. Input is the user's selection, and output is the request to the server. Specifically, the user performs mouse clicks or touch operations.

[0174] Step 7: Data Acquisition

[0175] The server retrieves the necessary data from the database according to the selected function. The input is the menu selection information, and the output is the data corresponding to the function. For example, if employee information management is selected, an SQL query is executed to retrieve information on all employees.

[0176] Step 8: Displaying the data

[0177] The terminal displays data received from the server. Input is data from the server, and output is the screen display. Specifically, the terminal renders the data in a tabular or list format on an HTML page.

[0178] Step 9: Data manipulation (Employee information management)

[0179] Users view, edit, add, or delete specific employee information. The terminal sends these operation requests to the server. Input is the user's actions, and output is the request to the server. Specifically, the user fills out forms or clicks buttons.

[0180] Step 10: Update operation results

[0181] The server updates the database based on the operation request it receives. The input is the operation request, and the output is the update result. For example, if new employee information is added, an INSERT statement is executed on the database.

[0182] Step 11: Enter your leave request

[0183] The user (employee) opens the leave request screen on their device and enters the date and reason. The device sends the request information to the server. The input is the leave request information, and the output is the request to the server. Specifically, the user fills out the form and presses the submit button.

[0184] Step 12: Saving and notifying application information

[0185] The server stores the received application information in a database and sends a notification to the approver. The input is the leave application information, and the output is the database update and notification sending. The server executes SQL statements and sends notifications using a mail server or notification service.

[0186] Step 13: Approval or rejection process

[0187] The user (approver) reviews the application details on their terminal and approves or rejects them. The terminal sends this action to the server. The input is the approver's judgment, and the output is the request to the server. Specifically, the approver operates using dropdown menus and buttons.

[0188] Step 14: Notification of Results

[0189] The server stores the approval or rejection result in a database and notifies the applicant. The input is the approval result, and the output is the database update and the notification to the applicant. The server uses a notification service to send the result to the applicant.

[0190] Through the steps outlined above, this system achieves increased efficiency and accuracy in administrative tasks.

[0191] (Application Example 1)

[0192] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0193] Factory management tasks, particularly employee information management and leave approval processes, are time-consuming and labor-intensive, and efficiency improvements are needed. Furthermore, errors and delays are common due to managers manually operating multiple systems. Therefore, the challenge lies in streamlining factory management tasks, reducing errors, and improving productivity.

[0194] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0195] In this invention, the server includes means for inputting user authentication information, means for transmitting the authentication information to the server and for the server to perform authentication, means for obtaining user profile information and displaying a main menu if authentication is successful, means for obtaining necessary data based on the function selected from the main menu and executing the function, means for performing user authentication and operation through the interface of a factory robot, and means for operating factory management tasks (such as employee information management and leave approval) through the robot interface. This makes it possible for users to efficiently operate and manage management tasks within the factory.

[0196] "User authentication information" refers to the user's identification information and password required to access the system.

[0197] A "server" is a central computer system that processes information sent by users and handles authentication, data storage, and data retrieval.

[0198] "Profile information" refers to data used to determine a user's operational rights within the system, such as their personal information, job title, and permissions.

[0199] The "main menu" is a screen that displays a list of functions available to the user after logging in, allowing them to select from them.

[0200] A "function" refers to a specific operation or process that can be performed within a system, and includes administrative tasks such as employee information management and leave approval.

[0201] A "factory" is a facility where production lines, machines, and robots are installed and manufacturing operations are carried out.

[0202] A "robot interface" refers to input / output means such as touch panels and voice recognition devices installed on robots in factories.

[0203] "Employee information management" refers to a function that manages, edits, adds, and deletes employees' personal information, work status, job title, etc.

[0204] "Leave approval" is the process of approving or rejecting leave requests submitted by employees and notifying them of the result.

[0205] "Management duties" refer to various tasks necessary for the operation of the organization, such as managing personnel and labor within the factory, and maintaining and inspecting equipment.

[0206] This invention is a system for streamlining management operations within a factory, and is particularly aimed at automating employee information management and leave approval processes. The system consists of user authentication, main menu display, function selection, and execution phases. The system operates in conjunction with multiple robots within the factory and utilizes the following hardware and software.

[0207] Hardware and software

[0208] Hardware:

[0209] Factory robots: with touch panel or voice recognition capabilities.

[0210] Server: Processes and stores data.

[0211] software:

[0212] Python scripts: Programs for user authentication, data retrieval, and manipulation.

[0213] Request Module: A library for performing API communication.

[0214] Database: Stores user profile information and administrative data (e.g., MySQL, MongoDB).

[0215] Processing flow

[0216] 1. User Authentication Phase:

[0217] The factory manager logs in using the robot's touch panel or voice recognition interface. The login data is transmitted wirelessly to the server. The server queries its database for the received authentication information to verify its validity. If authentication is successful, the server retrieves the user's profile information and displays the main menu on the robot's interface.

[0218] 2. Displaying and selecting from the main menu:

[0219] Upon successful login, the main menu appears on the robot's interface. The user selects functions such as personnel management or leave approval. Based on the selected function, the server retrieves the necessary data from the database and sends it to the robot's interface.

[0220] 3. Execution of business functions:

[0221] Based on the selected function, the robot displays the necessary data, and the user performs the action. For example, if the user selects employee information management, the server retrieves information on all employees from the database and sends it to the robot. The user can then view, edit, add, or delete specific employee information. The results of these actions are reflected in the database via the server.

[0222] Specific example

[0223] Example 1: Editing employee information

[0224] When the administrator speaks "Login" to the factory robot's interface, the robot prompts "Please enter your User ID." The administrator enters "12345" and then enters their password. Upon successful login, the robot displays "Please select a main menu" and presents the options of "Employee Information Management" or "Leave Approval." The administrator selects "Employee Information Management," chooses a specific employee, and presses the "Edit" button. After updating the necessary information, pressing the "Save" button updates the information in the database.

[0225] Example 2: Approval of leave request

[0226] When a user submits a leave request using the factory robot interface, they select the "Leave Request" menu, enter the required information, and press the submit button. The leave request is sent to the server, and a notification is sent to the supervisor. The supervisor reviews the request on their terminal and chooses to approve or reject it. Once the selection is complete, the result is notified to the applicant.

[0227] Example of a prompt

[0228] To the robot assistant: "Login"

[0229] Robot: "Please enter your User ID."

[0230] Administrator: "12345"

[0231] Robot: "Please enter your password."

[0232] Administrator: [Enter password]

[0233] Robot: "Login successful. Please select a main menu item: 1. Employee Information Management, 2. Leave Approval."

[0234] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0235] Step 1:

[0236] The user either says "Login" to the factory robot's interface or a login screen is displayed on the touch panel. The system requests a user ID and password as input and sends this data to the server. The server queries a database for the user ID and password and performs authentication. The output is either a success or failure authentication result; if authentication is successful, the server retrieves the user's profile information and returns it to the terminal.

[0237] Step 2:

[0238] The terminal displays the user's profile information along with a message confirming successful authentication. It generates a main menu, presenting the user with options such as "Employee Information Management" or "Leave Approval." There is no input required, but the user's selection becomes the input for the next step. The output is the display of the main menu.

[0239] Step 3:

[0240] The user selects the function they want to manage from the main menu (e.g., employee information management). The input is the user's selection, and the terminal sends this selection to the server. Based on the selected function, the server retrieves the necessary data from the database and sends it to the terminal. The output is the retrieval and display of the corresponding data.

[0241] Step 4:

[0242] The terminal displays data received from the server and allows the user to interact with it. For example, in employee information management, it displays a list of all employees. The user can then edit, add, or delete specific employee information. Input is the user's actions, and output is a confirmation screen of those actions.

[0243] Step 5:

[0244] After a user completes an edit, add, or delete operation, the terminal sends the result of the operation to the server. The input is the operation result, and the server reflects this information in the database. The output is the database update result and a completion message for the user.

[0245] Step 6:

[0246] When a user submits a leave request, they enter the necessary application information (e.g., reason for leave, duration, etc.) on the leave request screen. The input is the user's application information, and the terminal sends this information to the server. The server saves the application information to a database and sends a notification to the approver. The output is the saved application information and the notification to the approver.

[0247] Step 7:

[0248] Upon receiving a notification from the server, the approver reviews the details of the leave request and decides to approve or reject it. Input is the approver's action, and the result is sent to the server. The server saves the result to a database and notifies the applicant. Output is the notification result sent to both the applicant and the approver.

[0249] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0250] This invention combines a system designed to streamline administrative tasks and reduce the burden on staff with an emotion engine that recognizes user emotions and provides a more appropriate interface. This system has the functionality to provide appropriate feedback and suggestions based on the user's emotional state, from user authentication to main menu selection and processing of various tasks.

[0251] User authentication phase

[0252] The user opens the login screen on their device and enters their user ID and password. The device sends this authentication information to the server. The server queries the received authentication information against its database to verify its accuracy. If authentication is successful, the server returns the user's profile information and data for displaying the main menu to the device. Simultaneously, the emotion engine analyzes the user's emotions based on their input and actions and sends the analysis results to the server.

[0253] Displaying and selecting from the main menu

[0254] The server generates a customized main menu based on the user's profile information and sentiment analysis results, and sends it to the terminal. The terminal displays the received main menu on its screen. The user selects the desired function from the main menu (e.g., employee information management, leave approval). Based on the selected function, the server retrieves the necessary data from the database and provides an interface tailored to the user's emotional state.

[0255] Employee information management

[0256] For example, if a user selects the "Employee Information Management" function, the server retrieves information on all employees from the database and sends it to the terminal. The terminal displays a list of employee information, and the user can view, edit, add, or delete information on specific employees. The emotion engine analyzes the user's emotions during these operations and modifies the interface accordingly. This supports the user in working without stress.

[0257] Vacation Approval Process

[0258] When a user (employee) submits a leave request, they enter the necessary information on their terminal and press the submit button. The terminal sends the request information to the server. The server stores the request information in a database, sends a notification to the approver, and analyzes the applicant's emotional state using an emotion engine to provide appropriate feedback. The supervisor receives the leave request notification on their terminal, reviews the details, and then approves or rejects the request. The result of this action is again stored in the database, and the applicant is notified of the result. At this time, the emotion engine analyzes the emotional states of both the supervisor and the applicant, and provides an interface that is designed to minimize stress for both parties.

[0259] Specific example

[0260] One day, an HR representative logs into the system. As they enter their login information, the emotion engine analyzes their typing speed and the frequency of errors to determine if they are emotionally unstable. After successful authentication, the server displays a main menu tailored to the user's state, displaying a gentle message such as, "What can we help you with today?" When the HR representative selects "Employee Information Management," the emotion engine, having detected stress, switches to an intuitive and easy-to-use interface.

[0261] Similarly, when another employee submits a leave request, the emotion engine analyzes their urgency and presents a concise input form. When a supervisor approves the request, the emotion engine analyzes the supervisor's emotional state and provides appropriate feedback.

[0262] In this way, the present invention improves the usability of the system by analyzing the user's emotional state, thereby achieving increased operational efficiency and reduced workload for the person in charge.

[0263] The following describes the processing flow.

[0264] User authentication phase

[0265] Step 1:

[0266] The user opens the login screen on their device and enters their user ID and password.

[0267] Step 2:

[0268] The terminal sends the entered authentication information to the server.

[0269] Step 3:

[0270] The server queries the database for the received authentication information to verify its accuracy.

[0271] Step 4:

[0272] If the authentication on the server is successful, it will obtain the user's profile information and send the input data during the login operation to the emotion engine.

[0273] Step 5:

[0274] The emotion engine analyzes the user's emotion and sends the result to the server.

[0275] Step 6:

[0276] The server sends the user's profile information and the emotion analysis result to the terminal.

[0277] Step 7:

[0278] The terminal displays the main menu screen.

[0279] Display and Selection of the Main Menu

[0280] Step 1:

[0281] Based on the user's profile information and the emotion analysis result, the server generates the options for the main menu.

[0282] Step 2:

[0283] The server sends the options of the main menu to the terminal.

[0284] Step 3:

[0285] The terminal displays the received main menu on the screen.

[0286] Step 4:

[0287] The user selects the desired function from the main menu.

[0288] Step 5:

[0289] The terminal sends the user's selection to the server.

[0290] Step 6:

[0291] The server retrieves the necessary data from the database based on the selected function.

[0292] Step 7:

[0293] The emotion engine suggests an appropriate interface based on the user's emotions and sends the result to the server.

[0294] Step 8:

[0295] The server sends the acquired data along with suggestions from the emotion engine to the terminal.

[0296] Step 9:

[0297] The device displays a screen corresponding to the selected function and adjusts the user interface accordingly.

[0298] Employee information management

[0299] Step 1:

[0300] The user selects the employee information management function.

[0301] Step 2:

[0302] The server retrieves information on all employees from the database.

[0303] Step 3:

[0304] The server sends the acquired employee information to the terminal.

[0305] Step 4:

[0306] The terminal displays a list of employee information on its screen.

[0307] Step 5:

[0308] The user selects specific employee information and performs operations such as viewing, editing, newly adding, or deleting.

[0309] Step 6:

[0310] The terminal sends the user's operation content to the server.

[0311] Step 7:

[0312] The server executes CRUD operations on the database based on the operation content.

[0313] Step 8:

[0314] The emotion engine analyzes the emotion of the user during the operation and sends the result to the server.

[0315] Step 9:

[0316] The server sends the operation result to the terminal.

[0317] Step 10:

[0318] The terminal updates the screen based on the operation result and performs interface adjustment reflecting the result of the emotion engine.

[0319] Vacation Approval Process

[0320] Step 1:

[0321] The user (employee) opens the vacation application screen and enters the necessary information.

[0322] Step 2:

[0323] The terminal sends the entered application information to the server.

[0324] Step 3:

[0325] The server stores the application information in a database.

[0326] Step 4:

[0327] The emotion engine analyzes the user's emotions based on input content and input speed, and sends the results to the server.

[0328] Step 5:

[0329] The server sends a notification of the leave request to the approver (supervisor) and also notifies them of the applicant's emotional state.

[0330] Step 6:

[0331] The server sends the notification content to the approver's device.

[0332] Step 7:

[0333] The user (supervisor) checks the leave request notification on their terminal.

[0334] Step 8:

[0335] The user (supervisor) reviews the details of the leave request and chooses to approve or reject it.

[0336] Step 9:

[0337] The terminal sends the supervisor's selection to the server.

[0338] Step 10:

[0339] The server saves the selection results to the database.

[0340] Step 11:

[0341] The emotion engine analyzes the boss's emotions and sends the results to the server.

[0342] Step 12:

[0343] The server notifies the applicant of the result and provides feedback that reflects the results of the emotion engine.

[0344] Step 13:

[0345] The device displays the results to the applicant and provides feedback from the emotion engine.

[0346] In this way, the operations of the administrative department are streamlined, and a flexible interface that responds to the user's emotional state is provided, resulting in improved accuracy and reduced workload for the person in charge.

[0347] (Example 2)

[0348] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0349] Current business management systems often cause user stress because they provide a uniform interface without considering the user's emotional state. Furthermore, improvements in work efficiency and reduction of the burden on employees are not sufficiently achieved. This is particularly due to the provision of inappropriate feedback during operations that users find stressful or critical. Therefore, there is a need for a system that appropriately analyzes the user's emotional state and provides an interface and feedback accordingly.

[0350] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0351] In this invention, the server includes means for inputting user authentication information, means for transmitting the authentication information to the server and for the server to perform authentication, means for acquiring user profile information and displaying a customized main menu based on the sentiment analysis results if authentication is successful, and means for acquiring necessary data based on the function selected from the main menu and providing an appropriate interface according to the sentiment analysis results. This enables the provision of an interface and feedback that responds to the user's emotional state, thereby improving work efficiency and reducing the burden on the person in charge.

[0352] "User authentication information" refers to the information that a user enters to access the system, and typically consists of a user ID and password.

[0353] A "server" is a computer system that sends and receives data over a network and provides authentication, manages profile information, and offers interfaces based on the results of sentiment analysis.

[0354] "Profile information" refers to data that includes personal information and settings information about the user, and is used to provide information based on the user's usage history and preferences.

[0355] "Emotional analysis results" refer to the estimated emotional state of a user, based on data such as the user's operation speed and error frequency.

[0356] A "customized main menu" refers to a main menu that has been individually adjusted based on the user's profile information and sentiment analysis results.

[0357] "Required data" refers to various pieces of information retrieved from the server in order to execute the function selected by the user, and this information is stored in a database.

[0358] "Interface" refers to the screens and means of operation that users use to interact with a system, and these are appropriately modified according to the user's emotional state.

[0359] "A user selecting an employee information management function" refers to the act of a user selecting a function from the main menu to display, edit, add, or delete employee information.

[0360] "Leave request information" refers to detailed information necessary for a user to take leave, which is sent to the server and later processed by an approver.

[0361] A "database" is a system for systematically storing and managing large amounts of data, and for searching and retrieving data as needed.

[0362] An "approver" is a person who has the authority to receive leave requests from users and approve or reject them.

[0363] This invention combines a system designed to streamline administrative tasks and reduce the burden on staff with an emotion engine that recognizes user emotions and provides a more appropriate interface. From user authentication to main menu selection and processing of various tasks, the system provides appropriate feedback and suggestions based on the user's emotional state.

[0364] User authentication phase

[0365] The user opens the login screen on their device and enters their user ID and password. The device sends this authentication information to the server. The server queries the received authentication information against its database to verify its accuracy. If authentication is successful, the server sends the user's profile information and data for displaying the main menu back to the device. Simultaneously, the emotion engine analyzes the user's emotions based on their input speed and actions, and sends the results to the server.

[0366] Displaying and selecting from the main menu

[0367] The server generates a customized main menu for each user based on the user's profile information and sentiment analysis results, and sends it to the terminal. The terminal displays the received customized main menu on its screen. The user selects the desired function from the main menu (e.g., employee information management, leave approval). Based on the selected function, the server retrieves the necessary data from the database and provides an interface that is appropriate to the user's emotional state.

[0368] Employee information management

[0369] For example, if a user selects the "Employee Information Management" function, the server retrieves information on all employees from the database and sends it to the terminal. The terminal displays a list of the retrieved employee information on the screen. The user can view and edit specific employee information, and add or delete new employees. The emotion engine analyzes the user's emotions during these operations and modifies the interface to make the operation intuitive and easy. This supports the user in working without stress.

[0370] Vacation Approval Process

[0371] When a user (employee) submits a leave request, they enter the necessary information on their terminal and press the submit button. The terminal sends the request information to the server. The server stores the request information in a database and sends a notification to the approver. At the same time, the emotion engine analyzes the applicant's emotional state and provides appropriate feedback. The supervisor receives the leave request notification on their terminal, reviews the details, and then approves or rejects the request. The result of this action is again stored in the database, and the applicant is notified of the result. In this process, the emotion engine analyzes the emotional states of both the supervisor and the applicant, providing an interface that is designed to minimize stress for both parties.

[0372] Specific example

[0373] One day, an HR representative logs into the system. As they enter their login information, the emotion engine analyzes their typing speed and error frequency, and detects if they are feeling emotionally unstable. After successful authentication, the server displays a main menu tailored to the representative's state, displaying a gentle message such as, "What can we help you with today?" When the user selects "Employee Information Management," the emotion engine detects that the representative is stressed and automatically switches to a user-friendly, intuitive interface. This improves the representative's work efficiency. Similarly, when another employee submits a leave request, the emotion engine analyzes if the employee is in a hurry and provides a quick and concise input form. After the request is submitted, when the supervisor approves it, the emotion engine analyzes the supervisor's emotions and provides appropriate feedback.

[0374] Example of a prompt

[0375] Please describe how a system works by analyzing a user's emotions when they log into the system and customizing how the main menu is displayed.

[0376] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0377] Step 1:

[0378] The user opens the login screen on their device and enters their user ID and password. This entered information becomes the input data. The device sends this authentication information to the server. The entered information is sent to the server as user authentication information.

[0379] Step 2:

[0380] The server queries the database for the received authentication information to verify its accuracy. This database query outputs the authentication result (authentication successful or failed). If authentication is successful, the server retrieves the user's profile information from the database.

[0381] Step 3:

[0382] Based on the acquired profile information, the server sends data such as the user's input speed and error frequency to the emotion engine. The emotion engine analyzes this data and outputs the user's emotional state. The emotional state is classified as "stable," "unstable," etc.

[0383] Step 4:

[0384] The server generates a customized main menu tailored to each individual user based on the user's profile information and sentiment analysis results. This main menu is output as generated data and sent to the terminal.

[0385] Step 5:

[0386] The terminal displays the customized main menu it received on the screen. From here, the user selects the desired function (e.g., employee information management, leave approval). The selected menu is sent to the server as input data.

[0387] Step 6:

[0388] The server retrieves the necessary data from the database based on the function selected by the user. This data retrieval process outputs the relevant data, and simultaneously generates an interface that corresponds to the user's emotional state.

[0389] Step 7:

[0390] For example, if a user selects the "Employee Information Management" function, the server retrieves information on all employees from the database and sends it to the terminal. This displays a list of employee information on the terminal, allowing the user to view, edit, add, or delete information on specific employees. The results of these operations are sent to the emotion engine, which re-analyzes the user's emotional state.

[0391] Step 8:

[0392] When a user (employee) submits a leave request, they enter the necessary application information on a terminal and press the submit button. The terminal sends the application information to the server. The server stores the application information in a database, sends a notification to the approver, and analyzes the applicant's emotional state using an emotion engine to provide appropriate feedback.

[0393] Step 9:

[0394] The supervisor receives a notification of the leave request on their device, reviews the details, and then approves or rejects it. This result is saved back to the database, and the applicant is notified of the outcome. Simultaneously, the emotion engine analyzes the emotional states of both the supervisor and the applicant, providing an interface designed to minimize stress for both parties.

[0395] (Application Example 2)

[0396] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0397] The problem that this invention aims to solve is to improve the efficiency of management tasks and reduce the burden on personnel. Current systems completely disregard the emotional state of users, and their uniform usability makes it difficult for users to cope with stress or sudden changes in circumstances. In particular, in tasks requiring a high level of tension, such as those performed by security personnel, there is a need for user interfaces that adapt to the emotional state of individual personnel to improve work efficiency and enable appropriate responses.

[0398] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0399] In this invention, the server includes means for inputting user authentication information, means for transmitting the authentication information to the server and for the server to perform authentication, means for obtaining user profile information and displaying a main menu if authentication is successful, means for obtaining necessary data based on the function selected from the main menu and executing the function, means for analyzing the user's emotional state using an emotion analysis engine, and means for adaptively changing the user interface based on the analysis results. This makes it possible to provide an interface that takes the user's emotional state into consideration, thereby improving the efficiency of management operations and reducing the burden on staff.

[0400] "User authentication information" refers to information used to identify and authenticate a user, such as the user's ID and password.

[0401] A "server" is a computer system that performs user authentication, data processing, and the primary functions of a system.

[0402] "Profile information" refers to individual information about a user, including, for example, name, job title, and past operation history.

[0403] The "main menu" is an interface that appears after a user logs into the system, allowing them to select from multiple functions.

[0404] An "emotion analysis engine" is software or algorithms used to analyze a user's emotions based on factors such as facial recognition and user behavior.

[0405] A "database" is a system that centrally manages and stores user profile information and information related to business processes.

[0406] "User interface" refers to the screen display and operating methods that enable interaction between the user and the system.

[0407] The "Employee Information Management Function" is a feature that allows users to view, edit, add, and delete employee information.

[0408] A "leave request" is the process by which a user enters and submits the necessary information to take leave for a certain period of time.

[0409] An "approver" is the person responsible for making the final decision to approve or reject leave requests and other work processes.

[0410] "Analysis results" refer to data about the user's emotional state obtained by the emotion analysis engine.

[0411] "Means of adaptive modification" refer to methods and functions for dynamically optimizing and changing the user interface in response to the user's emotional state.

[0412] The system for implementing the present invention performs user authentication, acquisition of profile information, display of the main menu, analysis of emotional state by an emotion analysis engine, and adaptive modification of the user interface based on the analysis. The specific configuration and operation are shown below.

[0413] 1. User Authentication

[0414] The terminal prompts the user to enter authentication information through a login screen. The user enters their ID and password, and this information is sent to the server. The server queries its database to perform authentication. If authentication is successful, the server sends the user's profile information to the terminal.

[0415] 2. Introduction of an emotion analysis engine

[0416] During the authentication process, the device uses its camera and input data to acquire the user's facial image and operation status, and sends this information to the emotion analysis engine. The emotion analysis engine uses libraries such as DeepFace to perform image analysis and recognize emotional states.

[0417] 3. Displaying the main menu

[0418] The server generates a customized main menu based on the user's profile information and the results of the emotion analysis engine. This menu changes according to the user's emotional state and is designed to reduce stress and anxiety. For example, a concise menu is displayed when the user is in a hurry, while a more detailed menu is displayed when they are relaxed.

[0419] 4. Function Selection and Emotional Response

[0420] When a user selects a desired function from the main menu, the server retrieves the corresponding data from the database and provides an interface tailored to the user's emotional state. This allows users to perform their tasks using an intuitive and easy-to-use interface.

[0421] Explanation of specific examples

[0422] Example 1: User Authentication

[0423] One day, a user attempts to log in to the system. As they enter their login information, the camera built into the device captures an image of the user, and an emotion analysis engine analyzes their emotional state. For example, the analysis might reveal that the user is focused but slightly tense. Based on this, the server displays a message saying "Please calm down" along with a concise main menu.

[0424] Example 2: Employee Information Management

[0425] Next, when the user selects the "Employee Information Management" function from the main menu, the server retrieves the necessary employee information from the database. The emotion analysis engine also monitors the user's emotions in real time while they are operating the system. For example, if the user is feeling stressed, intuitive and easy-to-follow instructions are presented.

[0426] Example 3: Leave application

[0427] When a user submits a leave request, they enter the required information and press the submit button. The sentiment analysis engine detects if the user is in a hurry and simplifies the input form. Simultaneously, the server saves the relevant information to the database and notifies the approver. The approver's emotional state is also analyzed by the sentiment analysis engine, and appropriate feedback is provided.

[0428] Example of a prompt

[0429] Please analyze the emotions in the following image:

[0430] [Image URL]

[0431] The user is currently logged in. Based on the analyzed sentiment, please suggest the next message and layout to display. If the user's sentiment is "angry," display a warning; if it is "happy," display detailed information.

[0432] Thus, the present invention analyzes the user's emotional state in real time and adapts the interface based on that analysis, thereby improving the efficiency of management tasks and reducing the burden on the person in charge.

[0433] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0434] Step 1:

[0435] The user opens the login screen and enters their ID and password.

[0436] Enter: ID and password

[0437] Output: Authentication information sent to the server

[0438] Operation: The terminal sends the ID and password received from the user to the server.

[0439] Step 2:

[0440] The server queries the database for the authentication information it receives and performs the authentication.

[0441] Input: Authentication information (ID and password)

[0442] Output: Authentication results and profile information

[0443] Operation: The server queries the database for the relevant user's information, and if authentication is successful, retrieves the profile information.

[0444] Step 3:

[0445] The device captures an image of the user's face and sends it to the emotion analysis engine.

[0446] Input: User's face image

[0447] Output: Analysis results of emotional state

[0448] Operation: The device uses its camera to acquire an image of the user's face and sends it to the emotion analysis engine.

[0449] Step 4:

[0450] The emotion analysis engine analyzes the user's emotional state and sends it to the server.

[0451] Input: User's face image

[0452] Output: Analysis results of emotional state

[0453] Operation: The emotion analysis engine uses libraries such as DeepFace to analyze the user's emotional state. The analysis results are sent to the server.

[0454] Step 5:

[0455] The server generates a main menu based on the profile information and the results of the emotional state analysis, and sends it to the terminal.

[0456] Input: Profile information and analysis results of emotional state

[0457] Output: Customized main menu

[0458] Operation: The server generates an adaptively changing main menu based on profile information and emotional state, and sends it to the terminal.

[0459] Step 6:

[0460] The device displays a customized main menu, allowing the user to select the desired function.

[0461] Input: Customized main menu

[0462] Output: Identifier of the selected feature

[0463] Operation: The user selects the desired function from the main menu, and the selection is recognized by the device.

[0464] Step 7:

[0465] The server retrieves the necessary data from the database based on the selected function.

[0466] Input: Identifier of the selected function

[0467] Output: Required data

[0468] Operation: The server retrieves data from the database according to the selected function and sends it to the terminal.

[0469] Step 8:

[0470] The device displays the data it has acquired and adaptively changes the interface according to the user's emotional state.

[0471] Input: Acquired data and emotional state

[0472] Output: Optimized user interface

[0473] Operation: The device displays the acquired data and, based on the analysis results of the emotion engine, modifies the interface to best suit the user.

[0474] Step 9:

[0475] Users perform specific tasks (for example, viewing, editing, adding, and deleting employee information).

[0476] Input: User actions and data

[0477] Output: Processing results of the task

[0478] Operation: Appropriate processing is performed according to the user's actions, and the results are reflected in the database.

[0479] Step 10:

[0480] The user submits a leave request, enters the necessary information, and sends it to the server.

[0481] Input: Leave request information

[0482] Output: Notification of successful application

[0483] Operation: The user fills in the required information on the leave request form, and the terminal sends it to the server.

[0484] Step 11:

[0485] The server saves the application information to the database and notifies the approver.

[0486] Input: Leave request information

[0487] Output: Notification to approver

[0488] Operation: The server saves the leave request information to the database and sends a notification to the approver.

[0489] Step 12:

[0490] The approver reviews the application and decides whether to approve or reject it.

[0491] Input: Leave request details

[0492] Output: Approval or rejection result

[0493] Operation: The approver reviews the application details on their terminal and selects to approve or reject it. The result of this action is saved in the database and notified to the applicant.

[0494] After completing the above steps, the system will be operational, analyzing the user's emotional state in real time and adaptively changing the interface to improve work efficiency and reduce the burden on the person in charge.

[0495] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0496] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0497] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0498] [Second Embodiment]

[0499] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0500] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0501] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0502] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0503] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0504] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0505] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0506] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0507] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0508] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0509] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0510] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0511] This invention provides a system to streamline administrative operations and reduce the burden on staff. This system enables efficient and accurate work execution, starting with user authentication, followed by selection from the main menu, and processing of various tasks.

[0512] User authentication phase

[0513] The user enters their user ID and password on the login screen on their device. The device sends this authentication information to the server. The server queries its database for the received authentication information to verify its validity. If authentication is successful, the server returns the user's profile information to the device, the device displays a message indicating successful login, and then displays the main menu as the next step.

[0514] Displaying and selecting from the main menu

[0515] The server generates an appropriate main menu based on the user's job title and permissions and sends it to the terminal. The terminal displays the received main menu on its screen. The user selects the function they want to manage from the main menu, such as "Employee Information Management" or "Leave Approval." Based on the selected function, the server retrieves the necessary data from the database and sends it to the terminal.

[0516] Employee information management

[0517] For example, if a user selects the "Employee Information Management" function, the server retrieves information on all employees from the database and sends it to the terminal. The terminal displays a list of employee information, and the user can view, edit, add, or delete information on specific employees. The results of these operations are reflected in the database via the server.

[0518] Vacation Approval Process

[0519] When a user (employee) submits a leave request, they enter the necessary information on their terminal. Upon pressing the submit button, the terminal sends the information to the server. The server stores the information in its database and sends a notification to the approver. This notification is then sent from the server to the terminal, and the user (approver) reviews the details of the leave request before approving or rejecting it. The result of this action is again saved in the database, and the user (employee who submitted the request) is notified of the result.

[0520] Specific example

[0521] One day, an HR representative wants to log into the company's HR system to update employee information. Using their desktop computer, the HR representative enters their user ID and password on the login screen. Upon successful authentication, the main menu appears, and they select "Employee Information Management." The system displays a list of all employees, and the HR representative selects a specific employee and presses the "Edit" button. After updating the necessary information, they press the "Save" button, and the information is reflected in the database.

[0522] Furthermore, if another employee wishes to request leave, they open the leave request screen on their device, enter their request information, and press the submit button. The leave request is sent to the server, and a notification is sent to their supervisor. The supervisor reviews the request on their device and chooses to approve or reject it. Once the selection is complete, the result is notified to the applicant. In this way, various management tasks are performed efficiently and accurately.

[0523] The above describes the embodiment for carrying out the present invention. This system will improve the efficiency of the administrative department and reduce the burden on the staff. As a result, it is expected that the productivity of the entire organization will improve.

[0524] The following describes the processing flow.

[0525] User authentication phase

[0526] Step 1:

[0527] The user opens the login screen on their device and enters their user ID and password.

[0528] Step 2:

[0529] The terminal sends the entered authentication information to the server.

[0530] Step 3:

[0531] The server queries the database for the received authentication information to verify its accuracy.

[0532] Step 4:

[0533] If authentication is successful, the server retrieves the user's profile information.

[0534] Step 5:

[0535] The server sends a message to the terminal confirming successful authentication along with the user's profile information.

[0536] Step 6:

[0537] The device displays the main menu screen.

[0538] Displaying and selecting from the main menu

[0539] Step 1:

[0540] The server generates the main menu options based on the user's profile information.

[0541] Step 2:

[0542] The server sends the main menu options to the terminal.

[0543] Step 3:

[0544] The device displays the received main menu on its screen.

[0545] Step 4:

[0546] The user selects the desired function from the main menu.

[0547] Step 5:

[0548] The terminal sends the user's selection to the server.

[0549] Step 6:

[0550] The server retrieves the necessary data from the database based on the selected function.

[0551] Step 7:

[0552] The server sends the acquired data to the terminal.

[0553] Step 8:

[0554] The device displays a screen corresponding to the selected function.

[0555] Employee information management

[0556] Step 1:

[0557] The user selects the employee information management function.

[0558] Step 2:

[0559] The server retrieves information on all employees from the database.

[0560] Step 3:

[0561] The server sends the acquired employee information to the terminal.

[0562] Step 4:

[0563] The terminal displays a list of employee information on its screen.

[0564] Step 5:

[0565] Users can select specific employee information and perform actions such as viewing, editing, adding, or deleting it.

[0566] Step 6:

[0567] The terminal sends user actions to the server.

[0568] Step 7:

[0569] The server performs CRUD operations on the database based on the operation performed.

[0570] Step 8:

[0571] The server sends the operation results to the terminal.

[0572] Step 9:

[0573] The device updates the screen based on the operation result.

[0574] Vacation Approval Process

[0575] Step 1:

[0576] The user (employee) opens the leave request screen and enters the necessary information.

[0577] Step 2:

[0578] The terminal sends the entered application information to the server.

[0579] Step 3:

[0580] The server stores the application information in a database.

[0581] Step 4:

[0582] The server sends a notification of the leave request to the approver (supervisor).

[0583] Step 5:

[0584] The server sends the notification content to the approver's device.

[0585] Step 6:

[0586] The user (supervisor) checks the leave request notification on their terminal.

[0587] Step 7:

[0588] The user (supervisor) reviews the details of the leave request and chooses to approve or reject it.

[0589] Step 8:

[0590] The terminal sends the supervisor's selection to the server.

[0591] Step 9:

[0592] The server saves the selection results to the database.

[0593] Step 10:

[0594] The server sends a notification to the applicant.

[0595] Step 11:

[0596] The terminal displays the results to the applicant.

[0597] In this way, the administrative department's operations are streamlined, and a system is created that enables accurate data management and rapid leave approval.

[0598] (Example 1)

[0599] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0600] The administrative department's duties are diverse, requiring the management and approval of various types of information. However, traditional systems often involve manual operations, resulting in poor work efficiency and placing an excessive burden on staff. Furthermore, the lack of standardized processes poses a risk of data inaccuracy. In addition, it is difficult to grasp the status of various tasks in real time. Therefore, a system is needed to improve the efficiency and accuracy of administrative operations.

[0601] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0602] In this invention, the server includes means for inputting user authentication information, means for transmitting the authentication information to the server and for the server to perform authentication in cooperation with a database, means for obtaining user profile information upon successful authentication and generating and displaying a main menu based on the user's role and authority, and means for obtaining necessary data based on the function selected from the main menu and executing the function. This enables improved efficiency and accuracy in management operations and reduces the burden on the person in charge.

[0603] "User authentication information" refers to information that a user provides to identify themselves, and typically includes a user ID and password.

[0604] A "server" is a computer system that receives requests from client terminals on a network and performs data processing and responses.

[0605] A "database" is a system or software for organizing and storing data, and is managed in a way that allows for efficient searching and updating.

[0606] "Profile information" refers to user-specific information, including the user's job title, permissions, and personal information.

[0607] The "main menu" is a menu screen that is displayed to allow the user to select functions within the system.

[0608] "Position" refers to the job title or responsibilities a user holds within an organization.

[0609] "Permissions" refer to information that defines the range of operations a user can perform and the information they can access within a system.

[0610] A "function" is a program or module that performs a specific operation or process provided by a system.

[0611] "Employee information management" refers to system functions for registering, displaying, editing, or deleting employee personal data, work history, performance evaluation information, etc.

[0612] A "leave application" is the application process that an employee goes through to take leave for a certain period of time.

[0613] "Notification" refers to the transmission of information or messages from a system to a user, and is usually done via email or in-app notifications.

[0614] An "approver" is a user who has the authority to review and approve or reject submitted applications.

[0615] Modes for carrying out the invention

[0616] This invention is a system designed to streamline administrative tasks and reduce the burden on staff. This system enables efficient and accurate work execution, starting with user authentication, followed by selection from the main menu, and processing of various tasks. Specific embodiments are described in detail below.

[0617] User authentication phase

[0618] The user opens a browser (e.g., Google Chrome) on their desktop computer (e.g., Windows PC) or mobile device (e.g., iPhone, Android device) and enters their user ID and password on the login screen. The computer sends this authentication information to the server using HTTPS. The server queries the database server (e.g., MySQL) for the received authentication information to verify that the user ID and password match. If authentication is successful, the server sends the user's profile information to the computer, which displays a message indicating successful login and then displays the main menu as the next step.

[0619] Displaying and selecting from the main menu

[0620] The server generates an appropriate main menu based on the user's job title and permissions. For example, administrators will see options such as "Employee Information Management" and "Leave Approval." The server sends the generated main menu to the terminal, which displays it on the screen. The user then selects the function they want to manage, such as "Employee Information Management" or "Leave Approval," from the main menu.

[0621] Employee information management

[0622] When a user selects the "Employee Information Management" function, the server retrieves information on all employees from the database and sends it to the terminal. The terminal displays a list of employee information, and the user selects a specific employee and performs actions such as "Edit," "Add New," or "Delete." The terminal receives these operations and sends the corresponding requests to the server. The server processes the requests and reflects the changes in the database.

[0623] Vacation Approval Process

[0624] When a user (employee) requests leave, they open the leave request screen on their device and enter the desired leave dates and reason. The device sends the entered request information to the server. The server stores the request information in a database and sends a notification to the approver (e.g., supervisor). This notification is sent using a mail server (e.g., Postfix) or a notification service (e.g., Firebase Cloud Messaging). The user (approver) reviews the details of the leave request on their device and approves or rejects it. The result of the action is again stored in the database, and the server sends the result to the device and notifies the user who submitted the request.

[0625] Specific examples of operation

[0626] One day, an HR representative wants to log into the company's HR system to update employee information. Using their desktop computer, the HR representative enters their user ID and password on the login screen. Upon successful authentication, the main menu appears, and they select "Employee Information Management." The system displays a list of all employees, and the HR representative selects a specific employee and presses the "Edit" button. After updating the necessary information, they press the "Save" button, and the information is reflected in the database.

[0627] Furthermore, if another employee wishes to request leave, they open the leave request screen on their device, enter their request information, and press the submit button. The leave request is sent to the server, and a notification is sent to their supervisor. The supervisor reviews the request on their device and chooses to approve or reject it. Once the selection is complete, the result is notified to the applicant. In this way, various management tasks are performed efficiently and accurately.

[0628] Examples of prompt statements

[0629] The following prompt sentences will be used as the generating AI model.

[0630] Please explain the program processing flow of the administrative department's business efficiency system, broken down into specific processing steps. Describe the user authentication, main menu display and selection, employee information management, and leave approval process, including their specific actions.

[0631] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0632] Step 1: Enter user authentication information

[0633] The user opens the login screen on their desktop or mobile device and enters their user ID and password. Based on this input, authentication information is generated. Specifically, the user enters the information using a keyboard or touchscreen.

[0634] Step 2: Submit authentication information

[0635] The terminal sends the entered authentication information to the server via HTTPS. In this process, encrypted data is sent to the server over the network. The terminal does this using its network interface.

[0636] Step 3: Verifying Authentication Information

[0637] The server verifies the received authentication information by querying the database. During this process, it executes a database query to confirm that the user ID and password match. The input is the authentication information, and the output is the authentication result. Specifically, the server executes an SQL query.

[0638] Step 4: Return of authentication results

[0639] If authentication is successful, the server retrieves the user's profile information from the database and sends it to the terminal. The input is the authentication result, and the output is the user's profile information. The server generates and sends the profile information in JSON format.

[0640] Step 5: Display the main menu

[0641] The device displays a user-specific main menu on its screen based on the received profile information. The input is the profile information, and the output is the main menu screen. Specifically, the device generates a visual menu using HTML and JavaScript.

[0642] Step 6: Select a menu item

[0643] The user selects the function they want to manage from the main menu (e.g., employee information management, leave approval). The selected information is sent from the terminal to the server. Input is the user's selection, and output is the request to the server. Specifically, the user performs mouse clicks or touch operations.

[0644] Step 7: Data Acquisition

[0645] The server retrieves the necessary data from the database according to the selected function. The input is the menu selection information, and the output is the data corresponding to the function. For example, if employee information management is selected, an SQL query is executed to retrieve information on all employees.

[0646] Step 8: Displaying the data

[0647] The terminal displays data received from the server. Input is data from the server, and output is the screen display. Specifically, the terminal renders the data in a tabular or list format on an HTML page.

[0648] Step 9: Data manipulation (Employee information management)

[0649] Users view, edit, add, or delete specific employee information. The terminal sends these operation requests to the server. Input is the user's actions, and output is the request to the server. Specifically, the user fills out forms or clicks buttons.

[0650] Step 10: Update operation results

[0651] The server updates the database based on the operation request it receives. The input is the operation request, and the output is the update result. For example, if new employee information is added, an INSERT statement is executed on the database.

[0652] Step 11: Enter your leave request

[0653] The user (employee) opens the leave request screen on their device and enters the date and reason. The device sends the request information to the server. The input is the leave request information, and the output is the request to the server. Specifically, the user fills out the form and presses the submit button.

[0654] Step 12: Saving and notifying application information

[0655] The server stores the received application information in a database and sends a notification to the approver. The input is the leave application information, and the output is the database update and notification sending. The server executes SQL statements and sends notifications using a mail server or notification service.

[0656] Step 13: Approval or rejection process

[0657] The user (approver) reviews the application details on their terminal and approves or rejects them. The terminal sends this action to the server. The input is the approver's judgment, and the output is the request to the server. Specifically, the approver operates using dropdown menus and buttons.

[0658] Step 14: Notification of Results

[0659] The server stores the approval or rejection result in a database and notifies the applicant. The input is the approval result, and the output is the database update and the notification to the applicant. The server uses a notification service to send the result to the applicant.

[0660] Through the steps outlined above, this system achieves increased efficiency and accuracy in administrative tasks.

[0661] (Application Example 1)

[0662] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0663] Factory management tasks, particularly employee information management and leave approval processes, are time-consuming and labor-intensive, and efficiency improvements are needed. Furthermore, errors and delays are common due to managers manually operating multiple systems. Therefore, the challenge lies in streamlining factory management tasks, reducing errors, and improving productivity.

[0664] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0665] In this invention, the server includes means for inputting user authentication information, means for transmitting the authentication information to the server and for the server to perform authentication, means for obtaining user profile information and displaying a main menu if authentication is successful, means for obtaining necessary data based on the function selected from the main menu and executing the function, means for performing user authentication and operation through the interface of a factory robot, and means for operating factory management tasks (such as employee information management and leave approval) through the robot interface. This makes it possible for users to efficiently operate and manage management tasks within the factory.

[0666] "User authentication information" refers to the user's identification information and password required to access the system.

[0667] A "server" is a central computer system that processes information sent by users and handles authentication, data storage, and data retrieval.

[0668] "Profile information" refers to data used to determine a user's operational rights within the system, such as their personal information, job title, and permissions.

[0669] The "main menu" is a screen that displays a list of functions available to the user after logging in, allowing them to select from them.

[0670] A "function" refers to a specific operation or process that can be performed within a system, and includes administrative tasks such as employee information management and leave approval.

[0671] A "factory" is a facility where production lines, machines, and robots are installed and manufacturing operations are carried out.

[0672] A "robot interface" refers to input / output means such as touch panels and voice recognition devices installed on robots in factories.

[0673] "Employee information management" refers to a function that manages, edits, adds, and deletes employees' personal information, work status, job title, etc.

[0674] "Leave approval" is the process of approving or rejecting leave requests submitted by employees and notifying them of the result.

[0675] "Management duties" refer to various tasks necessary for the operation of the organization, such as managing personnel and labor within the factory, and maintaining and inspecting equipment.

[0676] This invention is a system for streamlining management operations within a factory, and is particularly aimed at automating employee information management and leave approval processes. The system consists of user authentication, main menu display, function selection, and execution phases. The system operates in conjunction with multiple robots within the factory and utilizes the following hardware and software.

[0677] Hardware and software

[0678] Hardware:

[0679] Factory robots: with touch panel or voice recognition capabilities.

[0680] Server: Processes and stores data.

[0681] software:

[0682] Python scripts: Programs for user authentication, data retrieval, and manipulation.

[0683] Request Module: A library for performing API communication.

[0684] Database: Stores user profile information and administrative data (e.g., MySQL, MongoDB).

[0685] Processing flow

[0686] 1. User Authentication Phase:

[0687] The factory manager logs in using the robot's touch panel or voice recognition interface. The login data is transmitted wirelessly to the server. The server queries its database for the received authentication information to verify its validity. If authentication is successful, the server retrieves the user's profile information and displays the main menu on the robot's interface.

[0688] 2. Displaying and selecting from the main menu:

[0689] Upon successful login, the main menu appears on the robot's interface. The user selects functions such as personnel management or leave approval. Based on the selected function, the server retrieves the necessary data from the database and sends it to the robot's interface.

[0690] 3. Execution of business functions:

[0691] Based on the selected function, the robot displays the necessary data, and the user performs the action. For example, if the user selects employee information management, the server retrieves information on all employees from the database and sends it to the robot. The user can then view, edit, add, or delete specific employee information. The results of these actions are reflected in the database via the server.

[0692] Specific example

[0693] Example 1: Editing employee information

[0694] When the administrator speaks "Login" to the factory robot's interface, the robot prompts "Please enter your User ID." The administrator enters "12345" and then enters their password. Upon successful login, the robot displays "Please select a main menu" and presents the options of "Employee Information Management" or "Leave Approval." The administrator selects "Employee Information Management," chooses a specific employee, and presses the "Edit" button. After updating the necessary information, pressing the "Save" button updates the information in the database.

[0695] Example 2: Approval of leave request

[0696] When a user submits a leave request using the factory robot interface, they select the "Leave Request" menu, enter the required information, and press the submit button. The leave request is sent to the server, and a notification is sent to the supervisor. The supervisor reviews the request on their terminal and chooses to approve or reject it. Once the selection is complete, the result is notified to the applicant.

[0697] Example of a prompt

[0698] To the robot assistant: "Login"

[0699] Robot: "Please enter your User ID."

[0700] Administrator: "12345"

[0701] Robot: "Please enter your password."

[0702] Administrator: [Enter password]

[0703] Robot: "Login successful. Please select a main menu item: 1. Employee Information Management, 2. Leave Approval."

[0704] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0705] Step 1:

[0706] The user either says "Login" to the factory robot's interface or a login screen is displayed on the touch panel. The system requests a user ID and password as input and sends this data to the server. The server queries a database for the user ID and password and performs authentication. The output is either a success or failure authentication result; if authentication is successful, the server retrieves the user's profile information and returns it to the terminal.

[0707] Step 2:

[0708] The terminal displays the user's profile information along with a message confirming successful authentication. It generates a main menu, presenting the user with options such as "Employee Information Management" or "Leave Approval." There is no input required, but the user's selection becomes the input for the next step. The output is the display of the main menu.

[0709] Step 3:

[0710] The user selects the function they want to manage from the main menu (e.g., employee information management). The input is the user's selection, and the terminal sends this selection to the server. Based on the selected function, the server retrieves the necessary data from the database and sends it to the terminal. The output is the retrieval and display of the corresponding data.

[0711] Step 4:

[0712] The terminal displays data received from the server and allows the user to interact with it. For example, in employee information management, it displays a list of all employees. The user can then edit, add, or delete specific employee information. Input is the user's actions, and output is a confirmation screen of those actions.

[0713] Step 5:

[0714] After a user completes an edit, add, or delete operation, the terminal sends the result of the operation to the server. The input is the operation result, and the server reflects this information in the database. The output is the database update result and a completion message for the user.

[0715] Step 6:

[0716] When a user submits a leave request, they enter the necessary application information (e.g., reason for leave, duration, etc.) on the leave request screen. The input is the user's application information, and the terminal sends this information to the server. The server saves the application information to a database and sends a notification to the approver. The output is the saved application information and the notification to the approver.

[0717] Step 7:

[0718] Upon receiving a notification from the server, the approver reviews the details of the leave request and decides to approve or reject it. Input is the approver's action, and the result is sent to the server. The server saves the result to a database and notifies the applicant. Output is the notification result sent to both the applicant and the approver.

[0719] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0720] This invention combines a system designed to streamline administrative tasks and reduce the burden on staff with an emotion engine that recognizes user emotions and provides a more appropriate interface. This system has the functionality to provide appropriate feedback and suggestions based on the user's emotional state, from user authentication to main menu selection and processing of various tasks.

[0721] User authentication phase

[0722] The user opens the login screen on their device and enters their user ID and password. The device sends this authentication information to the server. The server queries the received authentication information against its database to verify its accuracy. If authentication is successful, the server returns the user's profile information and data for displaying the main menu to the device. Simultaneously, the emotion engine analyzes the user's emotions based on their input and actions and sends the analysis results to the server.

[0723] Displaying and selecting from the main menu

[0724] The server generates a customized main menu based on the user's profile information and sentiment analysis results, and sends it to the terminal. The terminal displays the received main menu on its screen. The user selects the desired function from the main menu (e.g., employee information management, leave approval). Based on the selected function, the server retrieves the necessary data from the database and provides an interface tailored to the user's emotional state.

[0725] Employee information management

[0726] For example, if a user selects the "Employee Information Management" function, the server retrieves information on all employees from the database and sends it to the terminal. The terminal displays a list of employee information, and the user can view, edit, add, or delete information on specific employees. The emotion engine analyzes the user's emotions during these operations and modifies the interface accordingly. This supports the user in working without stress.

[0727] Vacation Approval Process

[0728] When a user (employee) submits a leave request, they enter the necessary information on their terminal and press the submit button. The terminal sends the request information to the server. The server stores the request information in a database, sends a notification to the approver, and analyzes the applicant's emotional state using an emotion engine to provide appropriate feedback. The supervisor receives the leave request notification on their terminal, reviews the details, and then approves or rejects the request. The result of this action is again stored in the database, and the applicant is notified of the result. At this time, the emotion engine analyzes the emotional states of both the supervisor and the applicant, and provides an interface that is designed to minimize stress for both parties.

[0729] Specific example

[0730] One day, an HR representative logs into the system. As they enter their login information, the emotion engine analyzes their typing speed and the frequency of errors to determine if they are emotionally unstable. After successful authentication, the server displays a main menu tailored to the user's state, displaying a gentle message such as, "What can we help you with today?" When the HR representative selects "Employee Information Management," the emotion engine, having detected stress, switches to an intuitive and easy-to-use interface.

[0731] Similarly, when another employee submits a leave request, the emotion engine analyzes their urgency and presents a concise input form. When a supervisor approves the request, the emotion engine analyzes the supervisor's emotional state and provides appropriate feedback.

[0732] In this way, the present invention improves the usability of the system by analyzing the user's emotional state, thereby achieving increased operational efficiency and reduced workload for the person in charge.

[0733] The following describes the processing flow.

[0734] User authentication phase

[0735] Step 1:

[0736] The user opens the login screen on their device and enters their user ID and password.

[0737] Step 2:

[0738] The terminal sends the entered authentication information to the server.

[0739] Step 3:

[0740] The server queries the database for the received authentication information to verify its accuracy.

[0741] Step 4:

[0742] If authentication is successful, the server retrieves the user's profile information and sends the input data from the login process to the emotion engine.

[0743] Step 5:

[0744] The emotion engine analyzes the user's emotions and sends the results to the server.

[0745] Step 6:

[0746] The server sends the user's profile information and sentiment analysis results to the terminal.

[0747] Step 7:

[0748] The device displays the main menu screen.

[0749] Displaying and selecting from the main menu

[0750] Step 1:

[0751] The server generates main menu options based on the user's profile information and sentiment analysis results.

[0752] Step 2:

[0753] The server sends the main menu options to the terminal.

[0754] Step 3:

[0755] The device displays the received main menu on its screen.

[0756] Step 4:

[0757] The user selects the desired function from the main menu.

[0758] Step 5:

[0759] The terminal sends the user's selection to the server.

[0760] Step 6:

[0761] The server retrieves the necessary data from the database based on the selected function.

[0762] Step 7:

[0763] The emotion engine suggests an appropriate interface based on the user's emotions and sends the result to the server.

[0764] Step 8:

[0765] The server sends the acquired data along with suggestions from the emotion engine to the terminal.

[0766] Step 9:

[0767] The device displays a screen corresponding to the selected function and adjusts the user interface accordingly.

[0768] Employee information management

[0769] Step 1:

[0770] The user selects the employee information management function.

[0771] Step 2:

[0772] The server retrieves information on all employees from the database.

[0773] Step 3:

[0774] The server sends the acquired employee information to the terminal.

[0775] Step 4:

[0776] The terminal displays a list of employee information on its screen.

[0777] Step 5:

[0778] Users can select specific employee information and perform actions such as viewing, editing, adding, or deleting it.

[0779] Step 6:

[0780] The terminal sends user actions to the server.

[0781] Step 7:

[0782] The server performs CRUD operations on the database based on the operation performed.

[0783] Step 8:

[0784] The emotion engine analyzes the user's emotions during operation and sends the results to the server.

[0785] Step 9:

[0786] The server sends the operation results to the terminal.

[0787] Step 10:

[0788] The device updates the screen based on the operation results and adjusts the interface to reflect the results of the emotion engine.

[0789] Vacation Approval Process

[0790] Step 1:

[0791] The user (employee) opens the leave request screen and enters the necessary information.

[0792] Step 2:

[0793] The terminal sends the entered application information to the server.

[0794] Step 3:

[0795] The server stores the application information in a database.

[0796] Step 4:

[0797] The emotion engine analyzes the user's emotions based on input content and input speed, and sends the results to the server.

[0798] Step 5:

[0799] The server sends a notification of the leave request to the approver (supervisor) and also notifies them of the applicant's emotional state.

[0800] Step 6:

[0801] The server sends the notification content to the approver's device.

[0802] Step 7:

[0803] The user (supervisor) checks the leave request notification on their terminal.

[0804] Step 8:

[0805] The user (supervisor) reviews the details of the leave request and chooses to approve or reject it.

[0806] Step 9:

[0807] The terminal sends the supervisor's selection to the server.

[0808] Step 10:

[0809] The server saves the selection results to the database.

[0810] Step 11:

[0811] The emotion engine analyzes the boss's emotions and sends the results to the server.

[0812] Step 12:

[0813] The server notifies the applicant of the result and provides feedback that reflects the results of the emotion engine.

[0814] Step 13:

[0815] The device displays the results to the applicant and provides feedback from the emotion engine.

[0816] In this way, the operations of the administrative department are streamlined, and a flexible interface that responds to the user's emotional state is provided, resulting in improved accuracy and reduced workload for the person in charge.

[0817] (Example 2)

[0818] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0819] Current business management systems often cause user stress because they provide a uniform interface without considering the user's emotional state. Furthermore, improvements in work efficiency and reduction of the burden on employees are not sufficiently achieved. This is particularly due to the provision of inappropriate feedback during operations that users find stressful or critical. Therefore, there is a need for a system that appropriately analyzes the user's emotional state and provides an interface and feedback accordingly.

[0820] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0821] In this invention, the server includes means for inputting user authentication information, means for transmitting the authentication information to the server and for the server to perform authentication, means for acquiring user profile information and displaying a customized main menu based on the sentiment analysis results if authentication is successful, and means for acquiring necessary data based on the function selected from the main menu and providing an appropriate interface according to the sentiment analysis results. This enables the provision of an interface and feedback that responds to the user's emotional state, thereby improving work efficiency and reducing the burden on the person in charge.

[0822] "User authentication information" refers to the information that a user enters to access the system, and typically consists of a user ID and password.

[0823] A "server" is a computer system that sends and receives data over a network and provides authentication, manages profile information, and offers interfaces based on the results of sentiment analysis.

[0824] "Profile information" refers to data that includes personal information and settings information about the user, and is used to provide information based on the user's usage history and preferences.

[0825] "Emotional analysis results" refer to the estimated emotional state of a user, based on data such as the user's operation speed and error frequency.

[0826] A "customized main menu" refers to a main menu that has been individually adjusted based on the user's profile information and sentiment analysis results.

[0827] "Required data" refers to various pieces of information retrieved from the server in order to execute the function selected by the user, and this information is stored in a database.

[0828] "Interface" refers to the screens and means of operation that users use to interact with a system, and these are appropriately modified according to the user's emotional state.

[0829] "A user selecting an employee information management function" refers to the act of a user selecting a function from the main menu to display, edit, add, or delete employee information.

[0830] "Leave request information" refers to detailed information necessary for a user to take leave, which is sent to the server and later processed by an approver.

[0831] A "database" is a system for systematically storing and managing large amounts of data, and for searching and retrieving data as needed.

[0832] An "approver" is a person who has the authority to receive leave requests from users and approve or reject them.

[0833] This invention combines a system designed to streamline administrative tasks and reduce the burden on staff with an emotion engine that recognizes user emotions and provides a more appropriate interface. From user authentication to main menu selection and processing of various tasks, the system provides appropriate feedback and suggestions based on the user's emotional state.

[0834] User authentication phase

[0835] The user opens the login screen on their device and enters their user ID and password. The device sends this authentication information to the server. The server queries the received authentication information against its database to verify its accuracy. If authentication is successful, the server sends the user's profile information and data for displaying the main menu back to the device. Simultaneously, the emotion engine analyzes the user's emotions based on their input speed and actions, and sends the results to the server.

[0836] Displaying and selecting from the main menu

[0837] The server generates a customized main menu for each user based on the user's profile information and sentiment analysis results, and sends it to the terminal. The terminal displays the received customized main menu on its screen. The user selects the desired function from the main menu (e.g., employee information management, leave approval). Based on the selected function, the server retrieves the necessary data from the database and provides an interface that is appropriate to the user's emotional state.

[0838] Employee information management

[0839] For example, if a user selects the "Employee Information Management" function, the server retrieves information on all employees from the database and sends it to the terminal. The terminal displays a list of the retrieved employee information on the screen. The user can view and edit specific employee information, and add or delete new employees. The emotion engine analyzes the user's emotions during these operations and modifies the interface to make the operation intuitive and easy. This supports the user in working without stress.

[0840] Vacation Approval Process

[0841] When a user (employee) submits a leave request, they enter the necessary information on their terminal and press the submit button. The terminal sends the request information to the server. The server stores the request information in a database and sends a notification to the approver. At the same time, the emotion engine analyzes the applicant's emotional state and provides appropriate feedback. The supervisor receives the leave request notification on their terminal, reviews the details, and then approves or rejects the request. The result of this action is again stored in the database, and the applicant is notified of the result. In this process, the emotion engine analyzes the emotional states of both the supervisor and the applicant, providing an interface that is designed to minimize stress for both parties.

[0842] Specific example

[0843] One day, an HR representative logs into the system. As they enter their login information, the emotion engine analyzes their typing speed and error frequency, and detects if they are feeling emotionally unstable. After successful authentication, the server displays a main menu tailored to the representative's state, displaying a gentle message such as, "What can we help you with today?" When the user selects "Employee Information Management," the emotion engine detects that the representative is stressed and automatically switches to a user-friendly, intuitive interface. This improves the representative's work efficiency. Similarly, when another employee submits a leave request, the emotion engine analyzes if the employee is in a hurry and provides a quick and concise input form. After the request is submitted, when the supervisor approves it, the emotion engine analyzes the supervisor's emotions and provides appropriate feedback.

[0844] Example of a prompt

[0845] Please describe how a system works by analyzing a user's emotions when they log into the system and customizing how the main menu is displayed.

[0846] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0847] Step 1:

[0848] The user opens the login screen on their device and enters their user ID and password. This entered information becomes the input data. The device sends this authentication information to the server. The entered information is sent to the server as user authentication information.

[0849] Step 2:

[0850] The server queries the database for the received authentication information to verify its accuracy. This database query outputs the authentication result (authentication successful or failed). If authentication is successful, the server retrieves the user's profile information from the database.

[0851] Step 3:

[0852] Based on the acquired profile information, the server sends data such as the user's input speed and error frequency to the emotion engine. The emotion engine analyzes this data and outputs the user's emotional state. The emotional state is classified as "stable," "unstable," etc.

[0853] Step 4:

[0854] The server generates a customized main menu tailored to each individual user based on the user's profile information and sentiment analysis results. This main menu is output as generated data and sent to the terminal.

[0855] Step 5:

[0856] The terminal displays the customized main menu it received on the screen. From here, the user selects the desired function (e.g., employee information management, leave approval). The selected menu is sent to the server as input data.

[0857] Step 6:

[0858] The server retrieves the necessary data from the database based on the function selected by the user. This data retrieval process outputs the relevant data, and simultaneously generates an interface that corresponds to the user's emotional state.

[0859] Step 7:

[0860] For example, if a user selects the "Employee Information Management" function, the server retrieves information on all employees from the database and sends it to the terminal. This displays a list of employee information on the terminal, allowing the user to view, edit, add, or delete information on specific employees. The results of these operations are sent to the emotion engine, which re-analyzes the user's emotional state.

[0861] Step 8:

[0862] When a user (employee) submits a leave request, they enter the necessary application information on a terminal and press the submit button. The terminal sends the application information to the server. The server stores the application information in a database, sends a notification to the approver, and analyzes the applicant's emotional state using an emotion engine to provide appropriate feedback.

[0863] Step 9:

[0864] The supervisor receives a notification of the leave request on their device, reviews the details, and then approves or rejects it. This result is saved back to the database, and the applicant is notified of the outcome. Simultaneously, the emotion engine analyzes the emotional states of both the supervisor and the applicant, providing an interface designed to minimize stress for both parties.

[0865] (Application Example 2)

[0866] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0867] The problem that this invention aims to solve is to improve the efficiency of management tasks and reduce the burden on personnel. Current systems completely disregard the emotional state of users, and their uniform usability makes it difficult for users to cope with stress or sudden changes in circumstances. In particular, in tasks requiring a high level of tension, such as those performed by security personnel, there is a need for user interfaces that adapt to the emotional state of individual personnel to improve work efficiency and enable appropriate responses.

[0868] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0869] In this invention, the server includes means for inputting user authentication information, means for transmitting the authentication information to the server and for the server to perform authentication, means for obtaining user profile information and displaying a main menu if authentication is successful, means for obtaining necessary data based on the function selected from the main menu and executing the function, means for analyzing the user's emotional state using an emotion analysis engine, and means for adaptively changing the user interface based on the analysis results. This makes it possible to provide an interface that takes the user's emotional state into consideration, thereby improving the efficiency of management operations and reducing the burden on staff.

[0870] "User authentication information" refers to information used to identify and authenticate a user, such as the user's ID and password.

[0871] A "server" is a computer system that performs user authentication, data processing, and the primary functions of a system.

[0872] "Profile information" refers to individual information about a user, including, for example, name, job title, and past operation history.

[0873] The "main menu" is an interface that appears after a user logs into the system, allowing them to select from multiple functions.

[0874] An "emotion analysis engine" is software or algorithms used to analyze a user's emotions based on factors such as facial recognition and user behavior.

[0875] A "database" is a system that centrally manages and stores user profile information and information related to business processes.

[0876] "User interface" refers to the screen display and operating methods that enable interaction between the user and the system.

[0877] The "Employee Information Management Function" is a feature that allows users to view, edit, add, and delete employee information.

[0878] A "leave request" is the process by which a user enters and submits the necessary information to take leave for a certain period of time.

[0879] An "approver" is the person responsible for making the final decision to approve or reject leave requests and other work processes.

[0880] "Analysis results" refer to data about the user's emotional state obtained by the emotion analysis engine.

[0881] "Means of adaptive modification" refer to methods and functions for dynamically optimizing and changing the user interface in response to the user's emotional state.

[0882] The system for implementing the present invention performs user authentication, acquisition of profile information, display of the main menu, analysis of emotional state by an emotion analysis engine, and adaptive modification of the user interface based on the analysis. The specific configuration and operation are shown below.

[0883] 1. User Authentication

[0884] The terminal prompts the user to enter authentication information through a login screen. The user enters their ID and password, and this information is sent to the server. The server queries its database to perform authentication. If authentication is successful, the server sends the user's profile information to the terminal.

[0885] 2. Introduction of an emotion analysis engine

[0886] During the authentication process, the device uses its camera and input data to acquire the user's facial image and operation status, and sends this information to the emotion analysis engine. The emotion analysis engine uses libraries such as DeepFace to perform image analysis and recognize emotional states.

[0887] 3. Displaying the main menu

[0888] The server generates a customized main menu based on the user's profile information and the results of the emotion analysis engine. This menu changes according to the user's emotional state and is designed to reduce stress and anxiety. For example, a concise menu is displayed when the user is in a hurry, while a more detailed menu is displayed when they are relaxed.

[0889] 4. Function Selection and Emotional Response

[0890] When a user selects a desired function from the main menu, the server retrieves the corresponding data from the database and provides an interface tailored to the user's emotional state. This allows users to perform their tasks using an intuitive and easy-to-use interface.

[0891] Explanation of specific examples

[0892] Example 1: User Authentication

[0893] One day, a user attempts to log in to the system. As they enter their login information, the camera built into the device captures an image of the user, and an emotion analysis engine analyzes their emotional state. For example, the analysis might reveal that the user is focused but slightly tense. Based on this, the server displays a message saying "Please calm down" along with a concise main menu.

[0894] Example 2: Employee Information Management

[0895] Next, when the user selects the "Employee Information Management" function from the main menu, the server retrieves the necessary employee information from the database. The emotion analysis engine also monitors the user's emotions in real time while they are operating the system. For example, if the user is feeling stressed, intuitive and easy-to-follow instructions are presented.

[0896] Example 3: Leave application

[0897] When a user submits a leave request, they enter the required information and press the submit button. The sentiment analysis engine detects if the user is in a hurry and simplifies the input form. Simultaneously, the server saves the relevant information to the database and notifies the approver. The approver's emotional state is also analyzed by the sentiment analysis engine, and appropriate feedback is provided.

[0898] Example of a prompt

[0899] Please analyze the emotions in the following image:

[0900] [Image URL]

[0901] The user is currently logged in. Based on the analyzed sentiment, please suggest the next message and layout to display. If the user's sentiment is "angry," display a warning; if it is "happy," display detailed information.

[0902] Thus, the present invention analyzes the user's emotional state in real time and adapts the interface based on that analysis, thereby improving the efficiency of management tasks and reducing the burden on the person in charge.

[0903] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0904] Step 1:

[0905] The user opens the login screen and enters their ID and password.

[0906] Enter: ID and password

[0907] Output: Authentication information sent to the server

[0908] Operation: The terminal sends the ID and password received from the user to the server.

[0909] Step 2:

[0910] The server queries the database for the authentication information it receives and performs the authentication.

[0911] Input: Authentication information (ID and password)

[0912] Output: Authentication results and profile information

[0913] Operation: The server queries the database for the relevant user's information, and if authentication is successful, retrieves the profile information.

[0914] Step 3:

[0915] The device captures an image of the user's face and sends it to the emotion analysis engine.

[0916] Input: User's face image

[0917] Output: Analysis results of emotional state

[0918] Operation: The device uses its camera to acquire an image of the user's face and sends it to the emotion analysis engine.

[0919] Step 4:

[0920] The emotion analysis engine analyzes the user's emotional state and sends it to the server.

[0921] Input: User's face image

[0922] Output: Analysis results of emotional state

[0923] Operation: The emotion analysis engine uses libraries such as DeepFace to analyze the user's emotional state. The analysis results are sent to the server.

[0924] Step 5:

[0925] The server generates a main menu based on the profile information and the results of the emotional state analysis, and sends it to the terminal.

[0926] Input: Profile information and analysis results of emotional state

[0927] Output: Customized main menu

[0928] Operation: The server generates an adaptively changing main menu based on profile information and emotional state, and sends it to the terminal.

[0929] Step 6:

[0930] The device displays a customized main menu, allowing the user to select the desired function.

[0931] Input: Customized main menu

[0932] Output: Identifier of the selected feature

[0933] Operation: The user selects the desired function from the main menu, and the selection is recognized by the device.

[0934] Step 7:

[0935] The server retrieves the necessary data from the database based on the selected function.

[0936] Input: Identifier of the selected function

[0937] Output: Required data

[0938] Operation: The server retrieves data from the database according to the selected function and sends it to the terminal.

[0939] Step 8:

[0940] The device displays the data it has acquired and adaptively changes the interface according to the user's emotional state.

[0941] Input: Acquired data and emotional state

[0942] Output: Optimized user interface

[0943] Operation: The device displays the acquired data and, based on the analysis results of the emotion engine, modifies the interface to best suit the user.

[0944] Step 9:

[0945] Users perform specific tasks (for example, viewing, editing, adding, and deleting employee information).

[0946] Input: User actions and data

[0947] Output: Processing results of the task

[0948] Operation: Appropriate processing is performed according to the user's actions, and the results are reflected in the database.

[0949] Step 10:

[0950] The user submits a leave request, enters the necessary information, and sends it to the server.

[0951] Input: Leave request information

[0952] Output: Notification of successful application

[0953] Operation: The user fills in the required information on the leave request form, and the terminal sends it to the server.

[0954] Step 11:

[0955] The server saves the application information to the database and notifies the approver.

[0956] Input: Leave request information

[0957] Output: Notification to approver

[0958] Operation: The server saves the leave request information to the database and sends a notification to the approver.

[0959] Step 12:

[0960] The approver reviews the application and decides whether to approve or reject it.

[0961] Input: Leave request details

[0962] Output: Approval or rejection result

[0963] Operation: The approver reviews the application details on their terminal and selects to approve or reject it. The result of this action is saved in the database and notified to the applicant.

[0964] After completing the above steps, the system will be operational, analyzing the user's emotional state in real time and adaptively changing the interface to improve work efficiency and reduce the burden on the person in charge.

[0965] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0966] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0967] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0968] [Third Embodiment]

[0969] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0970] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0971] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0972] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0973] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0974] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0975] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0976] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0977] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0978] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0979] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0980] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0981] This invention provides a system to streamline administrative operations and reduce the burden on staff. This system enables efficient and accurate work execution, starting with user authentication, followed by selection from the main menu, and processing of various tasks.

[0982] User authentication phase

[0983] The user enters their user ID and password on the login screen on their device. The device sends this authentication information to the server. The server queries its database for the received authentication information to verify its validity. If authentication is successful, the server returns the user's profile information to the device, the device displays a message indicating successful login, and then displays the main menu as the next step.

[0984] Displaying and selecting from the main menu

[0985] The server generates an appropriate main menu based on the user's job title and permissions and sends it to the terminal. The terminal displays the received main menu on its screen. The user selects the function they want to manage from the main menu, such as "Employee Information Management" or "Leave Approval." Based on the selected function, the server retrieves the necessary data from the database and sends it to the terminal.

[0986] Employee information management

[0987] For example, if a user selects the "Employee Information Management" function, the server retrieves information on all employees from the database and sends it to the terminal. The terminal displays a list of employee information, and the user can view, edit, add, or delete information on specific employees. The results of these operations are reflected in the database via the server.

[0988] Vacation Approval Process

[0989] When a user (employee) submits a leave request, they enter the necessary information on their terminal. Upon pressing the submit button, the terminal sends the information to the server. The server stores the information in its database and sends a notification to the approver. This notification is then sent from the server to the terminal, and the user (approver) reviews the details of the leave request before approving or rejecting it. The result of this action is again saved in the database, and the user (employee who submitted the request) is notified of the result.

[0990] Specific example

[0991] One day, an HR representative wants to log into the company's HR system to update employee information. Using their desktop computer, the HR representative enters their user ID and password on the login screen. Upon successful authentication, the main menu appears, and they select "Employee Information Management." The system displays a list of all employees, and the HR representative selects a specific employee and presses the "Edit" button. After updating the necessary information, they press the "Save" button, and the information is reflected in the database.

[0992] Furthermore, if another employee wishes to request leave, they open the leave request screen on their device, enter their request information, and press the submit button. The leave request is sent to the server, and a notification is sent to their supervisor. The supervisor reviews the request on their device and chooses to approve or reject it. Once the selection is complete, the result is notified to the applicant. In this way, various management tasks are performed efficiently and accurately.

[0993] The above describes the embodiment for carrying out the present invention. This system will improve the efficiency of the administrative department and reduce the burden on the staff. As a result, it is expected that the productivity of the entire organization will improve.

[0994] The following describes the processing flow.

[0995] User authentication phase

[0996] Step 1:

[0997] The user opens the login screen on their device and enters their user ID and password.

[0998] Step 2:

[0999] The terminal sends the entered authentication information to the server.

[1000] Step 3:

[1001] The server queries the database for the received authentication information to verify its accuracy.

[1002] Step 4:

[1003] If authentication is successful, the server retrieves the user's profile information.

[1004] Step 5:

[1005] The server sends a message to the terminal confirming successful authentication along with the user's profile information.

[1006] Step 6:

[1007] The device displays the main menu screen.

[1008] Displaying and selecting from the main menu

[1009] Step 1:

[1010] The server generates the main menu options based on the user's profile information.

[1011] Step 2:

[1012] The server sends the main menu options to the terminal.

[1013] Step 3:

[1014] The device displays the received main menu on its screen.

[1015] Step 4:

[1016] The user selects the desired function from the main menu.

[1017] Step 5:

[1018] The terminal sends the user's selection to the server.

[1019] Step 6:

[1020] The server retrieves the necessary data from the database based on the selected function.

[1021] Step 7:

[1022] The server sends the acquired data to the terminal.

[1023] Step 8:

[1024] The device displays a screen corresponding to the selected function.

[1025] Employee information management

[1026] Step 1:

[1027] The user selects the employee information management function.

[1028] Step 2:

[1029] The server retrieves information on all employees from the database.

[1030] Step 3:

[1031] The server sends the acquired employee information to the terminal.

[1032] Step 4:

[1033] The terminal displays a list of employee information on its screen.

[1034] Step 5:

[1035] Users can select specific employee information and perform actions such as viewing, editing, adding, or deleting it.

[1036] Step 6:

[1037] The terminal sends user actions to the server.

[1038] Step 7:

[1039] The server performs CRUD operations on the database based on the operation performed.

[1040] Step 8:

[1041] The server sends the operation results to the terminal.

[1042] Step 9:

[1043] The device updates the screen based on the operation result.

[1044] Vacation Approval Process

[1045] Step 1:

[1046] The user (employee) opens the leave request screen and enters the necessary information.

[1047] Step 2:

[1048] The terminal sends the entered application information to the server.

[1049] Step 3:

[1050] The server stores the application information in a database.

[1051] Step 4:

[1052] The server sends a notification of the leave request to the approver (supervisor).

[1053] Step 5:

[1054] The server sends the notification content to the approver's device.

[1055] Step 6:

[1056] The user (supervisor) checks the leave request notification on their terminal.

[1057] Step 7:

[1058] The user (supervisor) reviews the details of the leave request and chooses to approve or reject it.

[1059] Step 8:

[1060] The terminal sends the supervisor's selection to the server.

[1061] Step 9:

[1062] The server saves the selection results to the database.

[1063] Step 10:

[1064] The server sends a notification to the applicant.

[1065] Step 11:

[1066] The terminal displays the results to the applicant.

[1067] In this way, the administrative department's operations are streamlined, and a system is created that enables accurate data management and rapid leave approval.

[1068] (Example 1)

[1069] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1070] The administrative department's duties are diverse, requiring the management and approval of various types of information. However, traditional systems often involve manual operations, resulting in poor work efficiency and placing an excessive burden on staff. Furthermore, the lack of standardized processes poses a risk of data inaccuracy. In addition, it is difficult to grasp the status of various tasks in real time. Therefore, a system is needed to improve the efficiency and accuracy of administrative operations.

[1071] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1072] In this invention, the server includes means for inputting user authentication information, means for transmitting the authentication information to the server and for the server to perform authentication in cooperation with a database, means for obtaining user profile information upon successful authentication and generating and displaying a main menu based on the user's role and authority, and means for obtaining necessary data based on the function selected from the main menu and executing the function. This enables improved efficiency and accuracy in management operations and reduces the burden on the person in charge.

[1073] "User authentication information" refers to information that a user provides to identify themselves, and typically includes a user ID and password.

[1074] A "server" is a computer system that receives requests from client terminals on a network and performs data processing and responses.

[1075] A "database" is a system or software for organizing and storing data, and is managed in a way that allows for efficient searching and updating.

[1076] "Profile information" refers to user-specific information, including the user's job title, permissions, and personal information.

[1077] The "main menu" is a menu screen that is displayed to allow the user to select functions within the system.

[1078] "Position" refers to the job title or responsibilities a user holds within an organization.

[1079] "Permissions" refer to information that defines the range of operations a user can perform and the information they can access within a system.

[1080] A "function" is a program or module that performs a specific operation or process provided by a system.

[1081] "Employee information management" refers to system functions for registering, displaying, editing, or deleting employee personal data, work history, performance evaluation information, etc.

[1082] A "leave application" is the application process that an employee goes through to take leave for a certain period of time.

[1083] "Notification" refers to the transmission of information or messages from a system to a user, and is usually done via email or in-app notifications.

[1084] An "approver" is a user who has the authority to review and approve or reject submitted applications.

[1085] Modes for carrying out the invention

[1086] This invention is a system designed to streamline administrative tasks and reduce the burden on staff. This system enables efficient and accurate work execution, starting with user authentication, followed by selection from the main menu, and processing of various tasks. Specific embodiments are described in detail below.

[1087] User authentication phase

[1088] The user opens a browser (e.g., Google Chrome) on their desktop computer (e.g., Windows PC) or mobile device (e.g., iPhone, Android device) and enters their user ID and password on the login screen. The computer sends this authentication information to the server using HTTPS. The server queries the database server (e.g., MySQL) with the received authentication information to verify that the user ID and password match. If authentication is successful, the server sends the user's profile information to the computer, which displays a message indicating successful login and then displays the main menu as the next step.

[1089] Displaying and selecting from the main menu

[1090] The server generates an appropriate main menu based on the user's job title and permissions. For example, administrators will see options such as "Employee Information Management" and "Leave Approval." The server sends the generated main menu to the terminal, which displays it on the screen. The user then selects the function they want to manage, such as "Employee Information Management" or "Leave Approval," from the main menu.

[1091] Employee information management

[1092] When a user selects the "Employee Information Management" function, the server retrieves information on all employees from the database and sends it to the terminal. The terminal displays a list of employee information, and the user selects a specific employee and performs actions such as "Edit," "Add New," or "Delete." The terminal receives these operations and sends the corresponding requests to the server. The server processes the requests and reflects the changes in the database.

[1093] Vacation Approval Process

[1094] When a user (employee) requests leave, they open the leave request screen on their device and enter the desired leave dates and reason. The device sends the entered request information to the server. The server stores the request information in a database and sends a notification to the approver (e.g., supervisor). This notification is sent using a mail server (e.g., Postfix) or a notification service (e.g., Firebase Cloud Messaging). The user (approver) reviews the details of the leave request on their device and approves or rejects it. The result of the action is again stored in the database, and the server sends the result to the device and notifies the user who submitted the request.

[1095] Specific examples of operation

[1096] One day, an HR representative wants to log into the company's HR system to update employee information. Using their desktop computer, the HR representative enters their user ID and password on the login screen. Upon successful authentication, the main menu appears, and they select "Employee Information Management." The system displays a list of all employees, and the HR representative selects a specific employee and presses the "Edit" button. After updating the necessary information, they press the "Save" button, and the information is reflected in the database.

[1097] Furthermore, if another employee wishes to request leave, they open the leave request screen on their device, enter their request information, and press the submit button. The leave request is sent to the server, and a notification is sent to their supervisor. The supervisor reviews the request on their device and chooses to approve or reject it. Once the selection is complete, the result is notified to the applicant. In this way, various management tasks are performed efficiently and accurately.

[1098] Examples of prompt statements

[1099] The following prompt sentences will be used as the generating AI model.

[1100] Please explain the program processing flow of the administrative department's business efficiency system, broken down into specific processing steps. Describe the user authentication, main menu display and selection, employee information management, and leave approval process, including their specific actions.

[1101] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1102] Step 1: Enter user authentication information

[1103] The user opens the login screen on their desktop or mobile device and enters their user ID and password. Based on this input, authentication information is generated. Specifically, the user enters the information using a keyboard or touchscreen.

[1104] Step 2: Submit authentication information

[1105] The terminal sends the entered authentication information to the server via HTTPS. In this process, encrypted data is sent to the server over the network. The terminal does this using its network interface.

[1106] Step 3: Verifying Authentication Information

[1107] The server verifies the received authentication information by querying the database. During this process, it executes a database query to confirm that the user ID and password match. The input is the authentication information, and the output is the authentication result. Specifically, the server executes an SQL query.

[1108] Step 4: Return of authentication results

[1109] If authentication is successful, the server retrieves the user's profile information from the database and sends it to the terminal. The input is the authentication result, and the output is the user's profile information. The server generates and sends the profile information in JSON format.

[1110] Step 5: Display the main menu

[1111] The device displays a user-specific main menu on its screen based on the received profile information. The input is the profile information, and the output is the main menu screen. Specifically, the device generates a visual menu using HTML and JavaScript.

[1112] Step 6: Select a menu item

[1113] The user selects the function they want to manage from the main menu (e.g., employee information management, leave approval). The selected information is sent from the terminal to the server. Input is the user's selection, and output is the request to the server. Specifically, the user performs mouse clicks or touch operations.

[1114] Step 7: Data Acquisition

[1115] The server retrieves the necessary data from the database according to the selected function. The input is the menu selection information, and the output is the data corresponding to the function. For example, if employee information management is selected, an SQL query is executed to retrieve information on all employees.

[1116] Step 8: Displaying the data

[1117] The terminal displays data received from the server. Input is data from the server, and output is the screen display. Specifically, the terminal renders the data in a tabular or list format on an HTML page.

[1118] Step 9: Data manipulation (Employee information management)

[1119] Users view, edit, add, or delete specific employee information. The terminal sends these operation requests to the server. Input is the user's actions, and output is the request to the server. Specifically, the user fills out forms or clicks buttons.

[1120] Step 10: Update operation results

[1121] The server updates the database based on the operation request it receives. The input is the operation request, and the output is the update result. For example, if new employee information is added, an INSERT statement is executed on the database.

[1122] Step 11: Enter your leave request

[1123] The user (employee) opens the leave request screen on their device and enters the date and reason. The device sends the request information to the server. The input is the leave request information, and the output is the request to the server. Specifically, the user fills out the form and presses the submit button.

[1124] Step 12: Saving and notifying application information

[1125] The server stores the received application information in a database and sends a notification to the approver. The input is the leave application information, and the output is the database update and notification sending. The server executes SQL statements and sends notifications using a mail server or notification service.

[1126] Step 13: Approval or rejection process

[1127] The user (approver) reviews the application details on their terminal and approves or rejects them. The terminal sends this action to the server. The input is the approver's judgment, and the output is the request to the server. Specifically, the approver operates using dropdown menus and buttons.

[1128] Step 14: Notification of Results

[1129] The server stores the approval or rejection result in a database and notifies the applicant. The input is the approval result, and the output is the database update and the notification to the applicant. The server uses a notification service to send the result to the applicant.

[1130] Through the steps outlined above, this system achieves increased efficiency and accuracy in administrative tasks.

[1131] (Application Example 1)

[1132] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1133] Factory management tasks, particularly employee information management and leave approval processes, are time-consuming and labor-intensive, and efficiency improvements are needed. Furthermore, errors and delays are common due to managers manually operating multiple systems. Therefore, the challenge lies in streamlining factory management tasks, reducing errors, and improving productivity.

[1134] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1135] In this invention, the server includes means for inputting user authentication information, means for transmitting the authentication information to the server and for the server to perform authentication, means for obtaining user profile information and displaying a main menu if authentication is successful, means for obtaining necessary data based on the function selected from the main menu and executing the function, means for performing user authentication and operation through the interface of a factory robot, and means for operating factory management tasks (such as employee information management and leave approval) through the robot interface. This makes it possible for users to efficiently operate and manage management tasks within the factory.

[1136] "User authentication information" refers to the user's identification information and password required to access the system.

[1137] A "server" is a central computer system that processes information sent by users and handles authentication, data storage, and data retrieval.

[1138] "Profile information" refers to data used to determine a user's operational rights within the system, such as their personal information, job title, and permissions.

[1139] The "main menu" is a screen that displays a list of functions available to the user after logging in, allowing them to select from them.

[1140] A "function" refers to a specific operation or process that can be performed within a system, and includes administrative tasks such as employee information management and leave approval.

[1141] A "factory" is a facility where production lines, machines, and robots are installed and manufacturing operations are carried out.

[1142] A "robot interface" refers to input / output means such as touch panels and voice recognition devices installed on robots in factories.

[1143] "Employee information management" refers to a function that manages, edits, adds, and deletes employees' personal information, work status, job title, etc.

[1144] "Leave approval" is the process of approving or rejecting leave requests submitted by employees and notifying them of the result.

[1145] "Management duties" refer to various tasks necessary for the operation of the organization, such as managing personnel and labor within the factory, and maintaining and inspecting equipment.

[1146] This invention is a system for streamlining management operations within a factory, and is particularly aimed at automating employee information management and leave approval processes. The system consists of user authentication, main menu display, function selection, and execution phases. The system operates in conjunction with multiple robots within the factory and utilizes the following hardware and software.

[1147] Hardware and software

[1148] Hardware:

[1149] Factory robots: with touch panel or voice recognition capabilities.

[1150] Server: Processes and stores data.

[1151] software:

[1152] Python scripts: Programs for user authentication, data retrieval, and manipulation.

[1153] Request Module: A library for performing API communication.

[1154] Database: Stores user profile information and administrative data (e.g., MySQL, MongoDB).

[1155] Processing flow

[1156] 1. User Authentication Phase:

[1157] The factory manager logs in using the robot's touch panel or voice recognition interface. The login data is transmitted wirelessly to the server. The server queries its database for the received authentication information to verify its validity. If authentication is successful, the server retrieves the user's profile information and displays the main menu on the robot's interface.

[1158] 2. Displaying and selecting from the main menu:

[1159] Upon successful login, the main menu appears on the robot's interface. The user selects functions such as personnel management or leave approval. Based on the selected function, the server retrieves the necessary data from the database and sends it to the robot's interface.

[1160] 3. Execution of business functions:

[1161] Based on the selected function, the robot displays the necessary data, and the user performs the action. For example, if the user selects employee information management, the server retrieves information on all employees from the database and sends it to the robot. The user can then view, edit, add, or delete specific employee information. The results of these actions are reflected in the database via the server.

[1162] Specific example

[1163] Example 1: Editing employee information

[1164] When the administrator speaks "Login" to the factory robot's interface, the robot prompts "Please enter your User ID." The administrator enters "12345" and then enters their password. Upon successful login, the robot displays "Please select a main menu" and presents the options of "Employee Information Management" or "Leave Approval." The administrator selects "Employee Information Management," chooses a specific employee, and presses the "Edit" button. After updating the necessary information, pressing the "Save" button updates the information in the database.

[1165] Example 2: Approval of leave request

[1166] When a user submits a leave request using the factory robot interface, they select the "Leave Request" menu, enter the required information, and press the submit button. The leave request is sent to the server, and a notification is sent to the supervisor. The supervisor reviews the request on their terminal and chooses to approve or reject it. Once the selection is complete, the result is notified to the applicant.

[1167] Example of a prompt

[1168] To the robot assistant: "Login"

[1169] Robot: "Please enter your User ID."

[1170] Administrator: "12345"

[1171] Robot: "Please enter your password."

[1172] Administrator: [Enter password]

[1173] Robot: "Login successful. Please select a main menu item: 1. Employee Information Management, 2. Leave Approval."

[1174] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1175] Step 1:

[1176] The user either says "Login" to the factory robot's interface or a login screen is displayed on the touch panel. The system requests a user ID and password as input and sends this data to the server. The server queries a database for the user ID and password and performs authentication. The output is either a success or failure authentication result; if authentication is successful, the server retrieves the user's profile information and returns it to the terminal.

[1177] Step 2:

[1178] The terminal displays the user's profile information along with a message confirming successful authentication. It generates a main menu, presenting the user with options such as "Employee Information Management" or "Leave Approval." There is no input required, but the user's selection becomes the input for the next step. The output is the display of the main menu.

[1179] Step 3:

[1180] The user selects the function they want to manage from the main menu (e.g., employee information management). The input is the user's selection, and the terminal sends this selection to the server. Based on the selected function, the server retrieves the necessary data from the database and sends it to the terminal. The output is the retrieval and display of the corresponding data.

[1181] Step 4:

[1182] The terminal displays data received from the server and allows the user to interact with it. For example, in employee information management, it displays a list of all employees. The user can then edit, add, or delete specific employee information. Input is the user's actions, and output is a confirmation screen of those actions.

[1183] Step 5:

[1184] After a user completes an edit, add, or delete operation, the terminal sends the result of the operation to the server. The input is the operation result, and the server reflects this information in the database. The output is the database update result and a completion message for the user.

[1185] Step 6:

[1186] When a user submits a leave request, they enter the necessary application information (e.g., reason for leave, duration, etc.) on the leave request screen. The input is the user's application information, and the terminal sends this information to the server. The server saves the application information to a database and sends a notification to the approver. The output is the saved application information and the notification to the approver.

[1187] Step 7:

[1188] Upon receiving a notification from the server, the approver reviews the details of the leave request and decides to approve or reject it. Input is the approver's action, and the result is sent to the server. The server saves the result to a database and notifies the applicant. Output is the notification result sent to both the applicant and the approver.

[1189] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1190] This invention combines a system designed to streamline administrative tasks and reduce the burden on staff with an emotion engine that recognizes user emotions and provides a more appropriate interface. This system has the functionality to provide appropriate feedback and suggestions based on the user's emotional state, from user authentication to main menu selection and processing of various tasks.

[1191] User authentication phase

[1192] The user opens the login screen on their device and enters their user ID and password. The device sends this authentication information to the server. The server queries the received authentication information against its database to verify its accuracy. If authentication is successful, the server returns the user's profile information and data for displaying the main menu to the device. Simultaneously, the emotion engine analyzes the user's emotions based on their input and actions and sends the analysis results to the server.

[1193] Displaying and selecting from the main menu

[1194] The server generates a customized main menu based on the user's profile information and sentiment analysis results, and sends it to the terminal. The terminal displays the received main menu on its screen. The user selects the desired function from the main menu (e.g., employee information management, leave approval). Based on the selected function, the server retrieves the necessary data from the database and provides an interface tailored to the user's emotional state.

[1195] Employee information management

[1196] For example, if a user selects the "Employee Information Management" function, the server retrieves information on all employees from the database and sends it to the terminal. The terminal displays a list of employee information, and the user can view, edit, add, or delete information on specific employees. The emotion engine analyzes the user's emotions during these operations and modifies the interface accordingly. This supports the user in working without stress.

[1197] Vacation Approval Process

[1198] When a user (employee) submits a leave request, they enter the necessary information on their terminal and press the submit button. The terminal sends the request information to the server. The server stores the request information in a database, sends a notification to the approver, and analyzes the applicant's emotional state using an emotion engine to provide appropriate feedback. The supervisor receives the leave request notification on their terminal, reviews the details, and then approves or rejects the request. The result of this action is again stored in the database, and the applicant is notified of the result. At this time, the emotion engine analyzes the emotional states of both the supervisor and the applicant, and provides an interface that is designed to minimize stress for both parties.

[1199] Specific example

[1200] One day, an HR representative logs into the system. As they enter their login information, the emotion engine analyzes their typing speed and the frequency of errors to determine if they are emotionally unstable. After successful authentication, the server displays a main menu tailored to the user's state, displaying a gentle message such as, "What can we help you with today?" When the HR representative selects "Employee Information Management," the emotion engine, having detected stress, switches to an intuitive and easy-to-use interface.

[1201] Similarly, when another employee submits a leave request, the emotion engine analyzes their urgency and presents a concise input form. When a supervisor approves the request, the emotion engine analyzes the supervisor's emotional state and provides appropriate feedback.

[1202] In this way, the present invention improves the usability of the system by analyzing the user's emotional state, thereby achieving increased operational efficiency and reduced workload for the person in charge.

[1203] The following describes the processing flow.

[1204] User authentication phase

[1205] Step 1:

[1206] The user opens the login screen on their device and enters their user ID and password.

[1207] Step 2:

[1208] The terminal sends the entered authentication information to the server.

[1209] Step 3:

[1210] The server queries the database for the received authentication information to verify its accuracy.

[1211] Step 4:

[1212] If authentication is successful, the server retrieves the user's profile information and sends the input data from the login process to the emotion engine.

[1213] Step 5:

[1214] The emotion engine analyzes the user's emotions and sends the results to the server.

[1215] Step 6:

[1216] The server sends the user's profile information and sentiment analysis results to the terminal.

[1217] Step 7:

[1218] The device displays the main menu screen.

[1219] Displaying and selecting from the main menu

[1220] Step 1:

[1221] The server generates main menu options based on the user's profile information and sentiment analysis results.

[1222] Step 2:

[1223] The server sends the main menu options to the terminal.

[1224] Step 3:

[1225] The device displays the received main menu on its screen.

[1226] Step 4:

[1227] The user selects the desired function from the main menu.

[1228] Step 5:

[1229] The terminal sends the user's selection to the server.

[1230] Step 6:

[1231] The server retrieves the necessary data from the database based on the selected function.

[1232] Step 7:

[1233] The emotion engine suggests an appropriate interface based on the user's emotions and sends the result to the server.

[1234] Step 8:

[1235] The server sends the acquired data along with suggestions from the emotion engine to the terminal.

[1236] Step 9:

[1237] The device displays a screen corresponding to the selected function and adjusts the user interface accordingly.

[1238] Employee information management

[1239] Step 1:

[1240] The user selects the employee information management function.

[1241] Step 2:

[1242] The server retrieves information on all employees from the database.

[1243] Step 3:

[1244] The server sends the acquired employee information to the terminal.

[1245] Step 4:

[1246] The terminal displays a list of employee information on its screen.

[1247] Step 5:

[1248] Users can select specific employee information and perform actions such as viewing, editing, adding, or deleting it.

[1249] Step 6:

[1250] The terminal sends user actions to the server.

[1251] Step 7:

[1252] The server performs CRUD operations on the database based on the operation performed.

[1253] Step 8:

[1254] The emotion engine analyzes the user's emotions during operation and sends the results to the server.

[1255] Step 9:

[1256] The server sends the operation results to the terminal.

[1257] Step 10:

[1258] The device updates the screen based on the operation results and adjusts the interface to reflect the results of the emotion engine.

[1259] Vacation Approval Process

[1260] Step 1:

[1261] The user (employee) opens the leave request screen and enters the necessary information.

[1262] Step 2:

[1263] The terminal sends the entered application information to the server.

[1264] Step 3:

[1265] The server stores the application information in a database.

[1266] Step 4:

[1267] The emotion engine analyzes the user's emotions based on input content and input speed, and sends the results to the server.

[1268] Step 5:

[1269] The server sends a notification of the leave request to the approver (supervisor) and also notifies them of the applicant's emotional state.

[1270] Step 6:

[1271] The server sends the notification content to the approver's device.

[1272] Step 7:

[1273] The user (supervisor) checks the leave request notification on their terminal.

[1274] Step 8:

[1275] The user (supervisor) reviews the details of the leave request and chooses to approve or reject it.

[1276] Step 9:

[1277] The terminal sends the supervisor's selection to the server.

[1278] Step 10:

[1279] The server saves the selection results to the database.

[1280] Step 11:

[1281] The emotion engine analyzes the boss's emotions and sends the results to the server.

[1282] Step 12:

[1283] The server notifies the applicant of the result and provides feedback that reflects the results of the emotion engine.

[1284] Step 13:

[1285] The device displays the results to the applicant and provides feedback from the emotion engine.

[1286] In this way, the operations of the administrative department are streamlined, and a flexible interface that responds to the user's emotional state is provided, resulting in improved accuracy and reduced workload for the person in charge.

[1287] (Example 2)

[1288] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1289] Current business management systems often cause user stress because they provide a uniform interface without considering the user's emotional state. Furthermore, improvements in work efficiency and reduction of the burden on employees are not sufficiently achieved. This is particularly due to the provision of inappropriate feedback during operations that users find stressful or critical. Therefore, there is a need for a system that appropriately analyzes the user's emotional state and provides an interface and feedback accordingly.

[1290] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1291] In this invention, the server includes means for inputting user authentication information, means for transmitting the authentication information to the server and for the server to perform authentication, means for acquiring user profile information and displaying a customized main menu based on the sentiment analysis results if authentication is successful, and means for acquiring necessary data based on the function selected from the main menu and providing an appropriate interface according to the sentiment analysis results. This enables the provision of an interface and feedback that responds to the user's emotional state, thereby improving work efficiency and reducing the burden on the person in charge.

[1292] "User authentication information" refers to the information that a user enters to access the system, and typically consists of a user ID and password.

[1293] A "server" is a computer system that sends and receives data over a network and provides authentication, manages profile information, and offers interfaces based on the results of sentiment analysis.

[1294] "Profile information" refers to data that includes personal information and settings information about the user, and is used to provide information based on the user's usage history and preferences.

[1295] "Emotional analysis results" refer to the estimated emotional state of a user, based on data such as the user's operation speed and error frequency.

[1296] A "customized main menu" refers to a main menu that has been individually adjusted based on the user's profile information and sentiment analysis results.

[1297] "Required data" refers to various pieces of information retrieved from the server in order to execute the function selected by the user, and this information is stored in a database.

[1298] "Interface" refers to the screens and means of operation that users use to interact with a system, and these are appropriately modified according to the user's emotional state.

[1299] "A user selecting an employee information management function" refers to the act of a user selecting a function from the main menu to display, edit, add, or delete employee information.

[1300] "Leave request information" refers to detailed information necessary for a user to take leave, which is sent to the server and later processed by an approver.

[1301] A "database" is a system for systematically storing and managing large amounts of data, and for searching and retrieving data as needed.

[1302] An "approver" is a person who has the authority to receive leave requests from users and approve or reject them.

[1303] This invention combines a system designed to streamline administrative tasks and reduce the burden on staff with an emotion engine that recognizes user emotions and provides a more appropriate interface. From user authentication to main menu selection and processing of various tasks, the system provides appropriate feedback and suggestions based on the user's emotional state.

[1304] User authentication phase

[1305] The user opens the login screen on their device and enters their user ID and password. The device sends this authentication information to the server. The server queries the received authentication information against its database to verify its accuracy. If authentication is successful, the server sends the user's profile information and data for displaying the main menu back to the device. Simultaneously, the emotion engine analyzes the user's emotions based on their input speed and actions, and sends the results to the server.

[1306] Displaying and selecting from the main menu

[1307] The server generates a customized main menu for each user based on the user's profile information and sentiment analysis results, and sends it to the terminal. The terminal displays the received customized main menu on its screen. The user selects the desired function from the main menu (e.g., employee information management, leave approval). Based on the selected function, the server retrieves the necessary data from the database and provides an interface that is appropriate to the user's emotional state.

[1308] Employee information management

[1309] For example, if a user selects the "Employee Information Management" function, the server retrieves information on all employees from the database and sends it to the terminal. The terminal displays a list of the retrieved employee information on the screen. The user can view and edit specific employee information, and add or delete new employees. The emotion engine analyzes the user's emotions during these operations and modifies the interface to make the operation intuitive and easy. This supports the user in working without stress.

[1310] Vacation Approval Process

[1311] When a user (employee) submits a leave request, they enter the necessary information on their terminal and press the submit button. The terminal sends the request information to the server. The server stores the request information in a database and sends a notification to the approver. At the same time, the emotion engine analyzes the applicant's emotional state and provides appropriate feedback. The supervisor receives the leave request notification on their terminal, reviews the details, and then approves or rejects the request. The result of this action is again stored in the database, and the applicant is notified of the result. In this process, the emotion engine analyzes the emotional states of both the supervisor and the applicant, providing an interface that is designed to minimize stress for both parties.

[1312] Specific example

[1313] One day, an HR representative logs into the system. As they enter their login information, the emotion engine analyzes their typing speed and error frequency, and detects if they are feeling emotionally unstable. After successful authentication, the server displays a main menu tailored to the representative's state, displaying a gentle message such as, "What can we help you with today?" When the user selects "Employee Information Management," the emotion engine detects that the representative is stressed and automatically switches to a user-friendly, intuitive interface. This improves the representative's work efficiency. Similarly, when another employee submits a leave request, the emotion engine analyzes if the employee is in a hurry and provides a quick and concise input form. After the request is submitted, when the supervisor approves it, the emotion engine analyzes the supervisor's emotions and provides appropriate feedback.

[1314] Example of a prompt

[1315] Please describe how a system works by analyzing a user's emotions when they log into the system and customizing how the main menu is displayed.

[1316] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1317] Step 1:

[1318] The user opens the login screen on their device and enters their user ID and password. This entered information becomes the input data. The device sends this authentication information to the server. The entered information is sent to the server as user authentication information.

[1319] Step 2:

[1320] The server queries the database for the received authentication information to verify its accuracy. This database query outputs the authentication result (authentication successful or failed). If authentication is successful, the server retrieves the user's profile information from the database.

[1321] Step 3:

[1322] Based on the acquired profile information, the server sends data such as the user's input speed and error frequency to the emotion engine. The emotion engine analyzes this data and outputs the user's emotional state. The emotional state is classified as "stable," "unstable," etc.

[1323] Step 4:

[1324] The server generates a customized main menu tailored to each individual user based on the user's profile information and sentiment analysis results. This main menu is output as generated data and sent to the terminal.

[1325] Step 5:

[1326] The terminal displays the customized main menu it received on the screen. From here, the user selects the desired function (e.g., employee information management, leave approval). The selected menu is sent to the server as input data.

[1327] Step 6:

[1328] The server retrieves the necessary data from the database based on the function selected by the user. This data retrieval process outputs the relevant data, and simultaneously generates an interface that corresponds to the user's emotional state.

[1329] Step 7:

[1330] For example, if a user selects the "Employee Information Management" function, the server retrieves information on all employees from the database and sends it to the terminal. This displays a list of employee information on the terminal, allowing the user to view, edit, add, or delete information on specific employees. The results of these operations are sent to the emotion engine, which re-analyzes the user's emotional state.

[1331] Step 8:

[1332] When a user (employee) submits a leave request, they enter the necessary application information on a terminal and press the submit button. The terminal sends the application information to the server. The server stores the application information in a database, sends a notification to the approver, and analyzes the applicant's emotional state using an emotion engine to provide appropriate feedback.

[1333] Step 9:

[1334] The supervisor receives a notification of the leave request on their device, reviews the details, and then approves or rejects it. This result is saved back to the database, and the applicant is notified of the outcome. Simultaneously, the emotion engine analyzes the emotional states of both the supervisor and the applicant, providing an interface designed to minimize stress for both parties.

[1335] (Application Example 2)

[1336] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1337] The problem that this invention aims to solve is to improve the efficiency of management tasks and reduce the burden on personnel. Current systems completely disregard the emotional state of users, and their uniform usability makes it difficult for users to cope with stress or sudden changes in circumstances. In particular, in tasks requiring a high level of tension, such as those performed by security personnel, there is a need for user interfaces that adapt to the emotional state of individual personnel to improve work efficiency and enable appropriate responses.

[1338] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1339] In this invention, the server includes means for inputting user authentication information, means for transmitting the authentication information to the server and for the server to perform authentication, means for obtaining user profile information and displaying a main menu if authentication is successful, means for obtaining necessary data based on the function selected from the main menu and executing the function, means for analyzing the user's emotional state using an emotion analysis engine, and means for adaptively changing the user interface based on the analysis results. This makes it possible to provide an interface that takes the user's emotional state into consideration, thereby improving the efficiency of management operations and reducing the burden on staff.

[1340] "User authentication information" refers to information used to identify and authenticate a user, such as the user's ID and password.

[1341] A "server" is a computer system that performs user authentication, data processing, and the primary functions of a system.

[1342] "Profile information" refers to individual information about a user, including, for example, name, job title, and past operation history.

[1343] The "main menu" is an interface that appears after a user logs into the system, allowing them to select from multiple functions.

[1344] An "emotion analysis engine" is software or algorithms used to analyze a user's emotions based on factors such as facial recognition and user behavior.

[1345] A "database" is a system that centrally manages and stores user profile information and information related to business processes.

[1346] "User interface" refers to the screen display and operating methods that enable interaction between the user and the system.

[1347] The "Employee Information Management Function" is a feature that allows users to view, edit, add, and delete employee information.

[1348] A "leave request" is the process by which a user enters and submits the necessary information to take leave for a certain period of time.

[1349] An "approver" is the person responsible for making the final decision to approve or reject leave requests and other work processes.

[1350] "Analysis results" refer to data about the user's emotional state obtained by the emotion analysis engine.

[1351] "Means of adaptive modification" refer to methods and functions for dynamically optimizing and changing the user interface in response to the user's emotional state.

[1352] The system for implementing the present invention performs user authentication, acquisition of profile information, display of the main menu, analysis of emotional state by an emotion analysis engine, and adaptive modification of the user interface based on the analysis. The specific configuration and operation are shown below.

[1353] 1. User Authentication

[1354] The terminal prompts the user to enter authentication information through a login screen. The user enters their ID and password, and this information is sent to the server. The server queries its database to perform authentication. If authentication is successful, the server sends the user's profile information to the terminal.

[1355] 2. Introduction of an emotion analysis engine

[1356] During the authentication process, the device uses its camera and input data to acquire the user's facial image and operation status, and sends this information to the emotion analysis engine. The emotion analysis engine uses libraries such as DeepFace to perform image analysis and recognize emotional states.

[1357] 3. Displaying the main menu

[1358] The server generates a customized main menu based on the user's profile information and the results of the emotion analysis engine. This menu changes according to the user's emotional state and is designed to reduce stress and anxiety. For example, a concise menu is displayed when the user is in a hurry, while a more detailed menu is displayed when they are relaxed.

[1359] 4. Function Selection and Emotional Response

[1360] When a user selects a desired function from the main menu, the server retrieves the corresponding data from the database and provides an interface tailored to the user's emotional state. This allows users to perform their tasks using an intuitive and easy-to-use interface.

[1361] Explanation of specific examples

[1362] Example 1: User Authentication

[1363] One day, a user attempts to log in to the system. As they enter their login information, the camera built into the device captures an image of the user, and an emotion analysis engine analyzes their emotional state. For example, the analysis might reveal that the user is focused but slightly tense. Based on this, the server displays a message saying "Please calm down" along with a concise main menu.

[1364] Example 2: Employee Information Management

[1365] Next, when the user selects the "Employee Information Management" function from the main menu, the server retrieves the necessary employee information from the database. The emotion analysis engine also monitors the user's emotions in real time while they are operating the system. For example, if the user is feeling stressed, intuitive and easy-to-follow instructions are presented.

[1366] Example 3: Leave application

[1367] When a user submits a leave request, they enter the required information and press the submit button. The sentiment analysis engine detects if the user is in a hurry and simplifies the input form. Simultaneously, the server saves the relevant information to the database and notifies the approver. The approver's emotional state is also analyzed by the sentiment analysis engine, and appropriate feedback is provided.

[1368] Example of a prompt

[1369] Please analyze the emotions in the following image:

[1370] [Image URL]

[1371] The user is currently logged in. Based on the analyzed sentiment, please suggest the next message and layout to display. If the user's sentiment is "angry," display a warning; if it is "happy," display detailed information.

[1372] Thus, the present invention analyzes the user's emotional state in real time and adapts the interface based on that analysis, thereby improving the efficiency of management tasks and reducing the burden on the person in charge.

[1373] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1374] Step 1:

[1375] The user opens the login screen and enters their ID and password.

[1376] Enter: ID and password

[1377] Output: Authentication information sent to the server

[1378] Operation: The terminal sends the ID and password received from the user to the server.

[1379] Step 2:

[1380] The server queries the database for the authentication information it receives and performs the authentication.

[1381] Input: Authentication information (ID and password)

[1382] Output: Authentication results and profile information

[1383] Operation: The server queries the database for the relevant user's information, and if authentication is successful, retrieves the profile information.

[1384] Step 3:

[1385] The device captures an image of the user's face and sends it to the emotion analysis engine.

[1386] Input: User's face image

[1387] Output: Analysis results of emotional state

[1388] Operation: The device uses its camera to acquire an image of the user's face and sends it to the emotion analysis engine.

[1389] Step 4:

[1390] The emotion analysis engine analyzes the user's emotional state and sends it to the server.

[1391] Input: User's face image

[1392] Output: Analysis results of emotional state

[1393] Operation: The emotion analysis engine uses libraries such as DeepFace to analyze the user's emotional state. The analysis results are sent to the server.

[1394] Step 5:

[1395] The server generates a main menu based on the profile information and the results of the emotional state analysis, and sends it to the terminal.

[1396] Input: Profile information and analysis results of emotional state

[1397] Output: Customized main menu

[1398] Operation: The server generates an adaptively changing main menu based on profile information and emotional state, and sends it to the terminal.

[1399] Step 6:

[1400] The device displays a customized main menu, allowing the user to select the desired function.

[1401] Input: Customized main menu

[1402] Output: Identifier of the selected feature

[1403] Operation: The user selects the desired function from the main menu, and the selection is recognized by the device.

[1404] Step 7:

[1405] The server retrieves the necessary data from the database based on the selected function.

[1406] Input: Identifier of the selected function

[1407] Output: Required data

[1408] Operation: The server retrieves data from the database according to the selected function and sends it to the terminal.

[1409] Step 8:

[1410] The device displays the data it has acquired and adaptively changes the interface according to the user's emotional state.

[1411] Input: Acquired data and emotional state

[1412] Output: Optimized user interface

[1413] Operation: The device displays the acquired data and, based on the analysis results of the emotion engine, modifies the interface to best suit the user.

[1414] Step 9:

[1415] Users perform specific tasks (for example, viewing, editing, adding, and deleting employee information).

[1416] Input: User actions and data

[1417] Output: Processing results of the task

[1418] Operation: Appropriate processing is performed according to the user's actions, and the results are reflected in the database.

[1419] Step 10:

[1420] The user submits a leave request, enters the necessary information, and sends it to the server.

[1421] Input: Leave request information

[1422] Output: Notification of successful application

[1423] Operation: The user fills in the required information on the leave request form, and the terminal sends it to the server.

[1424] Step 11:

[1425] The server saves the application information to the database and notifies the approver.

[1426] Input: Leave request information

[1427] Output: Notification to approver

[1428] Operation: The server saves the leave request information to the database and sends a notification to the approver.

[1429] Step 12:

[1430] The approver reviews the application and decides whether to approve or reject it.

[1431] Input: Leave request details

[1432] Output: Approval or rejection result

[1433] Operation: The approver reviews the application details on their terminal and selects to approve or reject it. The result of this action is saved in the database and notified to the applicant.

[1434] After completing the above steps, the system will be operational, analyzing the user's emotional state in real time and adaptively changing the interface to improve work efficiency and reduce the burden on the person in charge.

[1435] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1436] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1437] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1438] [Fourth Embodiment]

[1439] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1440] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1441] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1442] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1443] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1444] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1445] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1446] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1447] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1448] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1449] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1450] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1451] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1452] This invention provides a system to streamline administrative operations and reduce the burden on staff. This system enables efficient and accurate work execution, starting with user authentication, followed by selection from the main menu, and processing of various tasks.

[1453] User authentication phase

[1454] The user enters their user ID and password on the login screen on their device. The device sends this authentication information to the server. The server queries its database for the received authentication information to verify its validity. If authentication is successful, the server returns the user's profile information to the device, the device displays a message indicating successful login, and then displays the main menu as the next step.

[1455] Displaying and selecting from the main menu

[1456] The server generates an appropriate main menu based on the user's job title and permissions and sends it to the terminal. The terminal displays the received main menu on its screen. The user selects the function they want to manage from the main menu, such as "Employee Information Management" or "Leave Approval." Based on the selected function, the server retrieves the necessary data from the database and sends it to the terminal.

[1457] Employee information management

[1458] For example, if a user selects the "Employee Information Management" function, the server retrieves information on all employees from the database and sends it to the terminal. The terminal displays a list of employee information, and the user can view, edit, add, or delete information on specific employees. The results of these operations are reflected in the database via the server.

[1459] Vacation Approval Process

[1460] When a user (employee) submits a leave request, they enter the necessary information on their terminal. Upon pressing the submit button, the terminal sends the information to the server. The server stores the information in its database and sends a notification to the approver. This notification is then sent from the server to the terminal, and the user (approver) reviews the details of the leave request before approving or rejecting it. The result of this action is again saved in the database, and the user (employee who submitted the request) is notified of the result.

[1461] Specific example

[1462] One day, an HR representative wants to log into the company's HR system to update employee information. Using their desktop computer, the HR representative enters their user ID and password on the login screen. Upon successful authentication, the main menu appears, and they select "Employee Information Management." The system displays a list of all employees, and the HR representative selects a specific employee and presses the "Edit" button. After updating the necessary information, they press the "Save" button, and the information is reflected in the database.

[1463] Furthermore, if another employee wishes to request leave, they open the leave request screen on their device, enter their request information, and press the submit button. The leave request is sent to the server, and a notification is sent to their supervisor. The supervisor reviews the request on their device and chooses to approve or reject it. Once the selection is complete, the result is notified to the applicant. In this way, various management tasks are performed efficiently and accurately.

[1464] The above describes the embodiment for carrying out the present invention. This system will improve the efficiency of the administrative department and reduce the burden on the staff. As a result, it is expected that the productivity of the entire organization will improve.

[1465] The following describes the processing flow.

[1466] User authentication phase

[1467] Step 1:

[1468] The user opens the login screen on their device and enters their user ID and password.

[1469] Step 2:

[1470] The terminal sends the entered authentication information to the server.

[1471] Step 3:

[1472] The server queries the database for the received authentication information to verify its accuracy.

[1473] Step 4:

[1474] If authentication is successful, the server retrieves the user's profile information.

[1475] Step 5:

[1476] The server sends a message to the terminal confirming successful authentication along with the user's profile information.

[1477] Step 6:

[1478] The device displays the main menu screen.

[1479] Displaying and selecting from the main menu

[1480] Step 1:

[1481] The server generates the main menu options based on the user's profile information.

[1482] Step 2:

[1483] The server sends the main menu options to the terminal.

[1484] Step 3:

[1485] The device displays the received main menu on its screen.

[1486] Step 4:

[1487] The user selects the desired function from the main menu.

[1488] Step 5:

[1489] The terminal sends the user's selection to the server.

[1490] Step 6:

[1491] The server retrieves the necessary data from the database based on the selected function.

[1492] Step 7:

[1493] The server sends the acquired data to the terminal.

[1494] Step 8:

[1495] The device displays a screen corresponding to the selected function.

[1496] Employee information management

[1497] Step 1:

[1498] The user selects the employee information management function.

[1499] Step 2:

[1500] The server retrieves information on all employees from the database.

[1501] Step 3:

[1502] The server sends the acquired employee information to the terminal.

[1503] Step 4:

[1504] The terminal displays a list of employee information on its screen.

[1505] Step 5:

[1506] Users can select specific employee information and perform actions such as viewing, editing, adding, or deleting it.

[1507] Step 6:

[1508] The terminal sends user actions to the server.

[1509] Step 7:

[1510] The server performs CRUD operations on the database based on the operation performed.

[1511] Step 8:

[1512] The server sends the operation results to the terminal.

[1513] Step 9:

[1514] The device updates the screen based on the operation result.

[1515] Vacation Approval Process

[1516] Step 1:

[1517] The user (employee) opens the leave request screen and enters the necessary information.

[1518] Step 2:

[1519] The terminal sends the entered application information to the server.

[1520] Step 3:

[1521] The server stores the application information in a database.

[1522] Step 4:

[1523] The server sends a notification of the leave request to the approver (supervisor).

[1524] Step 5:

[1525] The server sends the notification content to the approver's device.

[1526] Step 6:

[1527] The user (supervisor) checks the leave request notification on their terminal.

[1528] Step 7:

[1529] The user (supervisor) reviews the details of the leave request and chooses to approve or reject it.

[1530] Step 8:

[1531] The terminal sends the supervisor's selection to the server.

[1532] Step 9:

[1533] The server saves the selection results to the database.

[1534] Step 10:

[1535] The server sends a notification to the applicant.

[1536] Step 11:

[1537] The terminal displays the results to the applicant.

[1538] In this way, the administrative department's operations are streamlined, and a system is created that enables accurate data management and rapid leave approval.

[1539] (Example 1)

[1540] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1541] The administrative department's duties are diverse, requiring the management and approval of various types of information. However, traditional systems often involve manual operations, resulting in poor work efficiency and placing an excessive burden on staff. Furthermore, the lack of standardized processes poses a risk of data inaccuracy. In addition, it is difficult to grasp the status of various tasks in real time. Therefore, a system is needed to improve the efficiency and accuracy of administrative operations.

[1542] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1543] In this invention, the server includes means for inputting user authentication information, means for transmitting the authentication information to the server and for the server to perform authentication in cooperation with a database, means for obtaining user profile information upon successful authentication and generating and displaying a main menu based on the user's role and authority, and means for obtaining necessary data based on the function selected from the main menu and executing the function. This enables improved efficiency and accuracy in management operations and reduces the burden on the person in charge.

[1544] "User authentication information" refers to information that a user provides to identify themselves, and typically includes a user ID and password.

[1545] A "server" is a computer system that receives requests from client terminals on a network and performs data processing and responses.

[1546] A "database" is a system or software for organizing and storing data, and is managed in a way that allows for efficient searching and updating.

[1547] "Profile information" refers to user-specific information, including the user's job title, permissions, and personal information.

[1548] The "main menu" is a menu screen that is displayed to allow the user to select functions within the system.

[1549] "Position" refers to the job title or responsibilities a user holds within an organization.

[1550] "Permissions" refer to information that defines the range of operations a user can perform and the information they can access within a system.

[1551] A "function" is a program or module that performs a specific operation or process provided by a system.

[1552] "Employee information management" refers to system functions for registering, displaying, editing, or deleting employee personal data, work history, performance evaluation information, etc.

[1553] A "leave application" is the application process that an employee goes through to take leave for a certain period of time.

[1554] "Notification" refers to the transmission of information or messages from a system to a user, and is usually done via email or in-app notifications.

[1555] An "approver" is a user who has the authority to review and approve or reject submitted applications.

[1556] Modes for carrying out the invention

[1557] This invention is a system designed to streamline administrative tasks and reduce the burden on staff. This system enables efficient and accurate work execution, starting with user authentication, followed by selection from the main menu, and processing of various tasks. Specific embodiments are described in detail below.

[1558] User authentication phase

[1559] The user opens a browser (e.g., Google Chrome) on their desktop computer (e.g., Windows PC) or mobile device (e.g., iPhone, Android device) and enters their user ID and password on the login screen. The computer sends this authentication information to the server using HTTPS. The server queries the database server (e.g., MySQL) with the received authentication information to verify that the user ID and password match. If authentication is successful, the server sends the user's profile information to the computer, which displays a message indicating successful login and then displays the main menu as the next step.

[1560] Displaying and selecting from the main menu

[1561] The server generates an appropriate main menu based on the user's job title and permissions. For example, administrators will see options such as "Employee Information Management" and "Leave Approval." The server sends the generated main menu to the terminal, which displays it on the screen. The user then selects the function they want to manage, such as "Employee Information Management" or "Leave Approval," from the main menu.

[1562] Employee information management

[1563] When a user selects the "Employee Information Management" function, the server retrieves information on all employees from the database and sends it to the terminal. The terminal displays a list of employee information, and the user selects a specific employee and performs actions such as "Edit," "Add New," or "Delete." The terminal receives these operations and sends the corresponding requests to the server. The server processes the requests and reflects the changes in the database.

[1564] Vacation Approval Process

[1565] When a user (employee) requests leave, they open the leave request screen on their device and enter the desired leave dates and reason. The device sends the entered request information to the server. The server stores the request information in a database and sends a notification to the approver (e.g., supervisor). This notification is sent using a mail server (e.g., Postfix) or a notification service (e.g., Firebase Cloud Messaging). The user (approver) reviews the details of the leave request on their device and approves or rejects it. The result of the action is again stored in the database, and the server sends the result to the device and notifies the user who submitted the request.

[1566] Specific examples of operation

[1567] One day, an HR representative wants to log into the company's HR system to update employee information. Using their desktop computer, the HR representative enters their user ID and password on the login screen. Upon successful authentication, the main menu appears, and they select "Employee Information Management." The system displays a list of all employees, and the HR representative selects a specific employee and presses the "Edit" button. After updating the necessary information, they press the "Save" button, and the information is reflected in the database.

[1568] Furthermore, if another employee wishes to request leave, they open the leave request screen on their device, enter their request information, and press the submit button. The leave request is sent to the server, and a notification is sent to their supervisor. The supervisor reviews the request on their device and chooses to approve or reject it. Once the selection is complete, the result is notified to the applicant. In this way, various management tasks are performed efficiently and accurately.

[1569] Examples of prompt statements

[1570] The following prompt sentences will be used as the generating AI model.

[1571] Please explain the program processing flow of the administrative department's business efficiency system, broken down into specific processing steps. Describe the user authentication, main menu display and selection, employee information management, and leave approval process, including their specific actions.

[1572] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1573] Step 1: Enter user authentication information

[1574] The user opens the login screen on their desktop or mobile device and enters their user ID and password. Based on this input, authentication information is generated. Specifically, the user enters the information using a keyboard or touchscreen.

[1575] Step 2: Submit authentication information

[1576] The terminal sends the entered authentication information to the server via HTTPS. In this process, encrypted data is sent to the server over the network. The terminal does this using its network interface.

[1577] Step 3: Verifying Authentication Information

[1578] The server verifies the received authentication information by querying the database. During this process, it executes a database query to confirm that the user ID and password match. The input is the authentication information, and the output is the authentication result. Specifically, the server executes an SQL query.

[1579] Step 4: Return of authentication results

[1580] If authentication is successful, the server retrieves the user's profile information from the database and sends it to the terminal. The input is the authentication result, and the output is the user's profile information. The server generates and sends the profile information in JSON format.

[1581] Step 5: Display the main menu

[1582] The device displays a user-specific main menu on its screen based on the received profile information. The input is the profile information, and the output is the main menu screen. Specifically, the device generates a visual menu using HTML and JavaScript.

[1583] Step 6: Select a menu item

[1584] The user selects the function they want to manage from the main menu (e.g., employee information management, leave approval). The selected information is sent from the terminal to the server. Input is the user's selection, and output is the request to the server. Specifically, the user performs mouse clicks or touch operations.

[1585] Step 7: Data Acquisition

[1586] The server retrieves the necessary data from the database according to the selected function. The input is the menu selection information, and the output is the data corresponding to the function. For example, if employee information management is selected, an SQL query is executed to retrieve information on all employees.

[1587] Step 8: Displaying the data

[1588] The terminal displays data received from the server. Input is data from the server, and output is the screen display. Specifically, the terminal renders the data in a tabular or list format on an HTML page.

[1589] Step 9: Data manipulation (Employee information management)

[1590] Users view, edit, add, or delete specific employee information. The terminal sends these operation requests to the server. Input is the user's actions, and output is the request to the server. Specifically, the user fills out forms or clicks buttons.

[1591] Step 10: Update operation results

[1592] The server updates the database based on the operation request it receives. The input is the operation request, and the output is the update result. For example, if new employee information is added, an INSERT statement is executed on the database.

[1593] Step 11: Enter your leave request

[1594] The user (employee) opens the leave request screen on their device and enters the date and reason. The device sends the request information to the server. The input is the leave request information, and the output is the request to the server. Specifically, the user fills out the form and presses the submit button.

[1595] Step 12: Saving and notifying application information

[1596] The server stores the received application information in a database and sends a notification to the approver. The input is the leave application information, and the output is the database update and notification sending. The server executes SQL statements and sends notifications using a mail server or notification service.

[1597] Step 13: Approval or rejection process

[1598] The user (approver) reviews the application details on their terminal and approves or rejects them. The terminal sends this action to the server. The input is the approver's judgment, and the output is the request to the server. Specifically, the approver operates using dropdown menus and buttons.

[1599] Step 14: Notification of Results

[1600] The server stores the approval or rejection result in a database and notifies the applicant. The input is the approval result, and the output is the database update and the notification to the applicant. The server uses a notification service to send the result to the applicant.

[1601] Through the steps outlined above, this system achieves increased efficiency and accuracy in administrative tasks.

[1602] (Application Example 1)

[1603] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1604] Factory management tasks, particularly employee information management and leave approval processes, are time-consuming and labor-intensive, and efficiency improvements are needed. Furthermore, errors and delays are common due to managers manually operating multiple systems. Therefore, the challenge lies in streamlining factory management tasks, reducing errors, and improving productivity.

[1605] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1606] In this invention, the server includes means for inputting user authentication information, means for transmitting the authentication information to the server and for the server to perform authentication, means for obtaining user profile information and displaying a main menu if authentication is successful, means for obtaining necessary data based on the function selected from the main menu and executing the function, means for performing user authentication and operation through the interface of a factory robot, and means for operating factory management tasks (such as employee information management and leave approval) through the robot interface. This makes it possible for users to efficiently operate and manage management tasks within the factory.

[1607] "User authentication information" refers to the user's identification information and password required to access the system.

[1608] A "server" is a central computer system that processes information sent by users and handles authentication, data storage, and data retrieval.

[1609] "Profile information" refers to data used to determine a user's operational rights within the system, such as their personal information, job title, and permissions.

[1610] The "main menu" is a screen that displays a list of functions available to the user after logging in, allowing them to select from them.

[1611] A "function" refers to a specific operation or process that can be performed within a system, and includes administrative tasks such as employee information management and leave approval.

[1612] A "factory" is a facility where production lines, machines, and robots are installed and manufacturing operations are carried out.

[1613] A "robot interface" refers to input / output means such as touch panels and voice recognition devices installed on robots in factories.

[1614] "Employee information management" refers to a function that manages, edits, adds, and deletes employees' personal information, work status, job title, etc.

[1615] "Leave approval" is the process of approving or rejecting leave requests submitted by employees and notifying them of the result.

[1616] "Management duties" refer to various tasks necessary for the operation of the organization, such as managing personnel and labor within the factory, and maintaining and inspecting equipment.

[1617] This invention is a system for streamlining management operations within a factory, and is particularly aimed at automating employee information management and leave approval processes. The system consists of user authentication, main menu display, function selection, and execution phases. The system operates in conjunction with multiple robots within the factory and utilizes the following hardware and software.

[1618] Hardware and software

[1619] Hardware:

[1620] Factory robots: with touch panel or voice recognition capabilities.

[1621] Server: Processes and stores data.

[1622] software:

[1623] Python scripts: Programs for user authentication, data retrieval, and manipulation.

[1624] Request Module: A library for performing API communication.

[1625] Database: Stores user profile information and administrative data (e.g., MySQL, MongoDB).

[1626] Processing flow

[1627] 1. User Authentication Phase:

[1628] The factory manager logs in using the robot's touch panel or voice recognition interface. The login data is transmitted wirelessly to the server. The server queries its database for the received authentication information to verify its validity. If authentication is successful, the server retrieves the user's profile information and displays the main menu on the robot's interface.

[1629] 2. Displaying and selecting from the main menu:

[1630] Upon successful login, the main menu appears on the robot's interface. The user selects functions such as personnel management or leave approval. Based on the selected function, the server retrieves the necessary data from the database and sends it to the robot's interface.

[1631] 3. Execution of business functions:

[1632] Based on the selected function, the robot displays the necessary data, and the user performs the action. For example, if the user selects employee information management, the server retrieves information on all employees from the database and sends it to the robot. The user can then view, edit, add, or delete specific employee information. The results of these actions are reflected in the database via the server.

[1633] Specific example

[1634] Example 1: Editing employee information

[1635] When the administrator speaks "Login" to the factory robot's interface, the robot prompts "Please enter your User ID." The administrator enters "12345" and then enters their password. Upon successful login, the robot displays "Please select a main menu" and presents the options of "Employee Information Management" or "Leave Approval." The administrator selects "Employee Information Management," chooses a specific employee, and presses the "Edit" button. After updating the necessary information, pressing the "Save" button updates the information in the database.

[1636] Example 2: Approval of leave request

[1637] When a user submits a leave request using the factory robot interface, they select the "Leave Request" menu, enter the required information, and press the submit button. The leave request is sent to the server, and a notification is sent to the supervisor. The supervisor reviews the request on their terminal and chooses to approve or reject it. Once the selection is complete, the result is notified to the applicant.

[1638] Example of a prompt

[1639] To the robot assistant: "Login"

[1640] Robot: "Please enter your User ID."

[1641] Administrator: "12345"

[1642] Robot: "Please enter your password."

[1643] Administrator: [Enter password]

[1644] Robot: "Login successful. Please select a main menu item: 1. Employee Information Management, 2. Leave Approval."

[1645] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1646] Step 1:

[1647] The user either says "Login" to the factory robot's interface or a login screen is displayed on the touch panel. The system requests a user ID and password as input and sends this data to the server. The server queries a database for the user ID and password and performs authentication. The output is either a success or failure authentication result; if authentication is successful, the server retrieves the user's profile information and returns it to the terminal.

[1648] Step 2:

[1649] The terminal displays the user's profile information along with a message confirming successful authentication. It generates a main menu, presenting the user with options such as "Employee Information Management" or "Leave Approval." There is no input required, but the user's selection becomes the input for the next step. The output is the display of the main menu.

[1650] Step 3:

[1651] The user selects the function they want to manage from the main menu (e.g., employee information management). The input is the user's selection, and the terminal sends this selection to the server. Based on the selected function, the server retrieves the necessary data from the database and sends it to the terminal. The output is the retrieval and display of the corresponding data.

[1652] Step 4:

[1653] The terminal displays data received from the server and allows the user to interact with it. For example, in employee information management, it displays a list of all employees. The user can then edit, add, or delete specific employee information. Input is the user's actions, and output is a confirmation screen of those actions.

[1654] Step 5:

[1655] After a user completes an edit, add, or delete operation, the terminal sends the result of the operation to the server. The input is the operation result, and the server reflects this information in the database. The output is the database update result and a completion message for the user.

[1656] Step 6:

[1657] When a user submits a leave request, they enter the necessary application information (e.g., reason for leave, duration, etc.) on the leave request screen. The input is the user's application information, and the terminal sends this information to the server. The server saves the application information to a database and sends a notification to the approver. The output is the saved application information and the notification to the approver.

[1658] Step 7:

[1659] Upon receiving a notification from the server, the approver reviews the details of the leave request and decides to approve or reject it. Input is the approver's action, and the result is sent to the server. The server saves the result to a database and notifies the applicant. Output is the notification result sent to both the applicant and the approver.

[1660] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1661] This invention combines a system designed to streamline administrative tasks and reduce the burden on staff with an emotion engine that recognizes user emotions and provides a more appropriate interface. This system has the functionality to provide appropriate feedback and suggestions based on the user's emotional state, from user authentication to main menu selection and processing of various tasks.

[1662] User authentication phase

[1663] The user opens the login screen on their device and enters their user ID and password. The device sends this authentication information to the server. The server queries the received authentication information against its database to verify its accuracy. If authentication is successful, the server returns the user's profile information and data for displaying the main menu to the device. Simultaneously, the emotion engine analyzes the user's emotions based on their input and actions and sends the analysis results to the server.

[1664] Displaying and selecting from the main menu

[1665] The server generates a customized main menu based on the user's profile information and sentiment analysis results, and sends it to the terminal. The terminal displays the received main menu on its screen. The user selects the desired function from the main menu (e.g., employee information management, leave approval). Based on the selected function, the server retrieves the necessary data from the database and provides an interface tailored to the user's emotional state.

[1666] Employee information management

[1667] For example, if a user selects the "Employee Information Management" function, the server retrieves information on all employees from the database and sends it to the terminal. The terminal displays a list of employee information, and the user can view, edit, add, or delete information on specific employees. The emotion engine analyzes the user's emotions during these operations and modifies the interface accordingly. This supports the user in working without stress.

[1668] Vacation Approval Process

[1669] When a user (employee) submits a leave request, they enter the necessary information on their terminal and press the submit button. The terminal sends the request information to the server. The server stores the request information in a database, sends a notification to the approver, and analyzes the applicant's emotional state using an emotion engine to provide appropriate feedback. The supervisor receives the leave request notification on their terminal, reviews the details, and then approves or rejects the request. The result of this action is again stored in the database, and the applicant is notified of the result. At this time, the emotion engine analyzes the emotional states of both the supervisor and the applicant, and provides an interface that is designed to minimize stress for both parties.

[1670] Specific example

[1671] One day, an HR representative logs into the system. As they enter their login information, the emotion engine analyzes their typing speed and the frequency of errors to determine if they are emotionally unstable. After successful authentication, the server displays a main menu tailored to the user's state, displaying a gentle message such as, "What can we help you with today?" When the HR representative selects "Employee Information Management," the emotion engine, having detected stress, switches to an intuitive and easy-to-use interface.

[1672] Similarly, when another employee submits a leave request, the emotion engine analyzes their urgency and presents a concise input form. When a supervisor approves the request, the emotion engine analyzes the supervisor's emotional state and provides appropriate feedback.

[1673] In this way, the present invention improves the usability of the system by analyzing the user's emotional state, thereby achieving increased operational efficiency and reduced workload for the person in charge.

[1674] The following describes the processing flow.

[1675] User authentication phase

[1676] Step 1:

[1677] The user opens the login screen on their device and enters their user ID and password.

[1678] Step 2:

[1679] The terminal sends the entered authentication information to the server.

[1680] Step 3:

[1681] The server queries the database for the received authentication information to verify its accuracy.

[1682] Step 4:

[1683] If authentication is successful, the server retrieves the user's profile information and sends the input data from the login process to the emotion engine.

[1684] Step 5:

[1685] The emotion engine analyzes the user's emotions and sends the results to the server.

[1686] Step 6:

[1687] The server sends the user's profile information and sentiment analysis results to the terminal.

[1688] Step 7:

[1689] The device displays the main menu screen.

[1690] Displaying and selecting from the main menu

[1691] Step 1:

[1692] The server generates main menu options based on the user's profile information and sentiment analysis results.

[1693] Step 2:

[1694] The server sends the main menu options to the terminal.

[1695] Step 3:

[1696] The device displays the received main menu on its screen.

[1697] Step 4:

[1698] The user selects the desired function from the main menu.

[1699] Step 5:

[1700] The terminal sends the user's selection to the server.

[1701] Step 6:

[1702] The server retrieves the necessary data from the database based on the selected function.

[1703] Step 7:

[1704] The emotion engine suggests an appropriate interface based on the user's emotions and sends the result to the server.

[1705] Step 8:

[1706] The server sends the acquired data along with suggestions from the emotion engine to the terminal.

[1707] Step 9:

[1708] The device displays a screen corresponding to the selected function and adjusts the user interface accordingly.

[1709] Employee information management

[1710] Step 1:

[1711] The user selects the employee information management function.

[1712] Step 2:

[1713] The server retrieves information on all employees from the database.

[1714] Step 3:

[1715] The server sends the acquired employee information to the terminal.

[1716] Step 4:

[1717] The terminal displays a list of employee information on its screen.

[1718] Step 5:

[1719] Users can select specific employee information and perform actions such as viewing, editing, adding, or deleting it.

[1720] Step 6:

[1721] The terminal sends user actions to the server.

[1722] Step 7:

[1723] The server performs CRUD operations on the database based on the operation performed.

[1724] Step 8:

[1725] The emotion engine analyzes the user's emotions during operation and sends the results to the server.

[1726] Step 9:

[1727] The server sends the operation results to the terminal.

[1728] Step 10:

[1729] The device updates the screen based on the operation results and adjusts the interface to reflect the results of the emotion engine.

[1730] Vacation Approval Process

[1731] Step 1:

[1732] The user (employee) opens the leave request screen and enters the necessary information.

[1733] Step 2:

[1734] The terminal sends the entered application information to the server.

[1735] Step 3:

[1736] The server stores the application information in a database.

[1737] Step 4:

[1738] The emotion engine analyzes the user's emotions based on input content and input speed, and sends the results to the server.

[1739] Step 5:

[1740] The server sends a notification of the leave request to the approver (supervisor) and also notifies them of the applicant's emotional state.

[1741] Step 6:

[1742] The server sends the notification content to the approver's device.

[1743] Step 7:

[1744] The user (supervisor) checks the leave request notification on their terminal.

[1745] Step 8:

[1746] The user (supervisor) reviews the details of the leave request and chooses to approve or reject it.

[1747] Step 9:

[1748] The terminal sends the supervisor's selection to the server.

[1749] Step 10:

[1750] The server saves the selection results to the database.

[1751] Step 11:

[1752] The emotion engine analyzes the boss's emotions and sends the results to the server.

[1753] Step 12:

[1754] The server notifies the applicant of the result and provides feedback that reflects the results of the emotion engine.

[1755] Step 13:

[1756] The device displays the results to the applicant and provides feedback from the emotion engine.

[1757] In this way, the operations of the administrative department are streamlined, and a flexible interface that responds to the user's emotional state is provided, resulting in improved accuracy and reduced workload for the person in charge.

[1758] (Example 2)

[1759] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1760] Current business management systems often cause user stress because they provide a uniform interface without considering the user's emotional state. Furthermore, improvements in work efficiency and reduction of the burden on employees are not sufficiently achieved. This is particularly due to the provision of inappropriate feedback during operations that users find stressful or critical. Therefore, there is a need for a system that appropriately analyzes the user's emotional state and provides an interface and feedback accordingly.

[1761] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1762] In this invention, the server includes means for inputting user authentication information, means for transmitting the authentication information to the server and for the server to perform authentication, means for acquiring user profile information and displaying a customized main menu based on the sentiment analysis results if authentication is successful, and means for acquiring necessary data based on the function selected from the main menu and providing an appropriate interface according to the sentiment analysis results. This enables the provision of an interface and feedback that responds to the user's emotional state, thereby improving work efficiency and reducing the burden on the person in charge.

[1763] "User authentication information" refers to the information that a user enters to access the system, and typically consists of a user ID and password.

[1764] A "server" is a computer system that sends and receives data over a network and provides authentication, manages profile information, and offers interfaces based on the results of sentiment analysis.

[1765] "Profile information" refers to data that includes personal information and settings information about the user, and is used to provide information based on the user's usage history and preferences.

[1766] "Emotional analysis results" refer to the estimated emotional state of a user, based on data such as the user's operation speed and error frequency.

[1767] A "customized main menu" refers to a main menu that has been individually adjusted based on the user's profile information and sentiment analysis results.

[1768] "Required data" refers to various pieces of information retrieved from the server in order to execute the function selected by the user, and this information is stored in a database.

[1769] "Interface" refers to the screens and means of operation that users use to interact with a system, and these are appropriately modified according to the user's emotional state.

[1770] "A user selecting an employee information management function" refers to the act of a user selecting a function from the main menu to display, edit, add, or delete employee information.

[1771] "Leave request information" refers to detailed information necessary for a user to take leave, which is sent to the server and later processed by an approver.

[1772] A "database" is a system for systematically storing and managing large amounts of data, and for searching and retrieving data as needed.

[1773] An "approver" is a person who has the authority to receive leave requests from users and approve or reject them.

[1774] This invention combines a system designed to streamline administrative tasks and reduce the burden on staff with an emotion engine that recognizes user emotions and provides a more appropriate interface. From user authentication to main menu selection and processing of various tasks, the system provides appropriate feedback and suggestions based on the user's emotional state.

[1775] User authentication phase

[1776] The user opens the login screen on their device and enters their user ID and password. The device sends this authentication information to the server. The server queries the received authentication information against its database to verify its accuracy. If authentication is successful, the server sends the user's profile information and data for displaying the main menu back to the device. Simultaneously, the emotion engine analyzes the user's emotions based on their input speed and actions, and sends the results to the server.

[1777] Displaying and selecting from the main menu

[1778] The server generates a customized main menu for each user based on the user's profile information and sentiment analysis results, and sends it to the terminal. The terminal displays the received customized main menu on its screen. The user selects the desired function from the main menu (e.g., employee information management, leave approval). Based on the selected function, the server retrieves the necessary data from the database and provides an interface that is appropriate to the user's emotional state.

[1779] Employee information management

[1780] For example, if a user selects the "Employee Information Management" function, the server retrieves information on all employees from the database and sends it to the terminal. The terminal displays a list of the retrieved employee information on the screen. The user can view and edit specific employee information, and add or delete new employees. The emotion engine analyzes the user's emotions during these operations and modifies the interface to make the operation intuitive and easy. This supports the user in working without stress.

[1781] Vacation Approval Process

[1782] When a user (employee) submits a leave request, they enter the necessary information on their terminal and press the submit button. The terminal sends the request information to the server. The server stores the request information in a database and sends a notification to the approver. At the same time, the emotion engine analyzes the applicant's emotional state and provides appropriate feedback. The supervisor receives the leave request notification on their terminal, reviews the details, and then approves or rejects the request. The result of this action is again stored in the database, and the applicant is notified of the result. In this process, the emotion engine analyzes the emotional states of both the supervisor and the applicant, providing an interface that is designed to minimize stress for both parties.

[1783] Specific example

[1784] One day, an HR representative logs into the system. As they enter their login information, the emotion engine analyzes their typing speed and error frequency, and detects if they are feeling emotionally unstable. After successful authentication, the server displays a main menu tailored to the representative's state, displaying a gentle message such as, "What can we help you with today?" When the user selects "Employee Information Management," the emotion engine detects that the representative is stressed and automatically switches to a user-friendly, intuitive interface. This improves the representative's work efficiency. Similarly, when another employee submits a leave request, the emotion engine analyzes if the employee is in a hurry and provides a quick and concise input form. After the request is submitted, when the supervisor approves it, the emotion engine analyzes the supervisor's emotions and provides appropriate feedback.

[1785] Example of a prompt

[1786] Please describe how a system works by analyzing a user's emotions when they log into the system and customizing how the main menu is displayed.

[1787] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1788] Step 1:

[1789] The user opens the login screen on their device and enters their user ID and password. This entered information becomes the input data. The device sends this authentication information to the server. The entered information is sent to the server as user authentication information.

[1790] Step 2:

[1791] The server queries the database for the received authentication information to verify its accuracy. This database query outputs the authentication result (authentication successful or failed). If authentication is successful, the server retrieves the user's profile information from the database.

[1792] Step 3:

[1793] Based on the acquired profile information, the server sends data such as the user's input speed and error frequency to the emotion engine. The emotion engine analyzes this data and outputs the user's emotional state. The emotional state is classified as "stable," "unstable," etc.

[1794] Step 4:

[1795] The server generates a customized main menu tailored to each individual user based on the user's profile information and sentiment analysis results. This main menu is output as generated data and sent to the terminal.

[1796] Step 5:

[1797] The terminal displays the customized main menu it received on the screen. From here, the user selects the desired function (e.g., employee information management, leave approval). The selected menu is sent to the server as input data.

[1798] Step 6:

[1799] The server retrieves the necessary data from the database based on the function selected by the user. This data retrieval process outputs the relevant data, and simultaneously generates an interface that corresponds to the user's emotional state.

[1800] Step 7:

[1801] For example, if a user selects the "Employee Information Management" function, the server retrieves information on all employees from the database and sends it to the terminal. This displays a list of employee information on the terminal, allowing the user to view, edit, add, or delete information on specific employees. The results of these operations are sent to the emotion engine, which re-analyzes the user's emotional state.

[1802] Step 8:

[1803] When a user (employee) submits a leave request, they enter the necessary application information on a terminal and press the submit button. The terminal sends the application information to the server. The server stores the application information in a database, sends a notification to the approver, and analyzes the applicant's emotional state using an emotion engine to provide appropriate feedback.

[1804] Step 9:

[1805] The supervisor receives a notification of the leave request on their device, reviews the details, and then approves or rejects it. This result is saved back to the database, and the applicant is notified of the outcome. Simultaneously, the emotion engine analyzes the emotional states of both the supervisor and the applicant, providing an interface designed to minimize stress for both parties.

[1806] (Application Example 2)

[1807] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1808] The problem that this invention aims to solve is to improve the efficiency of management tasks and reduce the burden on personnel. Current systems completely disregard the emotional state of users, and their uniform usability makes it difficult for users to cope with stress or sudden changes in circumstances. In particular, in tasks requiring a high level of tension, such as those performed by security personnel, there is a need for user interfaces that adapt to the emotional state of individual personnel to improve work efficiency and enable appropriate responses.

[1809] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1810] In this invention, the server includes means for inputting user authentication information, means for transmitting the authentication information to the server and for the server to perform authentication, means for obtaining user profile information and displaying a main menu if authentication is successful, means for obtaining necessary data based on the function selected from the main menu and executing the function, means for analyzing the user's emotional state using an emotion analysis engine, and means for adaptively changing the user interface based on the analysis results. This makes it possible to provide an interface that takes the user's emotional state into consideration, thereby improving the efficiency of management operations and reducing the burden on staff.

[1811] "User authentication information" refers to information used to identify and authenticate a user, such as the user's ID and password.

[1812] A "server" is a computer system that performs user authentication, data processing, and the primary functions of a system.

[1813] "Profile information" refers to individual information about a user, including, for example, name, job title, and past operation history.

[1814] The "main menu" is an interface that appears after a user logs into the system, allowing them to select from multiple functions.

[1815] An "emotion analysis engine" is software or algorithms used to analyze a user's emotions based on factors such as facial recognition and user behavior.

[1816] A "database" is a system that centrally manages and stores user profile information and information related to business processes.

[1817] "User interface" refers to the screen display and operating methods that enable interaction between the user and the system.

[1818] The "Employee Information Management Function" is a feature that allows users to view, edit, add, and delete employee information.

[1819] A "leave request" is the process by which a user enters and submits the necessary information to take leave for a certain period of time.

[1820] An "approver" is the person responsible for making the final decision to approve or reject leave requests and other work processes.

[1821] "Analysis results" refer to data about the user's emotional state obtained by the emotion analysis engine.

[1822] "Means of adaptive modification" refer to methods and functions for dynamically optimizing and changing the user interface in response to the user's emotional state.

[1823] The system for implementing the present invention performs user authentication, acquisition of profile information, display of the main menu, analysis of emotional state by an emotion analysis engine, and adaptive modification of the user interface based on the analysis. The specific configuration and operation are shown below.

[1824] 1. User Authentication

[1825] The terminal prompts the user to enter authentication information through a login screen. The user enters their ID and password, and this information is sent to the server. The server queries its database to perform authentication. If authentication is successful, the server sends the user's profile information to the terminal.

[1826] 2. Introduction of an emotion analysis engine

[1827] During the authentication process, the device uses its camera and input data to acquire the user's facial image and operation status, and sends this information to the emotion analysis engine. The emotion analysis engine uses libraries such as DeepFace to perform image analysis and recognize emotional states.

[1828] 3. Displaying the main menu

[1829] The server generates a customized main menu based on the user's profile information and the results of the emotion analysis engine. This menu changes according to the user's emotional state and is designed to reduce stress and anxiety. For example, a concise menu is displayed when the user is in a hurry, while a more detailed menu is displayed when they are relaxed.

[1830] 4. Function Selection and Emotional Response

[1831] When a user selects a desired function from the main menu, the server retrieves the corresponding data from the database and provides an interface tailored to the user's emotional state. This allows users to perform their tasks using an intuitive and easy-to-use interface.

[1832] Explanation of specific examples

[1833] Example 1: User Authentication

[1834] One day, a user attempts to log in to the system. As they enter their login information, the camera built into the device captures an image of the user, and an emotion analysis engine analyzes their emotional state. For example, the analysis might reveal that the user is focused but slightly tense. Based on this, the server displays a message saying "Please calm down" along with a concise main menu.

[1835] Example 2: Employee Information Management

[1836] Next, when the user selects the "Employee Information Management" function from the main menu, the server retrieves the necessary employee information from the database. The emotion analysis engine also monitors the user's emotions in real time while they are operating the system. For example, if the user is feeling stressed, intuitive and easy-to-follow instructions are presented.

[1837] Example 3: Leave application

[1838] When a user submits a leave request, they enter the required information and press the submit button. The sentiment analysis engine detects if the user is in a hurry and simplifies the input form. Simultaneously, the server saves the relevant information to the database and notifies the approver. The approver's emotional state is also analyzed by the sentiment analysis engine, and appropriate feedback is provided.

[1839] Example of a prompt

[1840] Please analyze the emotions in the following image:

[1841] [Image URL]

[1842] The user is currently logged in. Based on the analyzed sentiment, please suggest the next message and layout to display. If the user's sentiment is "angry," display a warning; if it is "happy," display detailed information.

[1843] Thus, the present invention analyzes the user's emotional state in real time and adapts the interface based on that analysis, thereby improving the efficiency of management tasks and reducing the burden on the person in charge.

[1844] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1845] Step 1:

[1846] The user opens the login screen and enters their ID and password.

[1847] Enter: ID and password

[1848] Output: Authentication information sent to the server

[1849] Operation: The terminal sends the ID and password received from the user to the server.

[1850] Step 2:

[1851] The server queries the database for the authentication information it receives and performs the authentication.

[1852] Input: Authentication information (ID and password)

[1853] Output: Authentication results and profile information

[1854] Operation: The server queries the database for the relevant user's information, and if authentication is successful, retrieves the profile information.

[1855] Step 3:

[1856] The device captures an image of the user's face and sends it to the emotion analysis engine.

[1857] Input: User's face image

[1858] Output: Analysis results of emotional state

[1859] Operation: The device uses its camera to acquire an image of the user's face and sends it to the emotion analysis engine.

[1860] Step 4:

[1861] The emotion analysis engine analyzes the user's emotional state and sends it to the server.

[1862] Input: User's face image

[1863] Output: Analysis results of emotional state

[1864] Operation: The emotion analysis engine uses libraries such as DeepFace to analyze the user's emotional state. The analysis results are sent to the server.

[1865] Step 5:

[1866] The server generates a main menu based on the profile information and the results of the emotional state analysis, and sends it to the terminal.

[1867] Input: Profile information and analysis results of emotional state

[1868] Output: Customized main menu

[1869] Operation: The server generates an adaptively changing main menu based on profile information and emotional state, and sends it to the terminal.

[1870] Step 6:

[1871] The device displays a customized main menu, allowing the user to select the desired function.

[1872] Input: Customized main menu

[1873] Output: Identifier of the selected feature

[1874] Operation: The user selects the desired function from the main menu, and the selection is recognized by the device.

[1875] Step 7:

[1876] The server retrieves the necessary data from the database based on the selected function.

[1877] Input: Identifier of the selected function

[1878] Output: Required data

[1879] Operation: The server retrieves data from the database according to the selected function and sends it to the terminal.

[1880] Step 8:

[1881] The device displays the data it has acquired and adaptively changes the interface according to the user's emotional state.

[1882] Input: Acquired data and emotional state

[1883] Output: Optimized user interface

[1884] Operation: The device displays the acquired data and, based on the analysis results of the emotion engine, modifies the interface to best suit the user.

[1885] Step 9:

[1886] Users perform specific tasks (for example, viewing, editing, adding, and deleting employee information).

[1887] Input: User actions and data

[1888] Output: Processing results of the task

[1889] Operation: Appropriate processing is performed according to the user's actions, and the results are reflected in the database.

[1890] Step 10:

[1891] The user submits a leave request, enters the necessary information, and sends it to the server.

[1892] Input: Leave request information

[1893] Output: Notification of successful application

[1894] Operation: The user fills in the required information on the leave request form, and the terminal sends it to the server.

[1895] Step 11:

[1896] The server saves the application information to the database and notifies the approver.

[1897] Input: Leave request information

[1898] Output: Notification to approver

[1899] Operation: The server saves the leave request information to the database and sends a notification to the approver.

[1900] Step 12:

[1901] The approver reviews the application and decides whether to approve or reject it.

[1902] Input: Leave request details

[1903] Output: Approval or rejection result

[1904] Operation: The approver reviews the application details on their terminal and selects to approve or reject it. The result of this action is saved in the database and notified to the applicant.

[1905] After completing the above steps, the system will be operational, analyzing the user's emotional state in real time and adaptively changing the interface to improve work efficiency and reduce the burden on the person in charge.

[1906] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1907] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1908] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[1909] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1910] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[1911] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[1912] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[1913] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[1914] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[1915] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[1916] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[1917] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[1918] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[1919] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1920] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[1921] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[1922] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[1923] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[1924] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[1925] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[1926] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference.

[1927] The following is further disclosed regarding the embodiments described above.

[1928] (Claim 1)

[1929] A means of entering user authentication info...

Claims

1. A means of entering user authentication information, A means for sending the authentication information to a server and for the server to perform authentication, A means to obtain user profile information and display the main menu upon successful authentication, A means for obtaining the necessary data based on the function selected from the main menu and executing the function, A system that includes this.

2. The system according to claim 1, which includes means for displaying, editing, adding, or deleting employee information when a user selects the employee information management function.

3. A means for users to enter information for submitting a leave request and send it to the server, A means of storing the application information in a database and notifying the approver, The system according to claim 1, comprising means for an approver to approve or reject the application.

Images