system

Abstract

Provide a system. A means for receiving authentication information entered by a user and performing authentication; A means for providing a screen for selecting administrative procedures to a user who has been successfully authenticated; means for retrieving from the database and providing to the user the information required for the selected administrative procedure; A means for receiving and validating the procedure entered by the user; A means of registering the successfully validated procedure details in the database and notifying the completion of the procedure; A system including:

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In modern society, administrative procedures are diverse and often require complex procedures and necessary documents. This can result in users spending a lot of time and effort when completing procedures, leading to the risk of incorrect procedures or incomplete documents. Furthermore, in many cases, users must visit a counter, which is a significant burden, especially for busy users. To solve these issues, there is a demand for systems that allow users to complete administrative procedures efficiently and that also include input support and validation functions. [Means for solving the problem]

[0005] The present invention aims to solve the above problem by providing a system that includes a means for receiving authentication information entered by a user and performing authentication, a means for providing a screen for selecting an administrative procedure to a user who has been successfully authenticated, a means for retrieving information necessary for the selected administrative procedure from a database and providing it to the user, a means for receiving the procedure details entered by the user and performing validation, and a means for registering the procedure details that have been successfully validated in a database and notifying the user that the procedure has been completed.

[0006] Specifically, after authenticating the user, the system allows them to select an administrative procedure and provide the necessary information, allowing them to complete the procedure smoothly.In addition, by providing input assistance and real-time validation functions, it prevents incorrect input and incomplete documents, and by sending a confirmation notification when the procedure is completed, it gives users peace of mind.This reduces the burden on users and realizes a system that can streamline administrative procedures.

[0007] "Authentication information" refers to information such as ID and password required for a user to access a system.

[0008] "Authentication" is the process of verifying a user's legitimacy based on the authentication information entered.

[0009] "Administrative procedures" refers to various procedures that users carry out with public institutions, such as obtaining a resident registration card or submitting a moving-out notification.

[0010] A "database" is an information system for storing and managing necessary information related to various administrative procedures.

[0011] "Validation" is the process of checking whether the information entered by the user is of the correct format and content.

[0012] A "Procedure Completion Notification" is a message that informs the user that the administrative procedure they have performed has been successfully completed.

[0013] An "input assistance function" is a system function that guides users to input information accurately.

[0014] "Real-time validation" is the process of checking the accuracy of information entered by a user immediately as it is entered. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram illustrating a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0016] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0019] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0020] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0021] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0023] [First embodiment]

[0024] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0025] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0028] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0031] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0035] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0036] The present invention is a system that supports users in efficiently performing administrative procedures. This system includes means for receiving authentication information entered by a user and performing authentication, means for providing a screen for selecting an administrative procedure to a user who has been successfully authenticated, means for retrieving information necessary for the selected administrative procedure from a database and providing the information to the user, means for receiving and validating the procedure details entered by the user, and means for registering the successfully validated procedure details in the database and notifying the user of the completion of the procedure.

[0037] Overview of program processing flow

[0038] User authentication

[0039] 1. The terminal displays the user authentication screen.

[0040] The user enters their login ID and password.

[0041] 2. The device sends the authentication information entered by the user to the server.

[0042] The server checks the authentication information against a database to verify its validity.

[0043] 3. The server returns the authentication result to the terminal.

[0044] If the authentication is successful, proceed to the next step.

[0045] Choosing administrative procedures

[0046] 4. The terminal displays the administrative procedure category selection screen.

[0047] The user selects the procedure they wish to follow.

[0048] Example: Select "Notification of Moving Due to Moving."

[0049] 5. The device sends the selection information to the server.

[0050] The server retrieves detailed information about the selected procedure from a database.

[0051] 6. The server sends the procedure information back to the terminal.

[0052] Examples: a list of documents required for the moving-out notification, the location of the office, opening hours, etc.

[0053] Procedural input assistance

[0054] 7. The device will display the input form.

[0055] Provide users with fields to enter necessary information (e.g. new address, name, date of birth, etc.).

[0056] 8. The user enters the information.

[0057] The input is checked in real time to ensure there are no errors or omissions.

[0058] For example, when you enter your "new address," it will immediately check that it is in the correct format.

[0059] Input validation and procedure completion notification

[0060] 9. After the device has completed all the input fields, it will display a submit button.

[0061] The user confirms and presses send.

[0062] 10. The terminal sends the entered information to the server.

[0063] The server will reconfirm the information and register it in the database.

[0064] 11. The server sends a notification of completion of the procedure to the terminal and a confirmation email to the user.

[0065] The terminal will display a message to the user saying "The procedure is complete," and the entire process will be completed.

[0066] Specific examples

[0067] 1. Authentication Process

[0068] The device displays the authentication screen and the user enters "user123" and "password123".

[0069] The server receives the authentication information and returns a successful authentication after checking the database.

[0070] 2. Choice of administrative procedures

[0071] The device displays the category selection screen, and the user selects "Notification of Moving Out."

[0072] The server obtains detailed information about the moving-out notification and sends it to the terminal.

[0073] 3. Input assistance

[0074] The device displays an input form, and the user enters their new address as "No. XX, XX-chome, Minato-ku, Tokyo."

[0075] A format check is performed in real time, and if the format is correct, proceed to the next step.

[0076] 4. Complete the procedure

[0077] The user presses send and the device sends the data to the server.

[0078] The server registers the data, sends a notification of completion of the procedure to the terminal, and sends a confirmation email to the user.

[0079] This system allows users to complete administrative procedures efficiently and reliably, supporting them at each step of the process and significantly reducing the burden of the process.

[0080] The processing flow will be explained below.

[0081] Step 1:

[0082] The terminal displays the user authentication screen, and the user enters their login ID and password.

[0083] Step 2:

[0084] The user enters their ID and password. For example, they enter "user123" and "password123."

[0085] Step 3:

[0086] The terminal sends the entered authentication information to the server, which then checks the received authentication information against its database.

[0087] Step 4:

[0088] The server returns the authentication result to the terminal. If the authentication is successful, proceed to the next step. If the authentication is unsuccessful, return an error message.

[0089] Step 5:

[0090] The device displays a screen for the user to select a category for administrative procedures. For example, it displays a list of categories such as "Acquisition of Resident Registration," "Notification of Moving Out," and "Certificate Issuance."

[0091] Step 6:

[0092] The user selects the procedure they wish to perform. For example, they select "Notification of Moving Out."

[0093] Step 7:

[0094] The terminal sends the selection information to the server, which retrieves detailed information about the selected procedure from a database.

[0095] Step 8:

[0096] The server sends back the procedure information to the terminal, such as a list of documents required for the moving-out notification, the location of the counter, and reception hours.

[0097] Step 9:

[0098] The device displays the necessary information to the user and allows the user to access input forms.

[0099] Step 10:

[0100] The user enters the required information, such as new address, name, date of birth, etc.

[0101] Step 11:

[0102] The terminal validates input in real time, checking address format and required fields, and providing feedback to the user if there are any errors.

[0103] Step 12:

[0104] After the user has completed all the input fields, they check the information and click the submit button.

[0105] Step 13:

[0106] The terminal sends the input information to the server, which then reconfirms the received information and registers it in the database.

[0107] Step 14:

[0108] The server sends a notification to the terminal that the procedure has been completed. The notification includes detailed information about the procedure.

[0109] Step 15:

[0110] The device displays a transaction completion screen, informing the user that the transaction was successfully completed.

[0111] Step 16:

[0112] The server will send a confirmation email to the user, containing details of the procedure and next steps to take.

[0113] Example 1

[0114] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0115] In current administrative procedures, users often experience delays due to cumbersome procedures and incomplete documentation. Furthermore, because information is not checked or validated in real time, users may enter incorrect information and be required to resubmit the procedure. This not only wastes users' time and effort, but also reduces administrative processing efficiency. There is a need for improved system usability and user experience, especially for online procedures.

[0116] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0117] In this invention, the server includes means for receiving authentication information entered by a user and verifying it against a database for authentication; means for displaying a category selection screen and providing a screen for selecting an administrative procedure to a user who has been successfully authenticated; means for retrieving information necessary for the selected administrative procedure from the database and providing it to the user; means for receiving the procedure details entered by the user, performing a format check and validation in real time; and means for registering successfully validated procedure details in the database and notifying the user that the procedure has been completed. This enables users to perform administrative procedures online accurately and efficiently. Furthermore, real-time input checks and validations allow input errors to be detected early and prevent resubmission, thereby speeding up the procedure.

[0118] "User authentication" is the process in which a system receives authentication information, such as an ID and password, entered by a user and checks its validity against a database.

[0119] The "category selection screen" is an interface for selecting administrative procedures that is displayed to users who have been successfully authenticated.

[0120] "Database" means a digital storage system that stores user authentication information and information required for selected administrative procedures.

[0121] "User input" refers to the act of a user entering information required for a procedure through an interface such as a form.

[0122] "Real-time format checking" is the process of instantly verifying that the information entered by the user is in the correct format and displaying a warning if there are any errors.

[0123] "Validation" is the process of ensuring that user-entered data is accurate and contains all required information.

[0124] A "procedure completion notification" is a message that notifies the user that the procedure has been completed after the procedure details that have been successfully validated have been registered in the database.

[0125] A "confirmation email" is a notification sent to the user via email that the process has been completed.

[0126] The present invention is a system that helps users efficiently complete administrative procedures online. This system has multiple functions for user authentication, administrative procedure selection, procedure content input support, validation, and procedure completion notification.

[0127] This system is mainly composed of a server, a terminal, and a database. Below are the specific names of each piece of hardware and software, as well as details of each process.

[0128] User authentication

[0129] First, the terminal displays a user authentication screen. The user enters their login ID and password here, and the terminal sends the entered authentication information to the server. The server receives this information and performs authentication by checking it against a database such as OpenLDAP or MySQL (registered trademark). If authentication is successful, the server returns the authentication results to the terminal, which then proceeds to the next step.

[0130] Choosing administrative procedures

[0131] For users who have been successfully authenticated, the terminal displays a screen for selecting administrative procedures. When the user selects the appropriate procedure, the selection information is sent from the terminal to the server. The server retrieves the information necessary for the selected administrative procedure from a database such as PostgreSQL and sends it back to the terminal. For example, if a notification of moving out is selected, detailed information such as a list of required documents, the location of the counter, and reception hours is provided.

[0132] Procedural input assistance

[0133] Next, the terminal displays an input form and the user enters the necessary information (e.g., new address, name, date of birth, etc.). At this time, the terminal checks the format of the input in real time. For example, when "new address" is entered, the format is immediately confirmed and a warning is displayed if it is incorrect.

[0134] Validation and procedure completion notification

[0135] When the user completes all the input fields and presses the send button, the terminal sends the entered information to the server. The server then checks this information again and validates that the format and content are correct. If validation is successful, the information is registered in the database. Finally, the server notifies the terminal that the procedure is complete and sends a confirmation email to the user. The terminal displays a message saying "The procedure has been completed," and the entire procedure is complete.

[0136] Specific examples

[0137] 1. Authentication Process:

[0138] The device displays the authentication screen and the user enters "user123" and "password123."

[0139] The server receives the authentication information, checks it against a database, and returns a successful authentication.

[0140] 2. Choice of administrative procedure:

[0141] The device displays a category selection screen, and the user selects "Notification of Moving Out."

[0142] The server obtains detailed information about the moving-out notification and sends it to the terminal.

[0143] 3. Input assistance:

[0144] The device displays an input form, and the user enters the new address as "No. XX, XX-chome, Minato-ku, Tokyo."

[0145] A format check is performed in real time, and if the format is correct, proceed to the next step.

[0146] 4. Complete the process:

[0147] The user presses send and the device sends the data to the server.

[0148] The server registers the data, sends a notification of completion of the procedure to the terminal, and sends a confirmation email to the user.

[0149] This system allows users to complete administrative procedures online efficiently and reliably. Real-time input checks and validations prevent the entry of inaccurate information, enabling faster procedures.

[0150] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0151] Step 1:

[0152] Enter and submit user credentials

[0153] The device displays the user authentication screen. The user enters their login ID and password, and the device sends the entered authentication information to the server.

[0154] Input: The user enters the ID "user123" and password "password123".

[0155] Data processing and calculation: The terminal encrypts the authentication information using AES and sends it to the server.

[0156] Output: Encrypted authentication information sent to the server.

[0157] Specific behavior:

[0158] The device will display the message "Please enter your ID and password."

[0159] The user enters the ID "user123" and password "password123".

[0160] The terminal encrypts the input information with AES.

[0161] The device sends the encrypted information to the server.

[0162] Step 2:

[0163] Authentication verification

[0164] The server checks the received authentication information against a database to verify its validity.

[0165] Input: Encrypted credentials.

[0166] Data processing and calculation: The server decrypts the AES encryption and retrieves the corresponding user information from the database (e.g., MySQL). It compares the information to verify its authenticity.

[0167] Output: Generates authentication results and returns them to the terminal.

[0168] Specific behavior:

[0169] The server receives the encrypted authentication information.

[0170] The server decrypts the AES encryption and extracts the ID and password.

[0171] The server retrieves the relevant user information from the database.

[0172] The server compares the authentication information with the database information to verify its validity.

[0173] The server generates an authentication result.

[0174] The server sends the authentication result to the terminal.

[0175] Step 3:

[0176] Viewing the authentication result and proceeding to the next step

[0177] The device displays the authentication result sent by the server, and if the authentication is successful, the user proceeds to the next step.

[0178] Input: The authentication result from the server.

[0179] Data processing and calculation: None in particular.

[0180] Output: Display the authentication result on the screen.

[0181] Specific behavior:

[0182] The terminal receives the authentication result from the server.

[0183] If the authentication is successful, the message "Authentication successful" is displayed.

[0184] If authentication fails, the message "Authentication failed. Please try again" is displayed.

[0185] Step 4:

[0186] Choosing administrative procedures

[0187] The device displays a screen for selecting administrative procedures. The user selects the procedure they wish to follow.

[0188] Input: User selection information.

[0189] Data processing and calculation: None in particular.

[0190] Output: Sends the user's selection to the server.

[0191] Specific behavior:

[0192] The device will display the message "Please select a procedure category."

[0193] The user selects "Notification of Moving Out."

[0194] The terminal transmits the selection information to the server.

[0195] Step 5:

[0196] Sending selection information and obtaining procedure information

[0197] The server retrieves the information required for the selected procedure from the database and sends it to the terminal.

[0198] Input: User selection information.

[0199] Data processing and calculation: The server retrieves the necessary information from the database (e.g., PostgreSQL).

[0200] Output: Sends procedural information to the terminal.

[0201] Specific behavior:

[0202] The server receives the selection information sent by the terminal.

[0203] The server retrieves the information required for the procedure from the database.

[0204] The server transmits the acquired information to the terminal.

[0205] Step 6:

[0206] Displaying procedural information and providing input forms

[0207] The terminal provides the user with the procedure information and displays an input form, which the user fills in.

[0208] Input: The procedure entered by the user.

[0209] Data processing and calculation: The terminal performs format checks in real time.

[0210] Output: Shows the user in real time whether the format is correct.

[0211] Specific behavior:

[0212] The terminal displays the procedural information it has acquired (e.g., list of required documents, location of counter, etc.).

[0213] The terminal displays a form for entering the procedure details.

[0214] The user enters their new address, name, and date of birth.

[0215] Checks forms for correct formatting as you fill them out and displays warnings if there are any errors.

[0216] Step 7:

[0217] Submitting input and final validation

[0218] The terminal sends the user's input to the server, which performs final validation.

[0219] Input: All the procedures entered by the user.

[0220] Data processing and calculation: The server will double-check all data to ensure the accuracy of the format and content.

[0221] Output: Generate validation results and prepare them for registration in the database.

[0222] Specific behavior:

[0223] The user completes all the input and presses the submit button.

[0224] The device sends the input to the server.

[0225] The server revalidates the data received to ensure there are no problems.

[0226] Data that passes validation is registered in the database.

[0227] Step 8:

[0228] Notification of completion of procedure and sending of confirmation email

[0229] The server sends a notification of completion of the procedure to the terminal and a confirmation email to the user.

[0230] Input: The procedure that was successfully validated.

[0231] Data processing and calculation: None in particular.

[0232] Output: Sends a completion notification to the terminal and a confirmation email to the user.

[0233] Specific behavior:

[0234] The server generates a procedure completion notification.

[0235] The server sends a message to the terminal saying "The procedure is complete."

[0236] The server sends a confirmation email to the user.

[0237] The device displays the completion notification to the user.

[0238] This allows users to efficiently complete all procedures online.

[0239] (Application example 1)

[0240] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0241] When carrying out administrative procedures, users face challenges such as long wait times at local counters and the time it takes to gather the information necessary for the procedure. Additionally, it is inconvenient for users to not be able to track the progress of the procedure in real time. These challenges are particularly pronounced when carrying out procedures at brick-and-mortar locations such as city halls and ward offices. Another problem is that if an input error or omission occurs in the procedure details, it is not possible to quickly correct it.

[0242] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0243] In this invention, the server includes: means for receiving authentication information entered by a user and performing authentication; means for providing a screen for selecting an administrative procedure to a user who has been successfully authenticated; means for retrieving information necessary for the selected administrative procedure from a database and providing it to the user; means for receiving and validating the procedure details entered by the user; means for registering successfully validated procedure details in a database and notifying the user that the procedure has been completed; means for the user to scan an identification code installed at an administrative facility and log in using the scan results; and means for displaying the progress of the procedure to the user in real time. This reduces waiting time for users on-site, allows them to quickly obtain the information they need, and allows them to check the progress of the procedure in real time. Furthermore, the ability to check and correct input information in real time improves the accuracy of the procedure and reduces the burden on the user.

[0244] "User authentication" is the process by which a user enters their identity information, which is then verified by the system.

[0245] "Administrative procedures" are procedures through which users submit applications or notifications to public institutions such as government agencies.

[0246] A "database" is a structured collection of data that allows information to be efficiently stored, managed, and retrieved.

[0247] "Validation" is the process of checking whether the entered data is of the correct format and content.

[0248] The "procedure completion notification" is a message to inform the user that the procedure has been completed successfully.

[0249] "Scanning an identification code" refers to the act of reading a code such as a QR code (registered trademark) or barcode with a device and recognizing the information contained therein.

[0250] "Logging in" is the process by which a user enters authentication information and has their authentication accepted in order to access a system.

[0251] "Procedure progress display" is a function that displays the status and progress of ongoing procedures to users in real time.

[0252] "Real-time validation" is a process in which data entered by a user is verified instantly.

[0253] "Administrative facilities" are public buildings that provide administrative services, such as city halls and ward offices.

[0254] To implement this invention, the server, the terminal (such as a smartphone or tablet), and the user must each play their respective appropriate roles. Specific operation methods for each step are described below.

[0255] User authentication

[0256] First, the user scans the identification code installed at the city hall or ward office with the terminal and performs the authentication procedure using the result. The server receives this information and checks it against the database to verify the authenticity of the authentication. If the authentication is successful, the terminal proceeds to the next step.

[0257] Hardware and software used

[0258] Hardware: Smartphone with QR code reader

[0259] Software: iOS or ANDROID application, SQLite database, Flask server

[0260] Specific examples

[0261] The user scans the QR code displayed at the city hall counter with their smartphone and logs in by entering "user123" and "password123."

[0262] Choosing administrative procedures

[0263] After successful authentication, the terminal displays a screen for the user to select the administrative procedure. The user selects the procedure they want and the information is sent to the server. The server retrieves the information required for the selected procedure from the database and provides it to the terminal.

[0264] Hardware and software used

[0265] Hardware: Smartphone

[0266] Software: iOS or Android application, Flask server

[0267] Specific examples

[0268] The user selects "Notification of Moving Out" and the information is sent to the server. The server retrieves the list of documents required for the notification and detailed information from the database and returns them to the terminal.

[0269] Enter the required information

[0270] The terminal provides the user with a form to enter the information required for the selected procedure. As the user enters the information, validation is performed in real time, and any confirmation or correction of the input is reflected immediately.

[0271] Hardware and software used

[0272] Hardware: Smartphone

[0273] Software: iOS or Android application, Flask server

[0274] Specific examples

[0275] The user enters their new address as "No. XX, XX-chome, Minato-ku, Tokyo," and the format is instantly checked. If the format is correct, they proceed to the next step.

[0276] Notification of completion of procedure

[0277] Once all the information has been entered, the user presses the send button, and the device sends the information to the server. The server then checks the information again, registers it in the database, and notifies the device that the procedure has been completed. At the same time, a confirmation email is sent to the user.

[0278] Hardware and software used

[0279] Hardware: Smartphones, servers

[0280] Software: iOS or Android application, Flask server, mail server

[0281] Specific examples

[0282] The user submits the information, the server registers the data in the database, the terminal displays a message saying "The procedure is complete," and a confirmation email is sent to the user.

[0283] Prompt sentence for generative AI model

[0284] Below are some example prompts to be input to the generative AI model:

[0285] I would like to scan a QR code at the city hall counter to complete the authentication process. Please tell me how to scan the QR code using a smartphone, and how to create a series of steps from logging in, selecting a procedure, entering the necessary information, and receiving a notification that the procedure has been completed.

[0286] This system allows users to complete procedures at city halls and ward offices quickly and efficiently. Users can reduce waiting times on-site and easily obtain the information they need. In addition, the system allows users to check and correct input information in real time, improving the accuracy of procedures and reducing the burden on users.

[0287] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0288] Step 1:

[0289] The user scans the identification code installed in the government facility. The user reads the identification code using a QR code reader on their smartphone. This input data is sent to the terminal and then sent to the server as authentication information.

[0290] Step 2:

[0291] The server receives the authentication information and checks it against the database. The server compares the entered authentication information with the database to verify the user's authenticity. If authentication is successful, the server returns a message indicating successful authentication to the terminal.

[0292] Step 3:

[0293] After successful authentication, the terminal displays a screen for the user to select an administrative procedure. The user selects the administrative procedure from the list and enters the relevant information. This input data is sent to the server.

[0294] Step 4:

[0295] The server retrieves the information required for the procedure selected by the user from a database. The server retrieves the relevant information from the database and returns it to the terminal. The information displayed on the terminal includes a list of documents required for the procedure and detailed information.

[0296] Step 5:

[0297] The terminal displays a form for the user to enter the required information. The user enters the information into the form and the data is validated in real time. If any inaccurate or missing data is found during this process, the terminal provides immediate feedback and the user can make corrections.

[0298] Step 6:

[0299] After completing the input, the user presses the send button. The terminal sends the input information to the server. The server checks the information again and saves it in the database. A notification that the procedure is complete is then sent to the terminal and displayed to the user. A confirmation email is also sent to the user.

[0300] Step 7:

[0301] After the transaction is completed, the terminal will display the transaction progress to the user in real time. The server will update the transaction status at each stage and send it to the terminal, allowing the user to have an overall understanding of the transaction.

[0302] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0303] The present invention is a system that supports users in efficiently performing administrative procedures, and aims to improve the user experience by combining it with an emotion engine that recognizes the user's emotions. This system includes means for receiving authentication information entered by the user and performing authentication, means for providing a screen for selecting an administrative procedure to a user who has been successfully authenticated, means for retrieving information necessary for the selected administrative procedure from a database and providing the user with the information, means for receiving the procedure details entered by the user and validating it, and means for registering the successfully validated procedure details in the database and notifying the user that the procedure has been completed.

[0304] Furthermore, it is equipped with an emotion engine that recognizes the user's emotions and has the ability to customize procedural guidance and support based on the user's emotions. It also includes a means to adaptively change the operation screen and messages according to the user's emotions, and a means to save and analyze the recognized emotion data as a log.

[0305] Overview of program processing flow

[0306] User authentication

[0307] 1. The terminal displays the user authentication screen.

[0308] The user enters their login ID and password.

[0309] 2. The user enters their authentication information. For example, they enter "user123" and "password123."

[0310] 3. The device sends the entered authentication information to the server.

[0311] The server checks the received authentication information against a database.

[0312] 4. The server returns the authentication result to the terminal. If the authentication is successful, proceed to the next step.

[0313] Choosing administrative procedures

[0314] 5. The terminal displays the administrative procedure category selection screen.

[0315] The user selects the procedure they wish to follow. Example: Select "Notification of Moving Out."

[0316] 6. The device sends the selection information to the server.

[0317] The server retrieves detailed information about the selected procedure from a database.

[0318] 7. The server sends the procedure information back to the terminal.

[0319] Example: Send information such as a list of documents required for submitting a moving-out notification, the location of the counter, and reception hours to the terminal.

[0320] Procedural input assistance

[0321] 8. The device will display the input form.

[0322] Provide users with fields to enter necessary information (e.g. new address, name, date of birth, etc.).

[0323] 9. The user enters the information.

[0324] The input is checked in real time to ensure there are no errors or omissions.

[0325] Emotion Recognition and Customization

[0326] 10. The device uses an emotion engine to recognize the user's emotions.

[0327] Emotion recognition is based on the user's facial expressions, tone of voice, and typing speed.

[0328] 11. The server generates appropriate guidance and messages based on the user's emotions based on the emotion engine.

[0329] Example: If the user seems anxious, display a supportive message such as "Is there anything I can help you with?"

[0330] Input validation and procedure completion notification

[0331] 12. After the device has completed all the input fields, it will display a submit button.

[0332] The user confirms and presses send.

[0333] 13. The terminal sends the entered information to the server.

[0334] The server will reconfirm the information and register it in the database.

[0335] 14. The server sends a procedure completion notification to the terminal.

[0336] The completion notice will include detailed information about the procedure.

[0337] 15. The device displays a confirmation screen, informing the user that the transaction was successfully completed.

[0338] 16. The server sends a confirmation email to the user, containing details of the transaction and next steps to take.

[0339] Emotion data logging and analysis

[0340] 17. The server stores the emotion data recognized by the emotion engine as a log.

[0341] This allows us to track user behavior history and emotional changes.

[0342] 18. The server analyzes the stored emotional data and uses it to improve procedures and enhance the user experience.

[0343] Specific examples

[0344] 1. Authentication Process

[0345] The device displays the authentication screen and the user enters "user123" and "password123".

[0346] The server receives the authentication information and returns a successful authentication after checking the database.

[0347] 2. Choice of administrative procedures

[0348] The device displays the category selection screen, and the user selects "Notification of Moving Out."

[0349] The server obtains detailed information about the moving-out notification and sends it to the terminal.

[0350] 3. Input Assistance and Emotion Recognition

[0351] The device displays an input form, and the user enters the new address information: "No. XX, XX-chome, Minato-ku, Tokyo."

[0352] The device validates input in real time and recognizes the user's emotions using an emotion engine.

[0353] The server provides appropriate guidance and messages based on emotion recognition.

[0354] 4. Complete the procedure

[0355] The user presses send and the device sends the data to the server.

[0356] The server registers the data, sends a notification of completion of the procedure to the terminal, and sends a confirmation email to the user.

[0357] The server stores and analyzes the emotional data in a log.

[0358] This invention not only enables users to complete administrative procedures efficiently and reliably, but also reduces the stress and anxiety they may feel during the process. The introduction of an emotion engine enables more personalized support, improving the user experience.

[0359] The processing flow will be explained below.

[0360] Step 1:

[0361] The terminal displays the user authentication screen, and the user enters their login ID and password.

[0362] Step 2:

[0363] The user enters their ID and password. For example, they enter "user123" and "password123."

[0364] Step 3:

[0365] The terminal sends the entered authentication information to the server, which then collates the received authentication information with a database and performs authentication.

[0366] Step 4:

[0367] The server returns the authentication result to the terminal. If the authentication is successful, proceed to the next step. If the authentication is unsuccessful, return an error message.

[0368] Step 5:

[0369] The device displays a screen for the user to select a category for administrative procedures. For example, it displays a list of categories such as "Acquisition of Resident Registration," "Notification of Moving Out," and "Certificate Issuance."

[0370] Step 6:

[0371] The user selects the procedure they wish to perform. For example, they select "Notification of Moving Out."

[0372] Step 7:

[0373] The terminal sends the selection information to the server, which retrieves detailed information about the selected procedure from a database.

[0374] Step 8:

[0375] The server sends back the procedure information to the terminal, such as a list of documents required for the moving-out notification, the location of the counter, and reception hours.

[0376] Step 9:

[0377] The device displays the necessary information to the user and allows the user to access input forms.

[0378] Step 10:

[0379] The user enters the required information, such as new address, name, date of birth, etc.

[0380] Step 11:

[0381] The terminal validates input in real time, checking address format and required fields, and providing feedback to the user if there are any errors.

[0382] Step 12:

[0383] The device activates an emotion engine to recognize the user's emotions as they are input, analyzing the user's facial expressions, tone of voice, and input speed.

[0384] Step 13:

[0385] The server generates appropriate guidance and messages based on the user's emotions recognized using an emotion engine. For example, if the user appears anxious, it will display a message such as "Would you like to consult a specialist?"

[0386] Step 14:

[0387] The device displays generated guides and messages to the user, assisting the user to smoothly proceed with operations.

[0388] Step 15:

[0389] After the user has completed all the input fields, they confirm the information and click the submit button.

[0390] Step 16:

[0391] The terminal sends the input information to the server, which then reconfirms the received information and registers it in the database.

[0392] Step 17:

[0393] The server sends a procedure completion notification to the terminal, which includes detailed procedure information.

[0394] Step 18:

[0395] The device displays a transaction completion screen, informing the user that the transaction was successfully completed.

[0396] Step 19:

[0397] The server will send a confirmation email to the user, containing details of the procedure and next steps to take.

[0398] Step 20:

[0399] The server stores the emotion data recognized by the emotion engine as a log, which allows users to track their operation history and changes in their emotions.

[0400] Step 20:

[0401] The server analyzes the stored emotional data and uses it to improve procedures and enhance the user experience.

[0402] Example 2

[0403] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0404] The problem with existing administrative procedure systems is that they provide uniform procedural guidelines without considering the user's emotions or stress level.In addition, there are cases where confirmation of user input and notification of procedure completion are delayed, which reduces the efficiency of the entire procedure.

[0405] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0406] In this invention, the server includes means for receiving authentication information entered by the user and performing authentication, means for providing a procedure screen to a user who has been successfully authenticated, means for obtaining information necessary for the selected procedure from an information storage device and providing it to the user, means for receiving the procedure details entered by the user and confirming the input, means for registering the successfully confirmed procedure details in the information storage device and notifying the user that the procedure has been completed, means for providing support based on the recognized emotion, and means for recording and analyzing emotion information. This allows the server to provide personalized support according to the user's emotions, reducing stress during the procedure and enabling the procedure to be completed efficiently.

[0407] "Authentication Information" refers to the ID and password entered by a user when accessing the system, or any other similar personal identification information.

[0408] The "procedure screen" is the interface for the user to input the details of the administrative procedure they have selected.

[0409] An "information storage device" is a database or storage system that stores information related to a procedure and allows data to be retrieved as needed.

[0410] "Input validation" refers to the process of checking whether the procedure details entered by the user are accurate and complete.

[0411] A "transaction completion notification" is a mechanism used to notify the user that the transaction has been successfully completed.

[0412] An "emotion processing mechanism" refers to the algorithms and hardware that recognize and analyze a user's emotions.

[0413] "Means for providing support based on emotions" refers to the system's ability to provide appropriate guidance or messages based on the user's recognized emotions.

[0414] "Emotional information" refers to data that indicates the user's emotional state, such as information obtained from facial expressions, tone of voice, and typing speed.

[0415] "Means of recording and analyzing" refers to the process of storing emotional information as a history and analyzing that data to help improve the user experience and the system.

[0416] The present invention is a system that helps users to efficiently carry out administrative procedures, and aims to improve the user experience by combining an emotion processing mechanism that recognizes the user's emotions. This system includes authentication functions, administrative procedure selection functions, input support functions, emotion recognition functions, and procedure completion notification functions.

[0417] Hardware and Software Configuration

[0418] The system uses the following hardware and software:

[0419] Server: Runs the database, authentication system, emotion processing mechanism, and procedure management system.

[0420] Device: The device that receives user input (PC, smartphone, tablet).

[0421] Database: Stores data related to administrative procedures (e.g., MySQL, PostgreSQL)

[0422] Emotion processing mechanism: Software used to recognize the user's emotions (e.g., OpenCV, TENSORFLOW®)

[0423] Communication protocol: Used to send and receive data between the device and the server (e.g. HTTPS)

[0424] Specific processing flow of the system

[0425] 1. User authentication:

[0426] The device displays a user authentication screen, and the user enters their ID and password. The device then sends this information to the server.

[0427] The server checks the authentication information against a database and returns the result of authentication success or failure to the terminal.

[0428] 2. Choice of administrative procedure:

[0429] For users who have been successfully authenticated, the device displays a screen for selecting categories for administrative procedures.

[0430] The user selects the procedure they wish to perform and the device transmits the selection to the server.

[0431] 3. Input assistance:

[0432] The server retrieves the information required for the selected procedure from the database and sends it back to the terminal.

[0433] The terminal displays an input form and the user enters the required information.

[0434] 4. Emotion recognition:

[0435] The device uses an emotion processing mechanism to recognize the user's emotions based on facial expressions, voice tone, and input speed.

[0436] The server provides appropriate guidance and support based on the emotional information. For example, if the user seems anxious, it displays "Is there something I can help you with?"

[0437] 5. Notification of Completion of Procedure:

[0438] After the terminal completes all the input fields, it displays a submit button. When the user presses submit, the terminal sends the input data to the server.

[0439] The server checks the input data and registers it in the database, then sends a notification of completion of the procedure to the terminal and a confirmation email to the user.

[0440] 6. Emotional data logging and analysis:

[0441] The server stores the emotional data recognized by the emotion processing mechanism as a log and uses it to improve the user experience and procedures.

[0442] Specific examples

[0443] 1. Authentication Process:

[0444] The terminal displays the authentication screen, and the user enters "user123" and "password123." The server receives the authentication information, checks it against the database, and returns a successful authentication.

[0445] 2. Choice of administrative procedure:

[0446] The device displays a category selection screen, and the user selects "Notification of Moving Out." The server obtains detailed information about the notification of moving out and sends it to the device.

[0447] 3. Input assistance and emotion recognition:

[0448] The device displays an input form, and the user enters their new address, such as "No. XX, XX-chome, Minato-ku, Tokyo." The device validates the input in real time and recognizes the user's emotions using its emotion processing mechanism. The server then provides appropriate guidance and messages based on the emotion recognition.

[0449] 4. Complete the process:

[0450] The user presses send, and the device sends the data to the server. The server registers the data, sends a notification of completion to the device, and sends a confirmation email to the user. The server then stores the emotion data in a log and analyzes it.

[0451] Prompt Sentence Examples

[0452] After selecting "Notice of Moving Out," the message "Please contact us if you have any questions" will be displayed while you are entering the required information. Also, once the procedure is complete, the message "Thank you for completing the notification of moving out" will be displayed and a confirmation email will be sent.

[0453] In this way, the present invention not only enables users to complete administrative procedures efficiently and reliably, but also reduces the stress and anxiety they may feel during the process. The introduction of an emotion processing mechanism provides more personalized support and improves the user experience.

[0454] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0455] Step 1:

[0456] The device displays the user authentication screen.

[0457] The device displays a screen for the user to enter their login ID and password. The user can enter the ID as "user123" and the password as "password123" at any time.

[0458] Step 2:

[0459] The user enters their credentials.

[0460] The user enters their ID and password in the input fields displayed on the screen and presses the login button. The ID and password are provided to the terminal as input data.

[0461] Step 3:

[0462] The terminal transmits the entered authentication information to the server.

[0463] The terminal uses the HTTPS protocol to send the entered ID and password to the server, which receives this information and processes the authentication information by packaging the data in JSON format and sending it.

[0464] Step 4:

[0465] The server checks the credentials against a database.

[0466] The server compares the received authentication information with the database to verify that the ID and password match. Specifically, it executes an SQL query to search for the corresponding record in the database and determines whether the authentication is successful (e.g., SQL query "SELECT FROM users WHERE ID = 'user123' AND password = 'password123'").

[0467] Step 5:

[0468] The server returns the authentication result to the terminal.

[0469] The server sends the authentication result in JSON format to the terminal. If successful, it returns a "Authentication successful" response, and if unsuccessful, it returns a "Authentication failed" response.

[0470] Step 6:

[0471] The terminal displays a screen for selecting categories for administrative procedures.

[0472] If authentication is successful, the device displays a screen for selecting administrative procedures, such as a list of procedures such as "Notification of Moving Out," "Notification of Moving In," and "Obtaining a Copy of Residence Certificate."

[0473] Step 7:

[0474] The user selects an administrative procedure.

[0475] The user selects the administrative procedure they wish to carry out and presses the select button. The selected procedure (e.g., "Notification of Moving Out") is then provided to the terminal as input data.

[0476] Step 8:

[0477] The terminal transmits the selection information to the server.

[0478] The terminal sends the selected procedure information to the server. The server receives this information and processes it. Specifically, it sends the selected procedure category in JSON format.

[0479] Step 9:

[0480] The server retrieves the details of the procedure from a database.

[0481] The server retrieves detailed information about the specified procedure from the database, using an SQL query to retrieve relevant information (e.g., required documents, requirements, and office locations) (e.g., "SELECT FROM procedures WHERE type = 'Notification of Moving Out'").

[0482] Step 10:

[0483] The server sends the procedure information back to the terminal.

[0484] The server sends the acquired procedure information in JSON format to the terminal, which receives this information and displays it to the user.

[0485] Step 11:

[0486] The device displays the input form.

[0487] The device will then display a form where you can enter the necessary details, including your new address, name, date of birth, etc.

[0488] Step 12:

[0489] The user enters information.

[0490] The user enters the required information into each form field. For example, the new address is "No. XX, Minato-ku, Tokyo" and the name is "Taro Yamada." The input information is provided to the terminal.

[0491] Step 13:

[0492] The terminal validates the input in real time.

[0493] The device uses JavaScript and regular expressions to check the information entered in real time, for example, to ensure that the postal code is formatted correctly and that all required fields have been entered.

[0494] Step 14:

[0495] The device uses an emotion processing mechanism to recognize the user's emotions.

[0496] The device uses a camera and microphone to input the user's facial expressions, voice tone, and typing speed into emotion recognition algorithms, which use OpenCV and TensorFlow to analyze the emotion data.

[0497] Step 15:

[0498] The server generates appropriate guidance and messages based on the user's emotions based on the emotion processing mechanism.

[0499] The server uses the recognized emotion data to generate an appropriate support message, for example, "Is there anything I can help you with?" if the user appears anxious.

[0500] Step 16:

[0501] After the terminal has completed all the input fields, it will display a submit button.

[0502] If all required fields are filled in correctly, the terminal will enable a submit button. When the user presses submit, the data will be sent to the server.

[0503] Step 17:

[0504] The terminal transmits the input information to the server.

[0505] The terminal sends all input data to the server in JSON format.

[0506] Step 18:

[0507] The server will reconfirm the information and register it in the database.

[0508] The server checks the received data, verifies its accuracy, and then stores the information in the database (e.g., "INSERT INTO procedures (user_id, procedure_type, details) VALUES (...);").

[0509] Step 19:

[0510] The server sends a procedure completion notification to the terminal.

[0511] Once the registration in the database is complete, the server sends a notification of completion of the procedure to the terminal, along with detailed information about the procedure to the user.

[0512] Step 20:

[0513] The device will display a completion screen.

[0514] The device will display a screen informing the user that the procedure is complete.

[0515] Step 21:

[0516] The server sends a confirmation email to the user.

[0517] The server will then send a confirmation email to the user, detailing the process and the next steps to take.

[0518] Step 22:

[0519] The server stores the emotion data recognized by the emotion processing mechanism as a log.

[0520] The server stores the user's emotional data as a log and accumulates it for future analysis.

[0521] Step 23:

[0522] The server analyzes the stored emotional data and uses it to improve procedures and enhance the user experience.

[0523] The server analyzes the emotional data and identifies areas for improvement to improve the user experience and streamline procedures.

[0524] (Application example 2)

[0525] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0526] Conventional administrative procedure systems lack support that takes into account the user's emotions regarding the procedure, and no method has been established to reduce stress and anxiety during the procedure. Furthermore, even in physical stores, there are no systems that can recognize customer emotions in real time and provide appropriate customer service guidance or recommended products. This can result in a lack of improvement in the user and customer experience, leaving them dissatisfied.

[0527] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0528] In this invention, the server includes means for receiving authentication information entered by a user and performing authentication, means for providing a screen for selecting an administrative procedure to a user who has been successfully authenticated, means for retrieving information necessary for the selected administrative procedure from a database and providing it to the user, means for receiving procedure details entered by the user and performing validation, means for registering successfully validated procedure details in a database and notifying the user that the procedure has been completed, means for performing emotion recognition and presenting customer service guides and recommended products based on the recognized emotion data, and means for saving and analyzing the recognized emotion data as a log. This allows for the provision of personalized support according to the emotions of users and customers, reducing stress during procedures and improving the customer experience.

[0529] "User" refers to an individual or corporation that uses this system to receive administrative procedures or services.

[0530] "Authentication Information" means information such as a user ID and password that a user provides to access a system.

[0531] "Authentication means" refers to technology or devices that receive authentication information provided by a user and verify its validity.

[0532] "Administrative procedures" refers to various official procedures and applications that users carry out online or in physical locations.

[0533] A "database" is an information system for storing and managing administrative procedures and user information.

[0534] "Validation" is the process of ensuring that the information entered by the user is accurate and complete.

[0535] "Notification means" refers to the methods and techniques used to notify users of the completion of procedures and other important information.

[0536] "Emotion recognition" is a technology that infers a user's emotions from their facial expressions, tone of voice, etc.

[0537] A "guide" is a guide or instruction that helps users or customers to smoothly proceed with procedures or services.

[0538] "Recommended products" are products or services selected by the system based on the customer's emotions and preferences.

[0539] "Log" is data for recording the system's operation history and recognized emotion data.

[0540] "Analysis" is the process of analyzing data stored as logs and deriving patterns and trends.

[0541] System Overview

[0542] This invention is a system that allows users to efficiently complete administrative procedures, and aims to improve the user and customer experience by combining it with an emotion recognition engine. The system for implementing the invention includes means for user authentication, selection of administrative procedures, provision of necessary information, validation of procedure content, notification of procedure completion, emotion recognition, presentation of guides, display of recommended products, and logging and analysis of emotion data.

[0543] Hardware and software used

[0544] Hardware:

[0545] Devices (smartphones, smart glasses, head-mounted displays, robots, etc.)

[0546] server

[0547] software:

[0548] Authentication system: Authentication is performed using user ID and password.

[0549] Database system: A management system for managing administrative procedures and user information.

[0550] Emotion recognition engine: Recognizes emotions from the user's facial expressions and tone of voice.

[0551] Product recommendation system: Recommend products based on user sentiment and preferences.

[0552] Log management system: Stores and analyzes operation history and emotional data.

[0553] Explanation of program processing

[0554] Authentication process

[0555] The server receives the authentication information entered by the user and verifies it against the information in the database. At this time, the terminal displays an authentication screen and the user enters their ID and password. If authentication is successful, the process proceeds to the next step.

[0556] Selection of administrative procedures and provision of information

[0557] For users who have been successfully authenticated, the terminal displays a screen for selecting administrative procedures. The user selects the procedure they wish to use and sends that information to the server. The server then retrieves the necessary information (e.g., required documents, reception location, etc.) from the database and sends it back to the terminal.

[0558] Input support and validation of procedure details

[0559] When a user enters the required information into the input form, the terminal performs real-time validation. Information that passes validation is sent to the server and registered in the database. The user is then notified that the procedure has been completed.

[0560] Emotion Recognition and Personalized Guidance

[0561] The device uses an emotion recognition engine to recognize the user's emotions from their facial expressions and tone of voice. This information is sent to the server, which then displays the most appropriate guidance and product recommendations based on the user's emotions. For example, if the user is feeling anxious, the server will display a support message asking, "Is there anything I can help you with?"

[0562] Emotion data logging and analysis

[0563] The server stores the emotion data recognized by the emotion recognition engine as a log, which is then analyzed to improve future procedures and user experience.

[0564] Specific examples

[0565] For example, in a physical store, when a store staff member wearing smart glasses interacts with a customer, the emotion recognition engine analyzes the customer's emotions in real time. For example, if the customer is smiling, the smart glasses will display a message saying, "The customer seems to be in a good mood. Please recommend a new wine." The staff member can then follow the guidance displayed on the glasses to improve the customer experience.

[0566] Example prompts to input to a generative AI model:

[0567] Prototype a smart glasses application that recognizes emotions from a customer's facial expressions and tone of voice, and provides real-time guidance and product recommendations.

[0568] 1. Customer Authentication

[0569] 2. Real-time emotion recognition

[0570] 3. Guidance based on recognition results

[0571] 4. Emotional data logging

[0572] In summary, this system will enable users and customers to enjoy a better experience by reducing stress when undergoing procedures and receiving services.

[0573] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0574] Step 1:

[0575] The device displays an authentication screen and the user enters their authentication information.

[0576] Input: User ID and password

[0577] How it works: The device receives user input and sends it to the server.

[0578] Output: Authentication information is sent to the server.

[0579] Step 2:

[0580] The server checks the received authentication information against a database and returns the authentication result.

[0581] Input: User ID and password

[0582] What happens: The server contacts the database and verifies that the credentials match.

[0583] Output: The result of authentication success or failure is sent to the terminal.

[0584] Step 3:

[0585] For users who have been successfully authenticated, the device displays a screen for selecting categories for administrative procedures.

[0586] Input: Authentication success result

[0587] Operation: The terminal generates and displays a category selection screen for administrative procedures.

[0588] Output: The administrative procedure selection screen is displayed.

[0589] Step 4:

[0590] The user selects the desired administrative procedure, and the terminal transmits the selection information to the server.

[0591] Input: Selected information for administrative procedures

[0592] Operation: The device receives the information selected by the user and sends it to the server.

[0593] Output: The selection information is sent to the server.

[0594] Step 5:

[0595] The server retrieves detailed information about the selected administrative procedure from a database and sends it back to the terminal.

[0596] Input: Selection information

[0597] Operation: The server accesses the database and retrieves the necessary procedural information.

[0598] Output: The acquired procedure information is sent to the terminal.

[0599] Step 6:

[0600] The terminal displays the procedure information it has acquired, and the user enters the necessary information.

[0601] Input:Procedure information

[0602] Operation: The device generates an input form and displays it to the user. The user enters the required information.

[0603] Output: User input is saved to the device.

[0604] Step 7:

[0605] The device uses an emotion recognition engine to recognize the user's emotions in real time.

[0606] Input: User's facial expressions, tone of voice

[0607] How it works: The device uses an emotion recognition engine to analyze the data and recognize the user's emotions.

[0608] Output: User emotion data is obtained.

[0609] Step 8:

[0610] The server displays appropriate guides and recommended products to the user based on the emotional data.

[0611] Input: Emotion data

[0612] How it works: The server processes the acquired emotional data and generates the best guide and recommended products for the user.

[0613] Output: Guide and recommended product information is sent to the device.

[0614] Step 9:

[0615] The device displays guides and recommended products to the user, who then completes the input.

[0616] Input: Guide and recommended product information

[0617] Action: The terminal displays the information and the user completes the transaction.

[0618] Output: The completed input is saved to the device.

[0619] Step 10:

[0620] The terminal sends the completed procedure details to the server and performs validation.

[0621] Input: Completed procedure details

[0622] Operation: The terminal sends the procedure details to the server, which then validates them.

[0623] Output: The validation result is generated.

[0624] Step 11:

[0625] The server registers the procedure details that have been successfully validated in a database and sends a completion notification to the terminal.

[0626] Input: Validation result

[0627] Operation: The server registers the procedure details in the database, generates a completion notice, and sends it to the terminal.

[0628] Output: A notification of completion of the procedure is sent to the terminal.

[0629] Step 12:

[0630] The terminal displays a notification to the user that the procedure has been completed, and the server sends a confirmation email.

[0631] Input: Procedure completion notification

[0632] What happens: The device displays a notification and the server sends a confirmation email to the user.

[0633] Output: The user will receive a notification and a confirmation email.

[0634] Step 13:

[0635] The server stores the recognized emotion data as a log and uses it for future analysis.

[0636] Input: Emotion data

[0637] How it works: The server uses a log management system to store emotion data and manage it in an analyzable format.

[0638] Output: Emotion data is saved as a log.

[0639] The above are the specific processing steps of the system that realizes the application example. By accurately understanding the processing content of each step and its input and output, you can understand the overall picture of the system and implement it effectively.

[0640] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0641] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0642] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0643] [Second embodiment]

[0644] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0645] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0646] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0647] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0648] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0649] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0650] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0651] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0652] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0653] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0654] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0655] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0656] The present invention is a system that supports users in efficiently performing administrative procedures. This system includes means for receiving authentication information entered by a user and performing authentication, means for providing a screen for selecting an administrative procedure to a user who has been successfully authenticated, means for retrieving information necessary for the selected administrative procedure from a database and providing the information to the user, means for receiving and validating the procedure details entered by the user, and means for registering the successfully validated procedure details in the database and notifying the user of the completion of the procedure.

[0657] Overview of program processing flow

[0658] User authentication

[0659] 1. The terminal displays the user authentication screen.

[0660] The user enters their login ID and password.

[0661] 2. The device sends the authentication information entered by the user to the server.

[0662] The server checks the authentication information against a database to verify its validity.

[0663] 3. The server returns the authentication result to the terminal.

[0664] If the authentication is successful, proceed to the next step.

[0665] Choosing administrative procedures

[0666] 4. The terminal displays the administrative procedure category selection screen.

[0667] The user selects the procedure they wish to follow.

[0668] Example: Select "Notification of Moving Due to Moving."

[0669] 5. The device sends the selection information to the server.

[0670] The server retrieves detailed information about the selected procedure from a database.

[0671] 6. The server sends the procedure information back to the terminal.

[0672] Examples: a list of documents required for the moving-out notification, the location of the office, opening hours, etc.

[0673] Procedural input assistance

[0674] 7. The device will display the input form.

[0675] Provide users with fields to enter necessary information (e.g. new address, name, date of birth, etc.).

[0676] 8. The user enters the information.

[0677] The input is checked in real time to ensure there are no errors or omissions.

[0678] For example, when you enter your "new address," it will immediately check that it is in the correct format.

[0679] Input validation and procedure completion notification

[0680] 9. After the device has completed all the input fields, it will display a submit button.

[0681] The user confirms and presses send.

[0682] 10. The terminal sends the entered information to the server.

[0683] The server will reconfirm the information and register it in the database.

[0684] 11. The server sends a notification of completion of the procedure to the terminal and a confirmation email to the user.

[0685] The terminal will display a message to the user saying "The procedure is complete," and the entire process will be completed.

[0686] Specific examples

[0687] 1. Authentication Process

[0688] The device displays the authentication screen and the user enters "user123" and "password123".

[0689] The server receives the authentication information and returns a successful authentication after checking the database.

[0690] 2. Choice of administrative procedures

[0691] The device displays the category selection screen, and the user selects "Notification of Moving Out."

[0692] The server obtains detailed information about the moving-out notification and sends it to the terminal.

[0693] 3. Input assistance

[0694] The device displays an input form, and the user enters their new address as "No. XX, XX-chome, Minato-ku, Tokyo."

[0695] A format check is performed in real time, and if the format is correct, proceed to the next step.

[0696] 4. Complete the procedure

[0697] The user presses send and the device sends the data to the server.

[0698] The server registers the data, sends a notification of completion of the procedure to the terminal, and sends a confirmation email to the user.

[0699] This system allows users to complete administrative procedures efficiently and reliably, supporting them at each step of the process and significantly reducing the burden of the process.

[0700] The processing flow will be explained below.

[0701] Step 1:

[0702] The terminal displays the user authentication screen, and the user enters their login ID and password.

[0703] Step 2:

[0704] The user enters their ID and password. For example, they enter "user123" and "password123."

[0705] Step 3:

[0706] The terminal sends the entered authentication information to the server, which then checks the received authentication information against its database.

[0707] Step 4:

[0708] The server returns the authentication result to the terminal. If the authentication is successful, proceed to the next step. If the authentication is unsuccessful, return an error message.

[0709] Step 5:

[0710] The device displays a screen for the user to select a category for administrative procedures. For example, it displays a list of categories such as "Acquisition of Resident Registration," "Notification of Moving Out," and "Certificate Issuance."

[0711] Step 6:

[0712] The user selects the procedure they wish to perform. For example, they select "Notification of Moving Out."

[0713] Step 7:

[0714] The terminal sends the selection information to the server, which retrieves detailed information about the selected procedure from a database.

[0715] Step 8:

[0716] The server sends back the procedure information to the terminal, such as a list of documents required for the moving-out notification, the location of the counter, and reception hours.

[0717] Step 9:

[0718] The device displays the necessary information to the user and allows the user to access input forms.

[0719] Step 10:

[0720] The user enters the required information, such as new address, name, date of birth, etc.

[0721] Step 11:

[0722] The terminal validates input in real time, checking address format and required fields, and providing feedback to the user if there are any errors.

[0723] Step 12:

[0724] After the user has completed all the input fields, they check the information and click the submit button.

[0725] Step 13:

[0726] The terminal sends the input information to the server, which then reconfirms the received information and registers it in the database.

[0727] Step 14:

[0728] The server sends a notification to the terminal that the procedure has been completed. The notification includes detailed information about the procedure.

[0729] Step 15:

[0730] The device displays a transaction completion screen, informing the user that the transaction was successfully completed.

[0731] Step 16:

[0732] The server will send a confirmation email to the user, containing details of the procedure and next steps to take.

[0733] Example 1

[0734] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0735] In current administrative procedures, users often experience delays due to cumbersome procedures and incomplete documentation. Furthermore, because information is not checked or validated in real time, users may enter incorrect information and be required to resubmit the procedure. This not only wastes users' time and effort, but also reduces administrative processing efficiency. There is a need for improved system usability and user experience, especially for online procedures.

[0736] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0737] In this invention, the server includes means for receiving authentication information entered by a user and verifying it against a database for authentication; means for displaying a category selection screen and providing a screen for selecting an administrative procedure to a user who has been successfully authenticated; means for retrieving information necessary for the selected administrative procedure from the database and providing it to the user; means for receiving the procedure details entered by the user, performing a format check and validation in real time; and means for registering successfully validated procedure details in the database and notifying the user that the procedure has been completed. This enables users to perform administrative procedures online accurately and efficiently. Furthermore, real-time input checks and validations allow input errors to be detected early and prevent resubmission, thereby speeding up the procedure.

[0738] "User authentication" is the process in which a system receives authentication information, such as an ID and password, entered by a user and checks its validity against a database.

[0739] The "category selection screen" is an interface for selecting administrative procedures that is displayed to users who have been successfully authenticated.

[0740] "Database" means a digital storage system that stores user authentication information and information required for selected administrative procedures.

[0741] "User input" refers to the act of a user entering information required for a procedure through an interface such as a form.

[0742] "Real-time format checking" is the process of instantly verifying that the information entered by the user is in the correct format and displaying a warning if there are any errors.

[0743] "Validation" is the process of ensuring that user-entered data is accurate and contains all required information.

[0744] A "procedure completion notification" is a message that notifies the user that the procedure has been completed after the procedure details that have been successfully validated have been registered in the database.

[0745] A "confirmation email" is a notification sent to the user via email that the process has been completed.

[0746] The present invention is a system that helps users efficiently complete administrative procedures online. This system has multiple functions for user authentication, administrative procedure selection, procedure content input support, validation, and procedure completion notification.

[0747] This system is mainly composed of a server, a terminal, and a database. Below are the specific names of each piece of hardware and software, as well as details of each process.

[0748] User authentication

[0749] First, the terminal displays a user authentication screen. The user enters their login ID and password here, and the terminal sends the entered authentication information to the server. The server receives this information and performs authentication by checking it against a database such as OpenLDAP or MySQL. If authentication is successful, the server returns the authentication result to the terminal and proceeds to the next step.

[0750] Choosing administrative procedures

[0751] For users who have been successfully authenticated, the terminal displays a screen for selecting administrative procedures. When the user selects the appropriate procedure, the selection information is sent from the terminal to the server. The server retrieves the information necessary for the selected administrative procedure from a database such as PostgreSQL and sends it back to the terminal. For example, if a notification of moving out is selected, detailed information such as a list of required documents, the location of the counter, and reception hours is provided.

[0752] Procedural input assistance

[0753] Next, the terminal displays an input form and the user enters the necessary information (e.g., new address, name, date of birth, etc.). At this time, the terminal checks the format of the input in real time. For example, when "new address" is entered, the format is immediately confirmed and a warning is displayed if it is incorrect.

[0754] Validation and procedure completion notification

[0755] When the user completes all the input fields and presses the send button, the terminal sends the entered information to the server. The server then checks this information again and validates that the format and content are correct. If validation is successful, the information is registered in the database. Finally, the server notifies the terminal that the procedure is complete and sends a confirmation email to the user. The terminal displays a message saying "The procedure has been completed," and the entire procedure is complete.

[0756] Specific examples

[0757] 1. Authentication Process:

[0758] The device displays the authentication screen and the user enters "user123" and "password123."

[0759] The server receives the authentication information, checks it against a database, and returns a successful authentication.

[0760] 2. Choice of administrative procedure:

[0761] The device displays a category selection screen, and the user selects "Notification of Moving Out."

[0762] The server obtains detailed information about the moving-out notification and sends it to the terminal.

[0763] 3. Input assistance:

[0764] The device displays an input form, and the user enters the new address as "No. XX, XX-chome, Minato-ku, Tokyo."

[0765] A format check is performed in real time, and if the format is correct, proceed to the next step.

[0766] 4. Complete the process:

[0767] The user presses send and the device sends the data to the server.

[0768] The server registers the data, sends a notification of completion of the procedure to the terminal, and sends a confirmation email to the user.

[0769] This system allows users to complete administrative procedures online efficiently and reliably. Real-time input checks and validations prevent the entry of inaccurate information, enabling faster procedures.

[0770] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0771] Step 1:

[0772] Enter and submit user credentials

[0773] The device displays the user authentication screen. The user enters their login ID and password, and the device sends the entered authentication information to the server.

[0774] Input: The user enters the ID "user123" and password "password123".

[0775] Data processing and calculation: The terminal encrypts the authentication information using AES and sends it to the server.

[0776] Output: Encrypted authentication information sent to the server.

[0777] Specific behavior:

[0778] The device will display the message "Please enter your ID and password."

[0779] The user enters the ID "user123" and password "password123".

[0780] The terminal encrypts the input information with AES.

[0781] The device sends the encrypted information to the server.

[0782] Step 2:

[0783] Authentication verification

[0784] The server checks the received authentication information against a database to verify its validity.

[0785] Input: Encrypted credentials.

[0786] Data processing and calculation: The server decrypts the AES encryption and retrieves the corresponding user information from the database (e.g., MySQL). It compares the information to verify its authenticity.

[0787] Output: Generates authentication results and returns them to the terminal.

[0788] Specific behavior:

[0789] The server receives the encrypted authentication information.

[0790] The server decrypts the AES encryption and extracts the ID and password.

[0791] The server retrieves the relevant user information from the database.

[0792] The server compares the authentication information with the database information to verify its validity.

[0793] The server generates an authentication result.

[0794] The server sends the authentication result to the terminal.

[0795] Step 3:

[0796] Viewing the authentication result and proceeding to the next step

[0797] The device displays the authentication result sent by the server, and if the authentication is successful, the user proceeds to the next step.

[0798] Input: The authentication result from the server.

[0799] Data processing and calculation: None in particular.

[0800] Output: Display the authentication result on the screen.

[0801] Specific behavior:

[0802] The terminal receives the authentication result from the server.

[0803] If the authentication is successful, the message "Authentication successful" is displayed.

[0804] If authentication fails, the message "Authentication failed. Please try again" is displayed.

[0805] Step 4:

[0806] Choosing administrative procedures

[0807] The device displays a screen for selecting administrative procedures. The user selects the procedure they wish to follow.

[0808] Input: User selection information.

[0809] Data processing and calculation: None in particular.

[0810] Output: Sends the user's selection to the server.

[0811] Specific behavior:

[0812] The device will display the message "Please select a procedure category."

[0813] The user selects "Notification of Moving Out."

[0814] The terminal transmits the selection information to the server.

[0815] Step 5:

[0816] Sending selection information and obtaining procedure information

[0817] The server retrieves the information required for the selected procedure from the database and sends it to the terminal.

[0818] Input: User selection information.

[0819] Data processing and calculation: The server retrieves the necessary information from the database (e.g., PostgreSQL).

[0820] Output: Sends procedural information to the terminal.

[0821] Specific behavior:

[0822] The server receives the selection information sent by the terminal.

[0823] The server retrieves the information required for the procedure from the database.

[0824] The server transmits the acquired information to the terminal.

[0825] Step 6:

[0826] Displaying procedural information and providing input forms

[0827] The terminal provides the user with the procedure information and displays an input form, which the user fills in.

[0828] Input: The procedure entered by the user.

[0829] Data processing and calculation: The terminal performs format checks in real time.

[0830] Output: Shows the user in real time whether the format is correct.

[0831] Specific behavior:

[0832] The terminal displays the procedural information it has acquired (e.g., list of required documents, location of counter, etc.).

[0833] The terminal displays a form for entering the procedure details.

[0834] The user enters their new address, name, and date of birth.

[0835] Checks forms for correct formatting as you fill them out and displays warnings if there are any errors.

[0836] Step 7:

[0837] Submitting input and final validation

[0838] The terminal sends the user's input to the server, which performs final validation.

[0839] Input: All the procedures entered by the user.

[0840] Data processing and calculation: The server will double-check all data to ensure the accuracy of the format and content.

[0841] Output: Generate validation results and prepare them for registration in the database.

[0842] Specific behavior:

[0843] The user completes all the input and presses the submit button.

[0844] The device sends the input to the server.

[0845] The server revalidates the data received to ensure there are no problems.

[0846] Data that passes validation is registered in the database.

[0847] Step 8:

[0848] Notification of completion of procedure and sending of confirmation email

[0849] The server sends a notification of completion of the procedure to the terminal and a confirmation email to the user.

[0850] Input: The procedure that was successfully validated.

[0851] Data processing and calculation: None in particular.

[0852] Output: Sends a completion notification to the terminal and a confirmation email to the user.

[0853] Specific behavior:

[0854] The server generates a procedure completion notification.

[0855] The server sends a message to the terminal saying "The procedure is complete."

[0856] The server sends a confirmation email to the user.

[0857] The device displays the completion notification to the user.

[0858] This allows users to efficiently complete all procedures online.

[0859] (Application example 1)

[0860] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0861] When carrying out administrative procedures, users face challenges such as long wait times at local counters and the time it takes to gather the information necessary for the procedure. Additionally, it is inconvenient for users to not be able to track the progress of the procedure in real time. These challenges are particularly pronounced when carrying out procedures at brick-and-mortar locations such as city halls and ward offices. Another problem is that if an input error or omission occurs in the procedure details, it is not possible to quickly correct it.

[0862] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0863] In this invention, the server includes: means for receiving authentication information entered by a user and performing authentication; means for providing a screen for selecting an administrative procedure to a user who has been successfully authenticated; means for retrieving information necessary for the selected administrative procedure from a database and providing it to the user; means for receiving and validating the procedure details entered by the user; means for registering successfully validated procedure details in a database and notifying the user that the procedure has been completed; means for the user to scan an identification code installed at an administrative facility and log in using the scan results; and means for displaying the progress of the procedure to the user in real time. This reduces waiting time for users on-site, allows them to quickly obtain the information they need, and allows them to check the progress of the procedure in real time. Furthermore, the ability to check and correct input information in real time improves the accuracy of the procedure and reduces the burden on the user.

[0864] "User authentication" is the process by which a user enters their identity information, which is then verified by the system.

[0865] "Administrative procedures" are procedures through which users submit applications or notifications to public institutions such as government agencies.

[0866] A "database" is a structured collection of data that allows information to be efficiently stored, managed, and retrieved.

[0867] "Validation" is the process of checking whether the entered data is of the correct format and content.

[0868] The "procedure completion notification" is a message to inform the user that the procedure has been completed successfully.

[0869] "Scanning an identification code" refers to the act of reading a code such as a QR code or barcode with a device and recognizing the information contained therein.

[0870] "Logging in" is the process by which a user enters authentication information and has their authentication accepted in order to access a system.

[0871] "Procedure progress display" is a function that displays the status and progress of ongoing procedures to users in real time.

[0872] "Real-time validation" is a process in which data entered by a user is verified instantly.

[0873] "Administrative facilities" are public buildings that provide administrative services, such as city halls and ward offices.

[0874] To implement this invention, the server, the terminal (such as a smartphone or tablet), and the user must each play their respective appropriate roles. Specific operation methods for each step are described below.

[0875] User authentication

[0876] First, the user scans the identification code installed at the city hall or ward office with the terminal and performs the authentication procedure using the result. The server receives this information and checks it against the database to verify the authenticity of the authentication. If the authentication is successful, the terminal proceeds to the next step.

[0877] Hardware and software used

[0878] Hardware: Smartphone with QR code reader

[0879] Software: iOS or Android application, SQLite database, Flask server

[0880] Specific examples

[0881] The user scans the QR code displayed at the city hall counter with their smartphone and logs in by entering "user123" and "password123."

[0882] Choosing administrative procedures

[0883] After successful authentication, the terminal displays a screen for the user to select the administrative procedure. The user selects the procedure they want and the information is sent to the server. The server retrieves the information required for the selected procedure from the database and provides it to the terminal.

[0884] Hardware and software used

[0885] Hardware: Smartphone

[0886] Software: iOS or Android application, Flask server

[0887] Specific examples

[0888] The user selects "Notification of Moving Out" and the information is sent to the server. The server retrieves the list of documents required for the notification and detailed information from the database and returns them to the terminal.

[0889] Enter the required information

[0890] The terminal provides the user with a form to enter the information required for the selected procedure. As the user enters the information, validation is performed in real time, and any confirmation or correction of the input is reflected immediately.

[0891] Hardware and software used

[0892] Hardware: Smartphone

[0893] Software: iOS or Android application, Flask server

[0894] Specific examples

[0895] The user enters their new address as "No. XX, XX-chome, Minato-ku, Tokyo," and the format is instantly checked. If the format is correct, they proceed to the next step.

[0896] Notification of completion of procedure

[0897] Once all the information has been entered, the user presses the send button, and the device sends the information to the server. The server then checks the information again, registers it in the database, and notifies the device that the procedure has been completed. At the same time, a confirmation email is sent to the user.

[0898] Hardware and software used

[0899] Hardware: Smartphones, servers

[0900] Software: iOS or Android application, Flask server, mail server

[0901] Specific examples

[0902] The user submits the information, the server registers the data in the database, the terminal displays a message saying "The procedure is complete," and a confirmation email is sent to the user.

[0903] Prompt sentence for generative AI model

[0904] Below are some example prompts to be input to the generative AI model:

[0905] I would like to scan a QR code at the city hall counter to complete the authentication process. Please tell me how to scan the QR code using a smartphone, and how to create a series of steps from logging in, selecting a procedure, entering the necessary information, and receiving a notification that the procedure has been completed.

[0906] This system allows users to complete procedures at city halls and ward offices quickly and efficiently. Users can reduce waiting times on-site and easily obtain the information they need. In addition, the system allows users to check and correct input information in real time, improving the accuracy of procedures and reducing the burden on users.

[0907] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0908] Step 1:

[0909] The user scans the identification code installed in the government facility. The user reads the identification code using a QR code reader on their smartphone. This input data is sent to the terminal and then sent to the server as authentication information.

[0910] Step 2:

[0911] The server receives the authentication information and checks it against the database. The server compares the entered authentication information with the database to verify the user's authenticity. If authentication is successful, the server returns a message indicating successful authentication to the terminal.

[0912] Step 3:

[0913] After successful authentication, the terminal displays a screen for the user to select an administrative procedure. The user selects the administrative procedure from the list and enters the relevant information. This input data is sent to the server.

[0914] Step 4:

[0915] The server retrieves the information required for the procedure selected by the user from a database. The server retrieves the relevant information from the database and returns it to the terminal. The information displayed on the terminal includes a list of documents required for the procedure and detailed information.

[0916] Step 5:

[0917] The terminal displays a form for the user to enter the required information. The user enters the information into the form and the data is validated in real time. If any inaccurate or missing data is found during this process, the terminal provides immediate feedback and the user can make corrections.

[0918] Step 6:

[0919] After completing the input, the user presses the send button. The terminal sends the input information to the server. The server checks the information again and saves it in the database. A notification that the procedure is complete is then sent to the terminal and displayed to the user. A confirmation email is also sent to the user.

[0920] Step 7:

[0921] After the transaction is completed, the terminal will display the transaction progress to the user in real time. The server will update the transaction status at each stage and send it to the terminal, allowing the user to have an overall understanding of the transaction.

[0922] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0923] The present invention is a system that supports users in efficiently performing administrative procedures, and aims to improve the user experience by combining it with an emotion engine that recognizes the user's emotions. This system includes means for receiving authentication information entered by the user and performing authentication, means for providing a screen for selecting an administrative procedure to a user who has been successfully authenticated, means for retrieving information necessary for the selected administrative procedure from a database and providing the user with the information, means for receiving the procedure details entered by the user and validating it, and means for registering the successfully validated procedure details in the database and notifying the user that the procedure has been completed.

[0924] Furthermore, it is equipped with an emotion engine that recognizes the user's emotions and has the ability to customize procedural guidance and support based on the user's emotions. It also includes a means to adaptively change the operation screen and messages according to the user's emotions, and a means to save and analyze the recognized emotion data as a log.

[0925] Overview of program processing flow

[0926] User authentication

[0927] 1. The terminal displays the user authentication screen.

[0928] The user enters their login ID and password.

[0929] 2. The user enters their authentication information. For example, they enter "user123" and "password123."

[0930] 3. The device sends the entered authentication information to the server.

[0931] The server checks the received authentication information against a database.

[0932] 4. The server returns the authentication result to the terminal. If the authentication is successful, proceed to the next step.

[0933] Choosing administrative procedures

[0934] 5. The terminal displays the administrative procedure category selection screen.

[0935] The user selects the procedure they wish to follow. Example: Select "Notification of Moving Out."

[0936] 6. The device sends the selection information to the server.

[0937] The server retrieves detailed information about the selected procedure from a database.

[0938] 7. The server sends the procedure information back to the terminal.

[0939] Example: Send information such as a list of documents required for submitting a moving-out notification, the location of the counter, and reception hours to the terminal.

[0940] Procedural input assistance

[0941] 8. The device will display the input form.

[0942] Provide users with fields to enter necessary information (e.g. new address, name, date of birth, etc.).

[0943] 9. The user enters the information.

[0944] The input is checked in real time to ensure there are no errors or omissions.

[0945] Emotion Recognition and Customization

[0946] 10. The device uses an emotion engine to recognize the user's emotions.

[0947] Emotion recognition is based on the user's facial expressions, tone of voice, and typing speed.

[0948] 11. The server generates appropriate guidance and messages based on the user's emotions based on the emotion engine.

[0949] Example: If the user seems anxious, display a supportive message such as "Is there anything I can help you with?"

[0950] Input validation and procedure completion notification

[0951] 12. After the device has completed all the input fields, it will display a submit button.

[0952] The user confirms and presses send.

[0953] 13. The terminal sends the entered information to the server.

[0954] The server will reconfirm the information and register it in the database.

[0955] 14. The server sends a procedure completion notification to the terminal.

[0956] The completion notice will include detailed information about the procedure.

[0957] 15. The device displays a confirmation screen, informing the user that the transaction was successfully completed.

[0958] 16. The server sends a confirmation email to the user, containing details of the transaction and next steps to take.

[0959] Emotion data logging and analysis

[0960] 17. The server stores the emotion data recognized by the emotion engine as a log.

[0961] This allows us to track user behavior history and emotional changes.

[0962] 18. The server analyzes the stored emotional data and uses it to improve procedures and enhance the user experience.

[0963] Specific examples

[0964] 1. Authentication Process

[0965] The device displays the authentication screen and the user enters "user123" and "password123".

[0966] The server receives the authentication information and returns a successful authentication after checking the database.

[0967] 2. Choice of administrative procedures

[0968] The device displays the category selection screen, and the user selects "Notification of Moving Out."

[0969] The server obtains detailed information about the moving-out notification and sends it to the terminal.

[0970] 3. Input Assistance and Emotion Recognition

[0971] The device displays an input form, and the user enters the new address information: "No. XX, XX-chome, Minato-ku, Tokyo."

[0972] The device validates input in real time and recognizes the user's emotions using an emotion engine.

[0973] The server provides appropriate guidance and messages based on emotion recognition.

[0974] 4. Complete the procedure

[0975] The user presses send and the device sends the data to the server.

[0976] The server registers the data, sends a notification of completion of the procedure to the terminal, and sends a confirmation email to the user.

[0977] The server stores and analyzes the emotional data in a log.

[0978] This invention not only enables users to complete administrative procedures efficiently and reliably, but also reduces the stress and anxiety they may feel during the process. The introduction of an emotion engine enables more personalized support, improving the user experience.

[0979] The processing flow will be explained below.

[0980] Step 1:

[0981] The terminal displays the user authentication screen, and the user enters their login ID and password.

[0982] Step 2:

[0983] The user enters their ID and password. For example, they enter "user123" and "password123."

[0984] Step 3:

[0985] The terminal sends the entered authentication information to the server, which then collates the received authentication information with a database and performs authentication.

[0986] Step 4:

[0987] The server returns the authentication result to the terminal. If the authentication is successful, proceed to the next step. If the authentication is unsuccessful, return an error message.

[0988] Step 5:

[0989] The device displays a screen for the user to select a category for administrative procedures. For example, it displays a list of categories such as "Acquisition of Resident Registration," "Notification of Moving Out," and "Certificate Issuance."

[0990] Step 6:

[0991] The user selects the procedure they wish to perform. For example, they select "Notification of Moving Out."

[0992] Step 7:

[0993] The terminal sends the selection information to the server, which retrieves detailed information about the selected procedure from a database.

[0994] Step 8:

[0995] The server sends back the procedure information to the terminal, such as a list of documents required for the moving-out notification, the location of the counter, and reception hours.

[0996] Step 9:

[0997] The device displays the necessary information to the user and allows the user to access input forms.

[0998] Step 10:

[0999] The user enters the required information, such as new address, name, date of birth, etc.

[1000] Step 11:

[1001] The terminal validates input in real time, checking address format and required fields, and providing feedback to the user if there are any errors.

[1002] Step 12:

[1003] The device activates an emotion engine to recognize the user's emotions as they are input, analyzing the user's facial expressions, tone of voice, and input speed.

[1004] Step 13:

[1005] The server generates appropriate guidance and messages based on the user's emotions recognized using an emotion engine. For example, if the user appears anxious, it will display a message such as "Would you like to consult a specialist?"

[1006] Step 14:

[1007] The device displays generated guides and messages to the user, assisting the user to smoothly proceed with operations.

[1008] Step 15:

[1009] After the user has completed all the input fields, they confirm the information and click the submit button.

[1010] Step 16:

[1011] The terminal sends the input information to the server, which then reconfirms the received information and registers it in the database.

[1012] Step 17:

[1013] The server sends a procedure completion notification to the terminal, which includes detailed procedure information.

[1014] Step 18:

[1015] The device displays a transaction completion screen, informing the user that the transaction was successfully completed.

[1016] Step 19:

[1017] The server will send a confirmation email to the user, containing details of the procedure and next steps to take.

[1018] Step 20:

[1019] The server stores the emotion data recognized by the emotion engine as a log, which allows users to track their operation history and changes in their emotions.

[1020] Step 20:

[1021] The server analyzes the stored emotional data and uses it to improve procedures and enhance the user experience.

[1022] Example 2

[1023] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1024] The problem with existing administrative procedure systems is that they provide uniform procedural guidelines without considering the user's emotions or stress level.In addition, there are cases where confirmation of user input and notification of procedure completion are delayed, which reduces the efficiency of the entire procedure.

[1025] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1026] In this invention, the server includes means for receiving authentication information entered by the user and performing authentication, means for providing a procedure screen to a user who has been successfully authenticated, means for obtaining information necessary for the selected procedure from an information storage device and providing it to the user, means for receiving the procedure details entered by the user and confirming the input, means for registering the successfully confirmed procedure details in the information storage device and notifying the user that the procedure has been completed, means for providing support based on the recognized emotion, and means for recording and analyzing emotion information. This allows the server to provide personalized support according to the user's emotions, reducing stress during the procedure and enabling the procedure to be completed efficiently.

[1027] "Authentication Information" refers to the ID and password entered by a user when accessing the system, or any other similar personal identification information.

[1028] The "procedure screen" is the interface for the user to input the details of the administrative procedure they have selected.

[1029] An "information storage device" is a database or storage system that stores information related to a procedure and allows data to be retrieved as needed.

[1030] "Input validation" refers to the process of checking whether the procedure details entered by the user are accurate and complete.

[1031] A "transaction completion notification" is a mechanism used to notify the user that the transaction has been successfully completed.

[1032] An "emotion processing mechanism" refers to the algorithms and hardware that recognize and analyze a user's emotions.

[1033] "Means for providing support based on emotions" refers to the system's ability to provide appropriate guidance or messages based on the user's recognized emotions.

[1034] "Emotional information" refers to data that indicates the user's emotional state, such as information obtained from facial expressions, tone of voice, and typing speed.

[1035] "Means of recording and analyzing" refers to the process of storing emotional information as a history and analyzing that data to help improve the user experience and the system.

[1036] The present invention is a system that helps users to efficiently carry out administrative procedures, and aims to improve the user experience by combining an emotion processing mechanism that recognizes the user's emotions. This system includes authentication functions, administrative procedure selection functions, input support functions, emotion recognition functions, and procedure completion notification functions.

[1037] Hardware and Software Configuration

[1038] The system uses the following hardware and software:

[1039] Server: Runs the database, authentication system, emotion processing mechanism, and procedure management system.

[1040] Device: The device that receives user input (PC, smartphone, tablet).

[1041] Database: Stores data related to administrative procedures (e.g., MySQL, PostgreSQL)

[1042] Emotion processing mechanism: Software used to recognize user emotions (e.g., OpenCV, TensorFlow)

[1043] Communication protocol: Used to send and receive data between the device and the server (e.g. HTTPS)

[1044] Specific processing flow of the system

[1045] 1. User authentication:

[1046] The device displays a user authentication screen, and the user enters their ID and password. The device then sends this information to the server.

[1047] The server checks the authentication information against a database and returns the result of authentication success or failure to the terminal.

[1048] 2. Choice of administrative procedure:

[1049] For users who have been successfully authenticated, the device displays a screen for selecting categories for administrative procedures.

[1050] The user selects the procedure they wish to perform and the device transmits the selection to the server.

[1051] 3. Input assistance:

[1052] The server retrieves the information required for the selected procedure from the database and sends it back to the terminal.

[1053] The terminal displays an input form and the user enters the required information.

[1054] 4. Emotion recognition:

[1055] The device uses an emotion processing mechanism to recognize the user's emotions based on facial expressions, voice tone, and input speed.

[1056] The server provides appropriate guidance and support based on the emotional information. For example, if the user seems anxious, it displays "Is there something I can help you with?"

[1057] 5. Notification of Completion of Procedure:

[1058] After the terminal completes all the input fields, it displays a submit button. When the user presses submit, the terminal sends the input data to the server.

[1059] The server checks the input data and registers it in the database, then sends a notification of completion of the procedure to the terminal and a confirmation email to the user.

[1060] 6. Emotional data logging and analysis:

[1061] The server stores the emotional data recognized by the emotion processing mechanism as a log and uses it to improve the user experience and procedures.

[1062] Specific examples

[1063] 1. Authentication Process:

[1064] The terminal displays the authentication screen, and the user enters "user123" and "password123." The server receives the authentication information, checks it against the database, and returns a successful authentication.

[1065] 2. Choice of administrative procedure:

[1066] The device displays a category selection screen, and the user selects "Notification of Moving Out." The server obtains detailed information about the notification of moving out and sends it to the device.

[1067] 3. Input assistance and emotion recognition:

[1068] The device displays an input form, and the user enters their new address, such as "No. XX, XX-chome, Minato-ku, Tokyo." The device validates the input in real time and recognizes the user's emotions using its emotion processing mechanism. The server then provides appropriate guidance and messages based on the emotion recognition.

[1069] 4. Complete the process:

[1070] The user presses send, and the device sends the data to the server. The server registers the data, sends a notification of completion to the device, and sends a confirmation email to the user. The server then stores the emotion data in a log and analyzes it.

[1071] Prompt Sentence Examples

[1072] After selecting "Notice of Moving Out," the message "Please contact us if you have any questions" will be displayed while you are entering the required information. Also, once the procedure is complete, the message "Thank you for completing the notification of moving out" will be displayed and a confirmation email will be sent.

[1073] In this way, the present invention not only enables users to complete administrative procedures efficiently and reliably, but also reduces the stress and anxiety they may feel during the process. The introduction of an emotion processing mechanism provides more personalized support and improves the user experience.

[1074] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1075] Step 1:

[1076] The device displays the user authentication screen.

[1077] The device displays a screen for the user to enter their login ID and password. The user can enter the ID as "user123" and the password as "password123" at any time.

[1078] Step 2:

[1079] The user enters their credentials.

[1080] The user enters their ID and password in the input fields displayed on the screen and presses the login button. The ID and password are provided to the terminal as input data.

[1081] Step 3:

[1082] The terminal transmits the entered authentication information to the server.

[1083] The terminal uses the HTTPS protocol to send the entered ID and password to the server, which receives this information and processes the authentication information by packaging the data in JSON format and sending it.

[1084] Step 4:

[1085] The server checks the credentials against a database.

[1086] The server compares the received authentication information with the database to verify that the ID and password match. Specifically, it executes an SQL query to search for the corresponding record in the database and determines whether the authentication is successful (e.g., SQL query "SELECT FROM users WHERE ID = 'user123' AND password = 'password123'").

[1087] Step 5:

[1088] The server returns the authentication result to the terminal.

[1089] The server sends the authentication result in JSON format to the terminal. If successful, it returns a "Authentication successful" response, and if unsuccessful, it returns a "Authentication failed" response.

[1090] Step 6:

[1091] The terminal displays a screen for selecting categories for administrative procedures.

[1092] If authentication is successful, the device displays a screen for selecting administrative procedures, such as a list of procedures such as "Notification of Moving Out," "Notification of Moving In," and "Obtaining a Copy of Residence Certificate."

[1093] Step 7:

[1094] The user selects an administrative procedure.

[1095] The user selects the administrative procedure they wish to carry out and presses the select button. The selected procedure (e.g., "Notification of Moving Out") is then provided to the terminal as input data.

[1096] Step 8:

[1097] The terminal transmits the selection information to the server.

[1098] The terminal sends the selected procedure information to the server. The server receives this information and processes it. Specifically, it sends the selected procedure category in JSON format.

[1099] Step 9:

[1100] The server retrieves the details of the procedure from a database.

[1101] The server retrieves detailed information about the specified procedure from the database, using an SQL query to retrieve relevant information (e.g., required documents, requirements, and office locations) (e.g., "SELECT FROM procedures WHERE type = 'Notification of Moving Out'").

[1102] Step 10:

[1103] The server sends the procedure information back to the terminal.

[1104] The server sends the acquired procedure information in JSON format to the terminal, which receives this information and displays it to the user.

[1105] Step 11:

[1106] The device displays the input form.

[1107] The device will then display a form where you can enter the necessary details, including your new address, name, date of birth, etc.

[1108] Step 12:

[1109] The user enters information.

[1110] The user enters the required information into each form field. For example, the new address is "No. XX, Minato-ku, Tokyo" and the name is "Taro Yamada." The input information is provided to the terminal.

[1111] Step 13:

[1112] The terminal validates the input in real time.

[1113] The device uses JavaScript and regular expressions to check the information entered in real time, for example, to ensure that the postal code is formatted correctly and that all required fields are filled in.

[1114] Step 14:

[1115] The device uses an emotion processing mechanism to recognize the user's emotions.

[1116] The device uses a camera and microphone to input the user's facial expressions, voice tone, and typing speed into emotion recognition algorithms, which use OpenCV and TensorFlow to analyze the emotion data.

[1117] Step 15:

[1118] The server generates appropriate guidance and messages based on the user's emotions based on the emotion processing mechanism.

[1119] The server uses the recognized emotion data to generate an appropriate support message, for example, "Is there anything I can help you with?" if the user appears anxious.

[1120] Step 16:

[1121] After the terminal has completed all the input fields, it will display a submit button.

[1122] If all required fields are filled in correctly, the terminal will enable a submit button. When the user presses submit, the data will be sent to the server.

[1123] Step 17:

[1124] The terminal transmits the input information to the server.

[1125] The terminal sends all input data to the server in JSON format.

[1126] Step 18:

[1127] The server will reconfirm the information and register it in the database.

[1128] The server checks the received data, verifies its accuracy, and then stores the information in the database (e.g., "INSERT INTO procedures (user_id, procedure_type, details) VALUES (...);").

[1129] Step 19:

[1130] The server sends a procedure completion notification to the terminal.

[1131] Once the registration in the database is complete, the server sends a notification of completion of the procedure to the terminal, along with detailed information about the procedure to the user.

[1132] Step 20:

[1133] The device will display a completion screen.

[1134] The device will display a screen informing the user that the procedure is complete.

[1135] Step 21:

[1136] The server sends a confirmation email to the user.

[1137] The server will then send a confirmation email to the user, detailing the process and the next steps to take.

[1138] Step 22:

[1139] The server stores the emotion data recognized by the emotion processing mechanism as a log.

[1140] The server stores the user's emotional data as a log and accumulates it for future analysis.

[1141] Step 23:

[1142] The server analyzes the stored emotional data and uses it to improve procedures and enhance the user experience.

[1143] The server analyzes the emotional data and identifies areas for improvement to improve the user experience and streamline procedures.

[1144] (Application example 2)

[1145] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1146] Conventional administrative procedure systems lack support that takes into account the user's emotions regarding the procedure, and no method has been established to reduce stress and anxiety during the procedure. Furthermore, even in physical stores, there are no systems that can recognize customer emotions in real time and provide appropriate customer service guidance or recommended products. This can result in a lack of improvement in the user and customer experience, leaving them dissatisfied.

[1147] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1148] In this invention, the server includes means for receiving authentication information entered by a user and performing authentication, means for providing a screen for selecting an administrative procedure to a user who has been successfully authenticated, means for retrieving information necessary for the selected administrative procedure from a database and providing it to the user, means for receiving procedure details entered by the user and performing validation, means for registering successfully validated procedure details in a database and notifying the user that the procedure has been completed, means for performing emotion recognition and presenting customer service guides and recommended products based on the recognized emotion data, and means for saving and analyzing the recognized emotion data as a log. This allows for the provision of personalized support according to the emotions of users and customers, reducing stress during procedures and improving the customer experience.

[1149] "User" refers to an individual or corporation that uses this system to receive administrative procedures or services.

[1150] "Authentication Information" means information such as a user ID and password that a user provides to access a system.

[1151] "Authentication means" refers to technology or devices that receive authentication information provided by a user and verify its validity.

[1152] "Administrative procedures" refers to various official procedures and applications that users carry out online or in physical locations.

[1153] A "database" is an information system for storing and managing administrative procedures and user information.

[1154] "Validation" is the process of ensuring that the information entered by the user is accurate and complete.

[1155] "Notification means" refers to the methods and techniques used to notify users of the completion of procedures and other important information.

[1156] "Emotion recognition" is a technology that infers a user's emotions from their facial expressions, tone of voice, etc.

[1157] A "guide" is a guide or instruction that helps users or customers to smoothly proceed with procedures or services.

[1158] "Recommended products" are products or services selected by the system based on the customer's emotions and preferences.

[1159] "Log" is data for recording the system's operation history and recognized emotion data.

[1160] "Analysis" is the process of analyzing data stored as logs and deriving patterns and trends.

[1161] System Overview

[1162] This invention is a system that allows users to efficiently complete administrative procedures, and aims to improve the user and customer experience by combining it with an emotion recognition engine. The system for implementing the invention includes means for user authentication, selection of administrative procedures, provision of necessary information, validation of procedure content, notification of procedure completion, emotion recognition, presentation of guides, display of recommended products, and logging and analysis of emotion data.

[1163] Hardware and software used

[1164] Hardware:

[1165] Devices (smartphones, smart glasses, head-mounted displays, robots, etc.)

[1166] server

[1167] software:

[1168] Authentication system: Authentication is performed using user ID and password.

[1169] Database system: A management system for managing administrative procedures and user information.

[1170] Emotion recognition engine: Recognizes emotions from the user's facial expressions and tone of voice.

[1171] Product recommendation system: Recommend products based on user sentiment and preferences.

[1172] Log management system: Stores and analyzes operation history and emotional data.

[1173] Explanation of program processing

[1174] Authentication process

[1175] The server receives the authentication information entered by the user and verifies it against the information in the database. At this time, the terminal displays an authentication screen and the user enters their ID and password. If authentication is successful, the process proceeds to the next step.

[1176] Selection of administrative procedures and provision of information

[1177] For users who have been successfully authenticated, the terminal displays a screen for selecting administrative procedures. The user selects the procedure they wish to use and sends that information to the server. The server then retrieves the necessary information (e.g., required documents, reception location, etc.) from the database and sends it back to the terminal.

[1178] Input support and validation of procedure details

[1179] When a user enters the required information into the input form, the terminal performs real-time validation. Information that passes validation is sent to the server and registered in the database. The user is then notified that the procedure has been completed.

[1180] Emotion Recognition and Personalized Guidance

[1181] The device uses an emotion recognition engine to recognize the user's emotions from their facial expressions and tone of voice. This information is sent to the server, which then displays the most appropriate guidance and product recommendations based on the user's emotions. For example, if the user is feeling anxious, the server will display a support message asking, "Is there anything I can help you with?"

[1182] Emotion data logging and analysis

[1183] The server stores the emotion data recognized by the emotion recognition engine as a log, which is then analyzed to improve future procedures and user experience.

[1184] Specific examples

[1185] For example, in a physical store, when a store staff member wearing smart glasses interacts with a customer, the emotion recognition engine analyzes the customer's emotions in real time. For example, if the customer is smiling, the smart glasses will display a message saying, "The customer seems to be in a good mood. Please recommend a new wine." The staff member can then follow the guidance displayed on the glasses to improve the customer experience.

[1186] Example prompts to input to a generative AI model:

[1187] Prototype a smart glasses application that recognizes emotions from a customer's facial expressions and tone of voice, and provides real-time guidance and product recommendations.

[1188] 1. Customer Authentication

[1189] 2. Real-time emotion recognition

[1190] 3. Guidance based on recognition results

[1191] 4. Emotional data logging

[1192] In summary, this system will enable users and customers to enjoy a better experience by reducing stress when undergoing procedures and receiving services.

[1193] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1194] Step 1:

[1195] The device displays an authentication screen and the user enters their authentication information.

[1196] Input: User ID and password

[1197] How it works: The device receives user input and sends it to the server.

[1198] Output: Authentication information is sent to the server.

[1199] Step 2:

[1200] The server checks the received authentication information against a database and returns the authentication result.

[1201] Input: User ID and password

[1202] What happens: The server contacts the database and verifies that the credentials match.

[1203] Output: The result of authentication success or failure is sent to the terminal.

[1204] Step 3:

[1205] For users who have been successfully authenticated, the device displays a screen for selecting categories for administrative procedures.

[1206] Input: Authentication success result

[1207] Operation: The terminal generates and displays a category selection screen for administrative procedures.

[1208] Output: The administrative procedure selection screen is displayed.

[1209] Step 4:

[1210] The user selects the desired administrative procedure, and the terminal transmits the selection information to the server.

[1211] Input: Selected information for administrative procedures

[1212] Operation: The device receives the information selected by the user and sends it to the server.

[1213] Output: The selection information is sent to the server.

[1214] Step 5:

[1215] The server retrieves detailed information about the selected administrative procedure from a database and sends it back to the terminal.

[1216] Input: Selection information

[1217] Operation: The server accesses the database and retrieves the necessary procedural information.

[1218] Output: The acquired procedure information is sent to the terminal.

[1219] Step 6:

[1220] The terminal displays the procedure information it has acquired, and the user enters the necessary information.

[1221] Input:Procedure information

[1222] Operation: The device generates an input form and displays it to the user. The user enters the required information.

[1223] Output: User input is saved to the device.

[1224] Step 7:

[1225] The device uses an emotion recognition engine to recognize the user's emotions in real time.

[1226] Input: User's facial expressions, tone of voice

[1227] How it works: The device uses an emotion recognition engine to analyze the data and recognize the user's emotions.

[1228] Output: User emotion data is obtained.

[1229] Step 8:

[1230] The server displays appropriate guides and recommended products to the user based on the emotional data.

[1231] Input: Emotion data

[1232] How it works: The server processes the acquired emotional data and generates the best guide and recommended products for the user.

[1233] Output: Guide and recommended product information is sent to the device.

[1234] Step 9:

[1235] The device displays guides and recommended products to the user, who then completes the input.

[1236] Input: Guide and recommended product information

[1237] Action: The terminal displays the information and the user completes the transaction.

[1238] Output: The completed input is saved to the device.

[1239] Step 10:

[1240] The terminal sends the completed procedure details to the server and performs validation.

[1241] Input: Completed procedure details

[1242] Operation: The terminal sends the procedure details to the server, which then validates them.

[1243] Output: The validation result is generated.

[1244] Step 11:

[1245] The server registers the procedure details that have been successfully validated in a database and sends a completion notification to the terminal.

[1246] Input: Validation result

[1247] Operation: The server registers the procedure details in the database, generates a completion notice, and sends it to the terminal.

[1248] Output: A notification of completion of the procedure is sent to the terminal.

[1249] Step 12:

[1250] The terminal displays a notification to the user that the procedure has been completed, and the server sends a confirmation email.

[1251] Input: Procedure completion notification

[1252] What happens: The device displays a notification and the server sends a confirmation email to the user.

[1253] Output: The user will receive a notification and a confirmation email.

[1254] Step 13:

[1255] The server stores the recognized emotion data as a log and uses it for future analysis.

[1256] Input: Emotion data

[1257] How it works: The server uses a log management system to store emotion data and manage it in an analyzable format.

[1258] Output: Emotion data is saved as a log.

[1259] The above are the specific processing steps of the system that realizes the application example. By accurately understanding the processing content of each step and its input and output, you can understand the overall picture of the system and implement it effectively.

[1260] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1261] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1262] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1263] [Third embodiment]

[1264] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1265] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1266] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1267] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1268] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1269] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1270] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1271] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1272] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1273] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1274] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1275] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1276] The present invention is a system that supports users in efficiently performing administrative procedures. This system includes means for receiving authentication information entered by a user and performing authentication, means for providing a screen for selecting an administrative procedure to a user who has been successfully authenticated, means for retrieving information necessary for the selected administrative procedure from a database and providing the information to the user, means for receiving and validating the procedure details entered by the user, and means for registering the successfully validated procedure details in the database and notifying the user of the completion of the procedure.

[1277] Overview of program processing flow

[1278] User authentication

[1279] 1. The terminal displays the user authentication screen.

[1280] The user enters their login ID and password.

[1281] 2. The device sends the authentication information entered by the user to the server.

[1282] The server checks the authentication information against a database to verify its validity.

[1283] 3. The server returns the authentication result to the terminal.

[1284] If the authentication is successful, proceed to the next step.

[1285] Choosing administrative procedures

[1286] 4. The terminal displays the administrative procedure category selection screen.

[1287] The user selects the procedure they wish to follow.

[1288] Example: Select "Notification of Moving Due to Moving."

[1289] 5. The device sends the selection information to the server.

[1290] The server retrieves detailed information about the selected procedure from a database.

[1291] 6. The server sends the procedure information back to the terminal.

[1292] Examples: a list of documents required for the moving-out notification, the location of the office, opening hours, etc.

[1293] Procedural input assistance

[1294] 7. The device will display the input form.

[1295] Provide users with fields to enter necessary information (e.g. new address, name, date of birth, etc.).

[1296] 8. The user enters the information.

[1297] The input is checked in real time to ensure there are no errors or omissions.

[1298] For example, when you enter your "new address," it will immediately check that it is in the correct format.

[1299] Input validation and procedure completion notification

[1300] 9. After the device has completed all the input fields, it will display a submit button.

[1301] The user confirms and presses send.

[1302] 10. The terminal sends the entered information to the server.

[1303] The server will reconfirm the information and register it in the database.

[1304] 11. The server sends a notification of completion of the procedure to the terminal and a confirmation email to the user.

[1305] The terminal will display a message to the user saying "The procedure is complete," and the entire process will be completed.

[1306] Specific examples

[1307] 1. Authentication Process

[1308] The device displays the authentication screen and the user enters "user123" and "password123".

[1309] The server receives the authentication information and returns a successful authentication after checking the database.

[1310] 2. Choice of administrative procedures

[1311] The device displays the category selection screen, and the user selects "Notification of Moving Out."

[1312] The server obtains detailed information about the moving-out notification and sends it to the terminal.

[1313] 3. Input assistance

[1314] The device displays an input form, and the user enters their new address as "No. XX, XX-chome, Minato-ku, Tokyo."

[1315] A format check is performed in real time, and if the format is correct, proceed to the next step.

[1316] 4. Complete the procedure

[1317] The user presses send and the device sends the data to the server.

[1318] The server registers the data, sends a notification of completion of the procedure to the terminal, and sends a confirmation email to the user.

[1319] This system allows users to complete administrative procedures efficiently and reliably, supporting them at each step of the process and significantly reducing the burden of the process.

[1320] The processing flow will be explained below.

[1321] Step 1:

[1322] The terminal displays the user authentication screen, and the user enters their login ID and password.

[1323] Step 2:

[1324] The user enters their ID and password. For example, they enter "user123" and "password123."

[1325] Step 3:

[1326] The terminal sends the entered authentication information to the server, which then checks the received authentication information against its database.

[1327] Step 4:

[1328] The server returns the authentication result to the terminal. If the authentication is successful, proceed to the next step. If the authentication is unsuccessful, return an error message.

[1329] Step 5:

[1330] The device displays a screen for the user to select a category for administrative procedures. For example, it displays a list of categories such as "Acquisition of Resident Registration," "Notification of Moving Out," and "Certificate Issuance."

[1331] Step 6:

[1332] The user selects the procedure they wish to perform. For example, they select "Notification of Moving Out."

[1333] Step 7:

[1334] The terminal sends the selection information to the server, which retrieves detailed information about the selected procedure from a database.

[1335] Step 8:

[1336] The server sends back the procedure information to the terminal, such as a list of documents required for the moving-out notification, the location of the counter, and reception hours.

[1337] Step 9:

[1338] The device displays the necessary information to the user and allows the user to access input forms.

[1339] Step 10:

[1340] The user enters the required information, such as new address, name, date of birth, etc.

[1341] Step 11:

[1342] The terminal validates input in real time, checking address format and required fields, and providing feedback to the user if there are any errors.

[1343] Step 12:

[1344] After the user has completed all the input fields, they check the information and click the submit button.

[1345] Step 13:

[1346] The terminal sends the input information to the server, which then reconfirms the received information and registers it in the database.

[1347] Step 14:

[1348] The server sends a notification to the terminal that the procedure has been completed. The notification includes detailed information about the procedure.

[1349] Step 15:

[1350] The device displays a transaction completion screen, informing the user that the transaction was successfully completed.

[1351] Step 16:

[1352] The server will send a confirmation email to the user, containing details of the procedure and next steps to take.

[1353] Example 1

[1354] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1355] In current administrative procedures, users often experience delays due to cumbersome procedures and incomplete documentation. Furthermore, because information is not checked or validated in real time, users may enter incorrect information and be required to resubmit the procedure. This not only wastes users' time and effort, but also reduces administrative processing efficiency. There is a need for improved system usability and user experience, especially for online procedures.

[1356] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1357] In this invention, the server includes means for receiving authentication information entered by a user and verifying it against a database for authentication; means for displaying a category selection screen and providing a screen for selecting an administrative procedure to a user who has been successfully authenticated; means for retrieving information necessary for the selected administrative procedure from the database and providing it to the user; means for receiving the procedure details entered by the user, performing a format check and validation in real time; and means for registering successfully validated procedure details in the database and notifying the user that the procedure has been completed. This enables users to perform administrative procedures online accurately and efficiently. Furthermore, real-time input checks and validations allow input errors to be detected early and prevent resubmission, thereby speeding up the procedure.

[1358] "User authentication" is the process in which a system receives authentication information, such as an ID and password, entered by a user and checks its validity against a database.

[1359] The "category selection screen" is an interface for selecting administrative procedures that is displayed to users who have been successfully authenticated.

[1360] "Database" means a digital storage system that stores user authentication information and information required for selected administrative procedures.

[1361] "User input" refers to the act of a user entering information required for a procedure through an interface such as a form.

[1362] "Real-time format checking" is the process of instantly verifying that the information entered by the user is in the correct format and displaying a warning if there are any errors.

[1363] "Validation" is the process of ensuring that user-entered data is accurate and contains all required information.

[1364] A "procedure completion notification" is a message that notifies the user that the procedure has been completed after the procedure details that have been successfully validated have been registered in the database.

[1365] A "confirmation email" is a notification sent to the user via email that the process has been completed.

[1366] The present invention is a system that helps users efficiently complete administrative procedures online. This system has multiple functions for user authentication, administrative procedure selection, procedure content input support, validation, and procedure completion notification.

[1367] This system is mainly composed of a server, a terminal, and a database. Below are the specific names of each piece of hardware and software, as well as details of each process.

[1368] User authentication

[1369] First, the terminal displays a user authentication screen. The user enters their login ID and password here, and the terminal sends the entered authentication information to the server. The server receives this information and performs authentication by checking it against a database such as OpenLDAP or MySQL. If authentication is successful, the server returns the authentication result to the terminal and proceeds to the next step.

[1370] Choosing administrative procedures

[1371] For users who have been successfully authenticated, the terminal displays a screen for selecting administrative procedures. When the user selects the appropriate procedure, the selection information is sent from the terminal to the server. The server retrieves the information necessary for the selected administrative procedure from a database such as PostgreSQL and sends it back to the terminal. For example, if a notification of moving out is selected, detailed information such as a list of required documents, the location of the counter, and reception hours is provided.

[1372] Procedural input assistance

[1373] Next, the terminal displays an input form and the user enters the necessary information (e.g., new address, name, date of birth, etc.). At this time, the terminal checks the format of the input in real time. For example, when "new address" is entered, the format is immediately confirmed and a warning is displayed if it is incorrect.

[1374] Validation and procedure completion notification

[1375] When the user completes all the input fields and presses the send button, the terminal sends the entered information to the server. The server then checks this information again and validates that the format and content are correct. If validation is successful, the information is registered in the database. Finally, the server notifies the terminal that the procedure is complete and sends a confirmation email to the user. The terminal displays a message saying "The procedure has been completed," and the entire procedure is complete.

[1376] Specific examples

[1377] 1. Authentication Process:

[1378] The device displays the authentication screen and the user enters "user123" and "password123."

[1379] The server receives the authentication information, checks it against a database, and returns a successful authentication.

[1380] 2. Choice of administrative procedure:

[1381] The device displays a category selection screen, and the user selects "Notification of Moving Out."

[1382] The server obtains detailed information about the moving-out notification and sends it to the terminal.

[1383] 3. Input assistance:

[1384] The device displays an input form, and the user enters the new address as "No. XX, XX-chome, Minato-ku, Tokyo."

[1385] A format check is performed in real time, and if the format is correct, proceed to the next step.

[1386] 4. Complete the process:

[1387] The user presses send and the device sends the data to the server.

[1388] The server registers the data, sends a notification of completion of the procedure to the terminal, and sends a confirmation email to the user.

[1389] This system allows users to complete administrative procedures online efficiently and reliably. Real-time input checks and validations prevent the entry of inaccurate information, enabling faster procedures.

[1390] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1391] Step 1:

[1392] Enter and submit user credentials

[1393] The device displays the user authentication screen. The user enters their login ID and password, and the device sends the entered authentication information to the server.

[1394] Input: The user enters the ID "user123" and password "password123".

[1395] Data processing and calculation: The terminal encrypts the authentication information using AES and sends it to the server.

[1396] Output: Encrypted authentication information sent to the server.

[1397] Specific behavior:

[1398] The device will display the message "Please enter your ID and password."

[1399] The user enters the ID "user123" and password "password123".

[1400] The terminal encrypts the input information with AES.

[1401] The device sends the encrypted information to the server.

[1402] Step 2:

[1403] Authentication verification

[1404] The server checks the received authentication information against a database to verify its validity.

[1405] Input: Encrypted credentials.

[1406] Data processing and calculation: The server decrypts the AES encryption and retrieves the corresponding user information from the database (e.g., MySQL). It compares the information to verify its authenticity.

[1407] Output: Generates authentication results and returns them to the terminal.

[1408] Specific behavior:

[1409] The server receives the encrypted authentication information.

[1410] The server decrypts the AES encryption and extracts the ID and password.

[1411] The server retrieves the relevant user information from the database.

[1412] The server compares the authentication information with the database information to verify its validity.

[1413] The server generates an authentication result.

[1414] The server sends the authentication result to the terminal.

[1415] Step 3:

[1416] Viewing the authentication result and proceeding to the next step

[1417] The device displays the authentication result sent by the server, and if the authentication is successful, the user proceeds to the next step.

[1418] Input: The authentication result from the server.

[1419] Data processing and calculation: None in particular.

[1420] Output: Display the authentication result on the screen.

[1421] Specific behavior:

[1422] The terminal receives the authentication result from the server.

[1423] If the authentication is successful, the message "Authentication successful" is displayed.

[1424] If authentication fails, the message "Authentication failed. Please try again" is displayed.

[1425] Step 4:

[1426] Choosing administrative procedures

[1427] The device displays a screen for selecting administrative procedures. The user selects the procedure they wish to follow.

[1428] Input: User selection information.

[1429] Data processing and calculation: None in particular.

[1430] Output: Sends the user's selection to the server.

[1431] Specific behavior:

[1432] The device will display the message "Please select a procedure category."

[1433] The user selects "Notification of Moving Out."

[1434] The terminal transmits the selection information to the server.

[1435] Step 5:

[1436] Sending selection information and obtaining procedure information

[1437] The server retrieves the information required for the selected procedure from the database and sends it to the terminal.

[1438] Input: User selection information.

[1439] Data processing and calculation: The server retrieves the necessary information from the database (e.g., PostgreSQL).

[1440] Output: Sends procedural information to the terminal.

[1441] Specific behavior:

[1442] The server receives the selection information sent by the terminal.

[1443] The server retrieves the information required for the procedure from the database.

[1444] The server transmits the acquired information to the terminal.

[1445] Step 6:

[1446] Displaying procedural information and providing input forms

[1447] The terminal provides the user with the procedure information and displays an input form, which the user fills in.

[1448] Input: The procedure entered by the user.

[1449] Data processing and calculation: The terminal performs format checks in real time.

[1450] Output: Shows the user in real time whether the format is correct.

[1451] Specific behavior:

[1452] The terminal displays the procedural information it has acquired (e.g., list of required documents, location of counter, etc.).

[1453] The terminal displays a form for entering the procedure details.

[1454] The user enters their new address, name, and date of birth.

[1455] Checks forms for correct formatting as you fill them out and displays warnings if there are any errors.

[1456] Step 7:

[1457] Submitting input and final validation

[1458] The terminal sends the user's input to the server, which performs final validation.

[1459] Input: All the procedures entered by the user.

[1460] Data processing and calculation: The server will double-check all data to ensure the accuracy of the format and content.

[1461] Output: Generate validation results and prepare them for registration in the database.

[1462] Specific behavior:

[1463] The user completes all the input and presses the submit button.

[1464] The device sends the input to the server.

[1465] The server revalidates the data received to ensure there are no problems.

[1466] Data that passes validation is registered in the database.

[1467] Step 8:

[1468] Notification of completion of procedure and sending of confirmation email

[1469] The server sends a notification of completion of the procedure to the terminal and a confirmation email to the user.

[1470] Input: The procedure that was successfully validated.

[1471] Data processing and calculation: None in particular.

[1472] Output: Sends a completion notification to the terminal and a confirmation email to the user.

[1473] Specific behavior:

[1474] The server generates a procedure completion notification.

[1475] The server sends a message to the terminal saying "The procedure is complete."

[1476] The server sends a confirmation email to the user.

[1477] The device displays the completion notification to the user.

[1478] This allows users to efficiently complete all procedures online.

[1479] (Application example 1)

[1480] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1481] When carrying out administrative procedures, users face challenges such as long wait times at local counters and the time it takes to gather the information necessary for the procedure. Additionally, it is inconvenient for users to not be able to track the progress of the procedure in real time. These challenges are particularly pronounced when carrying out procedures at brick-and-mortar locations such as city halls and ward offices. Another problem is that if an input error or omission occurs in the procedure details, it is not possible to quickly correct it.

[1482] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1483] In this invention, the server includes: means for receiving authentication information entered by a user and performing authentication; means for providing a screen for selecting an administrative procedure to a user who has been successfully authenticated; means for retrieving information necessary for the selected administrative procedure from a database and providing it to the user; means for receiving and validating the procedure details entered by the user; means for registering successfully validated procedure details in a database and notifying the user that the procedure has been completed; means for the user to scan an identification code installed at an administrative facility and log in using the scan results; and means for displaying the progress of the procedure to the user in real time. This reduces waiting time for users on-site, allows them to quickly obtain the information they need, and allows them to check the progress of the procedure in real time. Furthermore, the ability to check and correct input information in real time improves the accuracy of the procedure and reduces the burden on the user.

[1484] "User authentication" is the process by which a user enters their identity information, which is then verified by the system.

[1485] "Administrative procedures" are procedures through which users submit applications or notifications to public institutions such as government agencies.

[1486] A "database" is a structured collection of data that allows information to be efficiently stored, managed, and retrieved.

[1487] "Validation" is the process of checking whether the entered data is of the correct format and content.

[1488] The "procedure completion notification" is a message to inform the user that the procedure has been completed successfully.

[1489] "Scanning an identification code" refers to the act of reading a code such as a QR code or barcode with a device and recognizing the information contained therein.

[1490] "Logging in" is the process by which a user enters authentication information and has their authentication accepted in order to access a system.

[1491] "Procedure progress display" is a function that displays the status and progress of ongoing procedures to users in real time.

[1492] "Real-time validation" is a process in which data entered by a user is verified instantly.

[1493] "Administrative facilities" are public buildings that provide administrative services, such as city halls and ward offices.

[1494] To implement this invention, the server, the terminal (such as a smartphone or tablet), and the user must each play their respective appropriate roles. Specific operation methods for each step are described below.

[1495] User authentication

[1496] First, the user scans the identification code installed at the city hall or ward office with the terminal and performs the authentication procedure using the result. The server receives this information and checks it against the database to verify the authenticity of the authentication. If the authentication is successful, the terminal proceeds to the next step.

[1497] Hardware and software used

[1498] Hardware: Smartphone with QR code reader

[1499] Software: iOS or Android application, SQLite database, Flask server

[1500] Specific examples

[1501] The user scans the QR code displayed at the city hall counter with their smartphone and logs in by entering "user123" and "password123."

[1502] Choosing administrative procedures

[1503] After successful authentication, the terminal displays a screen for the user to select the administrative procedure. The user selects the procedure they want and the information is sent to the server. The server retrieves the information required for the selected procedure from the database and provides it to the terminal.

[1504] Hardware and software used

[1505] Hardware: Smartphone

[1506] Software: iOS or Android application, Flask server

[1507] Specific examples

[1508] The user selects "Notification of Moving Out" and the information is sent to the server. The server retrieves the list of documents required for the notification and detailed information from the database and returns them to the terminal.

[1509] Enter the required information

[1510] The terminal provides the user with a form to enter the information required for the selected procedure. As the user enters the information, validation is performed in real time, and any confirmation or correction of the input is reflected immediately.

[1511] Hardware and software used

[1512] Hardware: Smartphone

[1513] Software: iOS or Android application, Flask server

[1514] Specific examples

[1515] The user enters their new address as "No. XX, XX-chome, Minato-ku, Tokyo," and the format is instantly checked. If the format is correct, they proceed to the next step.

[1516] Notification of completion of procedure

[1517] Once all the information has been entered, the user presses the send button, and the device sends the information to the server. The server then checks the information again, registers it in the database, and notifies the device that the procedure has been completed. At the same time, a confirmation email is sent to the user.

[1518] Hardware and software used

[1519] Hardware: Smartphones, servers

[1520] Software: iOS or Android application, Flask server, mail server

[1521] Specific examples

[1522] The user submits the information, the server registers the data in the database, the terminal displays a message saying "The procedure is complete," and a confirmation email is sent to the user.

[1523] Prompt sentence for generative AI model

[1524] Below are some example prompts to be input to the generative AI model:

[1525] I would like to scan a QR code at the city hall counter to complete the authentication process. Please tell me how to scan the QR code using a smartphone, and how to create a series of steps from logging in, selecting a procedure, entering the necessary information, and receiving a notification that the procedure has been completed.

[1526] This system allows users to complete procedures at city halls and ward offices quickly and efficiently. Users can reduce waiting times on-site and easily obtain the information they need. In addition, the system allows users to check and correct input information in real time, improving the accuracy of procedures and reducing the burden on users.

[1527] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1528] Step 1:

[1529] The user scans the identification code installed in the government facility. The user reads the identification code using a QR code reader on their smartphone. This input data is sent to the terminal and then sent to the server as authentication information.

[1530] Step 2:

[1531] The server receives the authentication information and checks it against the database. The server compares the entered authentication information with the database to verify the user's authenticity. If authentication is successful, the server returns a message indicating successful authentication to the terminal.

[1532] Step 3:

[1533] After successful authentication, the terminal displays a screen for the user to select an administrative procedure. The user selects the administrative procedure from the list and enters the relevant information. This input data is sent to the server.

[1534] Step 4:

[1535] The server retrieves the information required for the procedure selected by the user from a database. The server retrieves the relevant information from the database and returns it to the terminal. The information displayed on the terminal includes a list of documents required for the procedure and detailed information.

[1536] Step 5:

[1537] The terminal displays a form for the user to enter the required information. The user enters the information into the form and the data is validated in real time. If any inaccurate or missing data is found during this process, the terminal provides immediate feedback and the user can make corrections.

[1538] Step 6:

[1539] After completing the input, the user presses the send button. The terminal sends the input information to the server. The server checks the information again and saves it in the database. A notification that the procedure is complete is then sent to the terminal and displayed to the user. A confirmation email is also sent to the user.

[1540] Step 7:

[1541] After the transaction is completed, the terminal will display the transaction progress to the user in real time. The server will update the transaction status at each stage and send it to the terminal, allowing the user to have an overall understanding of the transaction.

[1542] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1543] The present invention is a system that supports users in efficiently performing administrative procedures, and aims to improve the user experience by combining it with an emotion engine that recognizes the user's emotions. This system includes means for receiving authentication information entered by the user and performing authentication, means for providing a screen for selecting an administrative procedure to a user who has been successfully authenticated, means for retrieving information necessary for the selected administrative procedure from a database and providing the user with the information, means for receiving the procedure details entered by the user and validating it, and means for registering the successfully validated procedure details in the database and notifying the user that the procedure has been completed.

[1544] Furthermore, it is equipped with an emotion engine that recognizes the user's emotions and has the ability to customize procedural guidance and support based on the user's emotions. It also includes a means to adaptively change the operation screen and messages according to the user's emotions, and a means to save and analyze the recognized emotion data as a log.

[1545] Overview of program processing flow

[1546] User authentication

[1547] 1. The terminal displays the user authentication screen.

[1548] The user enters their login ID and password.

[1549] 2. The user enters their authentication information. For example, they enter "user123" and "password123."

[1550] 3. The device sends the entered authentication information to the server.

[1551] The server checks the received authentication information against a database.

[1552] 4. The server returns the authentication result to the terminal. If the authentication is successful, proceed to the next step.

[1553] Choosing administrative procedures

[1554] 5. The terminal displays the administrative procedure category selection screen.

[1555] The user selects the procedure they wish to follow. Example: Select "Notification of Moving Out."

[1556] 6. The device sends the selection information to the server.

[1557] The server retrieves detailed information about the selected procedure from a database.

[1558] 7. The server sends the procedure information back to the terminal.

[1559] Example: Send information such as a list of documents required for submitting a moving-out notification, the location of the counter, and reception hours to the terminal.

[1560] Procedural input assistance

[1561] 8. The device will display the input form.

[1562] Provide users with fields to enter necessary information (e.g. new address, name, date of birth, etc.).

[1563] 9. The user enters the information.

[1564] The input is checked in real time to ensure there are no errors or omissions.

[1565] Emotion Recognition and Customization

[1566] 10. The device uses an emotion engine to recognize the user's emotions.

[1567] Emotion recognition is based on the user's facial expressions, tone of voice, and typing speed.

[1568] 11. The server generates appropriate guidance and messages based on the user's emotions based on the emotion engine.

[1569] Example: If the user seems anxious, display a supportive message such as "Is there anything I can help you with?"

[1570] Input validation and procedure completion notification

[1571] 12. After the device has completed all the input fields, it will display a submit button.

[1572] The user confirms and presses send.

[1573] 13. The terminal sends the entered information to the server.

[1574] The server will reconfirm the information and register it in the database.

[1575] 14. The server sends a procedure completion notification to the terminal.

[1576] The completion notice will include detailed information about the procedure.

[1577] 15. The device displays a confirmation screen, informing the user that the transaction was successfully completed.

[1578] 16. The server sends a confirmation email to the user, containing details of the transaction and next steps to take.

[1579] Emotion data logging and analysis

[1580] 17. The server stores the emotion data recognized by the emotion engine as a log.

[1581] This allows us to track user behavior history and emotional changes.

[1582] 18. The server analyzes the stored emotional data and uses it to improve procedures and enhance the user experience.

[1583] Specific examples

[1584] 1. Authentication Process

[1585] The device displays the authentication screen and the user enters "user123" and "password123".

[1586] The server receives the authentication information and returns a successful authentication after checking the database.

[1587] 2. Choice of administrative procedures

[1588] The device displays the category selection screen, and the user selects "Notification of Moving Out."

[1589] The server obtains detailed information about the moving-out notification and sends it to the terminal.

[1590] 3. Input Assistance and Emotion Recognition

[1591] The device displays an input form, and the user enters the new address information: "No. XX, XX-chome, Minato-ku, Tokyo."

[1592] The device validates input in real time and recognizes the user's emotions using an emotion engine.

[1593] The server provides appropriate guidance and messages based on emotion recognition.

[1594] 4. Complete the procedure

[1595] The user presses send and the device sends the data to the server.

[1596] The server registers the data, sends a notification of completion of the procedure to the terminal, and sends a confirmation email to the user.

[1597] The server stores and analyzes the emotional data in a log.

[1598] This invention not only enables users to complete administrative procedures efficiently and reliably, but also reduces the stress and anxiety they may feel during the process. The introduction of an emotion engine enables more personalized support, improving the user experience.

[1599] The processing flow will be explained below.

[1600] Step 1:

[1601] The terminal displays the user authentication screen, and the user enters their login ID and password.

[1602] Step 2:

[1603] The user enters their ID and password. For example, they enter "user123" and "password123."

[1604] Step 3:

[1605] The terminal sends the entered authentication information to the server, which then collates the received authentication information with a database and performs authentication.

[1606] Step 4:

[1607] The server returns the authentication result to the terminal. If the authentication is successful, proceed to the next step. If the authentication is unsuccessful, return an error message.

[1608] Step 5:

[1609] The device displays a screen for the user to select a category for administrative procedures. For example, it displays a list of categories such as "Acquisition of Resident Registration," "Notification of Moving Out," and "Certificate Issuance."

[1610] Step 6:

[1611] The user selects the procedure they wish to perform. For example, they select "Notification of Moving Out."

[1612] Step 7:

[1613] The terminal sends the selection information to the server, which retrieves detailed information about the selected procedure from a database.

[1614] Step 8:

[1615] The server sends back the procedure information to the terminal, such as a list of documents required for the moving-out notification, the location of the counter, and reception hours.

[1616] Step 9:

[1617] The device displays the necessary information to the user and allows the user to access input forms.

[1618] Step 10:

[1619] The user enters the required information, such as new address, name, date of birth, etc.

[1620] Step 11:

[1621] The terminal validates input in real time, checking address format and required fields, and providing feedback to the user if there are any errors.

[1622] Step 12:

[1623] The device activates an emotion engine to recognize the user's emotions as they are input, analyzing the user's facial expressions, tone of voice, and input speed.

[1624] Step 13:

[1625] The server generates appropriate guidance and messages based on the user's emotions recognized using an emotion engine. For example, if the user appears anxious, it will display a message such as "Would you like to consult a specialist?"

[1626] Step 14:

[1627] The device displays generated guides and messages to the user, assisting the user to smoothly proceed with operations.

[1628] Step 15:

[1629] After the user has completed all the input fields, they confirm the information and click the submit button.

[1630] Step 16:

[1631] The terminal sends the input information to the server, which then reconfirms the received information and registers it in the database.

[1632] Step 17:

[1633] The server sends a procedure completion notification to the terminal, which includes detailed procedure information.

[1634] Step 18:

[1635] The device displays a transaction completion screen, informing the user that the transaction was successfully completed.

[1636] Step 19:

[1637] The server will send a confirmation email to the user, containing details of the procedure and next steps to take.

[1638] Step 20:

[1639] The server stores the emotion data recognized by the emotion engine as a log, which allows users to track their operation history and changes in their emotions.

[1640] Step 20:

[1641] The server analyzes the stored emotional data and uses it to improve procedures and enhance the user experience.

[1642] Example 2

[1643] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1644] The problem with existing administrative procedure systems is that they provide uniform procedural guidelines without considering the user's emotions or stress level.In addition, there are cases where confirmation of user input and notification of procedure completion are delayed, which reduces the efficiency of the entire procedure.

[1645] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1646] In this invention, the server includes means for receiving authentication information entered by the user and performing authentication, means for providing a procedure screen to a user who has been successfully authenticated, means for obtaining information necessary for the selected procedure from an information storage device and providing it to the user, means for receiving the procedure details entered by the user and confirming the input, means for registering the successfully confirmed procedure details in the information storage device and notifying the user that the procedure has been completed, means for providing support based on the recognized emotion, and means for recording and analyzing emotion information. This allows the server to provide personalized support according to the user's emotions, reducing stress during the procedure and enabling the procedure to be completed efficiently.

[1647] "Authentication Information" refers to the ID and password entered by a user when accessing the system, or any other similar personal identification information.

[1648] The "procedure screen" is the interface for the user to input the details of the administrative procedure they have selected.

[1649] An "information storage device" is a database or storage system that stores information related to a procedure and allows data to be retrieved as needed.

[1650] "Input validation" refers to the process of checking whether the procedure details entered by the user are accurate and complete.

[1651] A "transaction completion notification" is a mechanism used to notify the user that the transaction has been successfully completed.

[1652] An "emotion processing mechanism" refers to the algorithms and hardware that recognize and analyze a user's emotions.

[1653] "Means for providing support based on emotions" refers to the system's ability to provide appropriate guidance or messages based on the user's recognized emotions.

[1654] "Emotional information" refers to data that indicates the user's emotional state, such as information obtained from facial expressions, tone of voice, and typing speed.

[1655] "Means of recording and analyzing" refers to the process of storing emotional information as a history and analyzing that data to help improve the user experience and the system.

[1656] The present invention is a system that helps users to efficiently carry out administrative procedures, and aims to improve the user experience by combining an emotion processing mechanism that recognizes the user's emotions. This system includes authentication functions, administrative procedure selection functions, input support functions, emotion recognition functions, and procedure completion notification functions.

[1657] Hardware and Software Configuration

[1658] The system uses the following hardware and software:

[1659] Server: Runs the database, authentication system, emotion processing mechanism, and procedure management system.

[1660] Device: The device that receives user input (PC, smartphone, tablet).

[1661] Database: Stores data related to administrative procedures (e.g., MySQL, PostgreSQL)

[1662] Emotion processing mechanism: Software used to recognize user emotions (e.g., OpenCV, TensorFlow)

[1663] Communication protocol: Used to send and receive data between the device and the server (e.g. HTTPS)

[1664] Specific processing flow of the system

[1665] 1. User authentication:

[1666] The device displays a user authentication screen, and the user enters their ID and password. The device then sends this information to the server.

[1667] The server checks the authentication information against a database and returns the result of authentication success or failure to the terminal.

[1668] 2. Choice of administrative procedure:

[1669] For users who have been successfully authenticated, the device displays a screen for selecting categories for administrative procedures.

[1670] The user selects the procedure they wish to perform and the device transmits the selection to the server.

[1671] 3. Input assistance:

[1672] The server retrieves the information required for the selected procedure from the database and sends it back to the terminal.

[1673] The terminal displays an input form and the user enters the required information.

[1674] 4. Emotion recognition:

[1675] The device uses an emotion processing mechanism to recognize the user's emotions based on facial expressions, voice tone, and input speed.

[1676] The server provides appropriate guidance and support based on the emotional information. For example, if the user seems anxious, it displays "Is there something I can help you with?"

[1677] 5. Notification of Completion of Procedure:

[1678] After the terminal completes all the input fields, it displays a submit button. When the user presses submit, the terminal sends the input data to the server.

[1679] The server checks the input data and registers it in the database, then sends a notification of completion of the procedure to the terminal and a confirmation email to the user.

[1680] 6. Emotional data logging and analysis:

[1681] The server stores the emotional data recognized by the emotion processing mechanism as a log and uses it to improve the user experience and procedures.

[1682] Specific examples

[1683] 1. Authentication Process:

[1684] The terminal displays the authentication screen, and the user enters "user123" and "password123." The server receives the authentication information, checks it against the database, and returns a successful authentication.

[1685] 2. Choice of administrative procedure:

[1686] The device displays a category selection screen, and the user selects "Notification of Moving Out." The server obtains detailed information about the notification of moving out and sends it to the device.

[1687] 3. Input assistance and emotion recognition:

[1688] The device displays an input form, and the user enters their new address, such as "No. XX, XX-chome, Minato-ku, Tokyo." The device validates the input in real time and recognizes the user's emotions using its emotion processing mechanism. The server then provides appropriate guidance and messages based on the emotion recognition.

[1689] 4. Complete the process:

[1690] The user presses send, and the device sends the data to the server. The server registers the data, sends a notification of completion to the device, and sends a confirmation email to the user. The server then stores the emotion data in a log and analyzes it.

[1691] Prompt Sentence Examples

[1692] After selecting "Notice of Moving Out," the message "Please contact us if you have any questions" will be displayed while you are entering the required information. Also, once the procedure is complete, the message "Thank you for completing the notification of moving out" will be displayed and a confirmation email will be sent.

[1693] In this way, the present invention not only enables users to complete administrative procedures efficiently and reliably, but also reduces the stress and anxiety they may feel during the process. The introduction of an emotion processing mechanism provides more personalized support and improves the user experience.

[1694] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1695] Step 1:

[1696] The device displays the user authentication screen.

[1697] The device displays a screen for the user to enter their login ID and password. The user can enter the ID as "user123" and the password as "password123" at any time.

[1698] Step 2:

[1699] The user enters their credentials.

[1700] The user enters their ID and password in the input fields displayed on the screen and presses the login button. The ID and password are provided to the terminal as input data.

[1701] Step 3:

[1702] The terminal transmits the entered authentication information to the server.

[1703] The terminal uses the HTTPS protocol to send the entered ID and password to the server, which receives this information and processes the authentication information by packaging the data in JSON format and sending it.

[1704] Step 4:

[1705] The server checks the credentials against a database.

[1706] The server compares the received authentication information with the database to verify that the ID and password match. Specifically, it executes an SQL query to search for the corresponding record in the database and determines whether the authentication is successful (e.g., SQL query "SELECT FROM users WHERE ID = 'user123' AND password = 'password123'").

[1707] Step 5:

[1708] The server returns the authentication result to the terminal.

[1709] The server sends the authentication result in JSON format to the terminal. If successful, it returns a "Authentication successful" response, and if unsuccessful, it returns a "Authentication failed" response.

[1710] Step 6:

[1711] The terminal displays a screen for selecting categories for administrative procedures.

[1712] If authentication is successful, the device displays a screen for selecting administrative procedures, such as a list of procedures such as "Notification of Moving Out," "Notification of Moving In," and "Obtaining a Copy of Residence Certificate."

[1713] Step 7:

[1714] The user selects an administrative procedure.

[1715] The user selects the administrative procedure they wish to carry out and presses the select button. The selected procedure (e.g., "Notification of Moving Out") is then provided to the terminal as input data.

[1716] Step 8:

[1717] The terminal transmits the selection information to the server.

[1718] The terminal sends the selected procedure information to the server. The server receives this information and processes it. Specifically, it sends the selected procedure category in JSON format.

[1719] Step 9:

[1720] The server retrieves the details of the procedure from a database.

[1721] The server retrieves detailed information about the specified procedure from the database, using an SQL query to retrieve relevant information (e.g., required documents, requirements, and office locations) (e.g., "SELECT FROM procedures WHERE type = 'Notification of Moving Out'").

[1722] Step 10:

[1723] The server sends the procedure information back to the terminal.

[1724] The server sends the acquired procedure information in JSON format to the terminal, which receives this information and displays it to the user.

[1725] Step 11:

[1726] The device displays the input form.

[1727] The device will then display a form where you can enter the necessary details, including your new address, name, date of birth, etc.

[1728] Step 12:

[1729] The user enters information.

[1730] The user enters the required information into each form field. For example, the new address is "No. XX, Minato-ku, Tokyo" and the name is "Taro Yamada." The input information is provided to the terminal.

[1731] Step 13:

[1732] The terminal validates the input in real time.

[1733] The device uses JavaScript and regular expressions to check the information entered in real time, for example, to ensure that the postal code is formatted correctly and that all required fields are filled in.

[1734] Step 14:

[1735] The device uses an emotion processing mechanism to recognize the user's emotions.

[1736] The device uses a camera and microphone to input the user's facial expressions, voice tone, and typing speed into emotion recognition algorithms, which use OpenCV and TensorFlow to analyze the emotion data.

[1737] Step 15:

[1738] The server generates appropriate guidance and messages based on the user's emotions based on the emotion processing mechanism.

[1739] The server uses the recognized emotion data to generate an appropriate support message, for example, "Is there anything I can help you with?" if the user appears anxious.

[1740] Step 16:

[1741] After the terminal has completed all the input fields, it will display a submit button.

[1742] If all required fields are filled in correctly, the terminal will enable a submit button. When the user presses submit, the data will be sent to the server.

[1743] Step 17:

[1744] The terminal transmits the input information to the server.

[1745] The terminal sends all input data to the server in JSON format.

[1746] Step 18:

[1747] The server will reconfirm the information and register it in the database.

[1748] The server checks the received data, verifies its accuracy, and then stores the information in the database (e.g., "INSERT INTO procedures (user_id, procedure_type, details) VALUES (...);").

[1749] Step 19:

[1750] The server sends a procedure completion notification to the terminal.

[1751] Once the registration in the database is complete, the server sends a notification of completion of the procedure to the terminal, along with detailed information about the procedure to the user.

[1752] Step 20:

[1753] The device will display a completion screen.

[1754] The device will display a screen informing the user that the procedure is complete.

[1755] Step 21:

[1756] The server sends a confirmation email to the user.

[1757] The server will then send a confirmation email to the user, detailing the process and the next steps to take.

[1758] Step 22:

[1759] The server stores the emotion data recognized by the emotion processing mechanism as a log.

[1760] The server stores the user's emotional data as a log and accumulates it for future analysis.

[1761] Step 23:

[1762] The server analyzes the stored emotional data and uses it to improve procedures and enhance the user experience.

[1763] The server analyzes the emotional data and identifies areas for improvement to improve the user experience and streamline procedures.

[1764] (Application example 2)

[1765] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1766] Conventional administrative procedure systems lack support that takes into account the user's emotions regarding the procedure, and no method has been established to reduce stress and anxiety during the procedure. Furthermore, even in physical stores, there are no systems that can recognize customer emotions in real time and provide appropriate customer service guidance or recommended products. This can result in a lack of improvement in the user and customer experience, leaving them dissatisfied.

[1767] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1768] In this invention, the server includes means for receiving authentication information entered by a user and performing authentication, means for providing a screen for selecting an administrative procedure to a user who has been successfully authenticated, means for retrieving information necessary for the selected administrative procedure from a database and providing it to the user, means for receiving procedure details entered by the user and performing validation, means for registering successfully validated procedure details in a database and notifying the user that the procedure has been completed, means for performing emotion recognition and presenting customer service guides and recommended products based on the recognized emotion data, and means for saving and analyzing the recognized emotion data as a log. This allows for the provision of personalized support according to the emotions of users and customers, reducing stress during procedures and improving the customer experience.

[1769] "User" refers to an individual or corporation that uses this system to receive administrative procedures or services.

[1770] "Authentication Information" means information such as a user ID and password that a user provides to access a system.

[1771] "Authentication means" refers to technology or devices that receive authentication information provided by a user and verify its validity.

[1772] "Administrative procedures" refers to various official procedures and applications that users carry out online or in physical locations.

[1773] A "database" is an information system for storing and managing administrative procedures and user information.

[1774] "Validation" is the process of ensuring that the information entered by the user is accurate and complete.

[1775] "Notification means" refers to the methods and techniques used to notify users of the completion of procedures and other important information.

[1776] "Emotion recognition" is a technology that infers a user's emotions from their facial expressions, tone of voice, etc.

[1777] A "guide" is a guide or instruction that helps users or customers to smoothly proceed with procedures or services.

[1778] "Recommended products" are products or services selected by the system based on the customer's emotions and preferences.

[1779] "Log" is data for recording the system's operation history and recognized emotion data.

[1780] "Analysis" is the process of analyzing data stored as logs and deriving patterns and trends.

[1781] System Overview

[1782] This invention is a system that allows users to efficiently complete administrative procedures, and aims to improve the user and customer experience by combining it with an emotion recognition engine. The system for implementing the invention includes means for user authentication, selection of administrative procedures, provision of necessary information, validation of procedure content, notification of procedure completion, emotion recognition, presentation of guides, display of recommended products, and logging and analysis of emotion data.

[1783] Hardware and software used

[1784] Hardware:

[1785] Devices (smartphones, smart glasses, head-mounted displays, robots, etc.)

[1786] server

[1787] software:

[1788] Authentication system: Authentication is performed using user ID and password.

[1789] Database system: A management system for managing administrative procedures and user information.

[1790] Emotion recognition engine: Recognizes emotions from the user's facial expressions and tone of voice.

[1791] Product recommendation system: Recommend products based on user sentiment and preferences.

[1792] Log management system: Stores and analyzes operation history and emotional data.

[1793] Explanation of program processing

[1794] Authentication process

[1795] The server receives the authentication information entered by the user and verifies it against the information in the database. At this time, the terminal displays an authentication screen and the user enters their ID and password. If authentication is successful, the process proceeds to the next step.

[1796] Selection of administrative procedures and provision of information

[1797] For users who have been successfully authenticated, the terminal displays a screen for selecting administrative procedures. The user selects the procedure they wish to use and sends that information to the server. The server then retrieves the necessary information (e.g., required documents, reception location, etc.) from the database and sends it back to the terminal.

[1798] Input support and validation of procedure details

[1799] When a user enters the required information into the input form, the terminal performs real-time validation. Information that passes validation is sent to the server and registered in the database. The user is then notified that the procedure has been completed.

[1800] Emotion Recognition and Personalized Guidance

[1801] The device uses an emotion recognition engine to recognize the user's emotions from their facial expressions and tone of voice. This information is sent to the server, which then displays the most appropriate guidance and product recommendations based on the user's emotions. For example, if the user is feeling anxious, the server will display a support message asking, "Is there anything I can help you with?"

[1802] Emotion data logging and analysis

[1803] The server stores the emotion data recognized by the emotion recognition engine as a log, which is then analyzed to improve future procedures and user experience.

[1804] Specific examples

[1805] For example, in a physical store, when a store staff member wearing smart glasses interacts with a customer, the emotion recognition engine analyzes the customer's emotions in real time. For example, if the customer is smiling, the smart glasses will display a message saying, "The customer seems to be in a good mood. Please recommend a new wine." The staff member can then follow the guidance displayed on the glasses to improve the customer experience.

[1806] Example prompts to input to a generative AI model:

[1807] Prototype a smart glasses application that recognizes emotions from a customer's facial expressions and tone of voice, and provides real-time guidance and product recommendations.

[1808] 1. Customer Authentication

[1809] 2. Real-time emotion recognition

[1810] 3. Guidance based on recognition results

[1811] 4. Emotional data logging

[1812] In summary, this system will enable users and customers to enjoy a better experience by reducing stress when undergoing procedures and receiving services.

[1813] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1814] Step 1:

[1815] The device displays an authentication screen and the user enters their authentication information.

[1816] Input: User ID and password

[1817] How it works: The device receives user input and sends it to the server.

[1818] Output: Authentication information is sent to the server.

[1819] Step 2:

[1820] The server checks the received authentication information against a database and returns the authentication result.

[1821] Input: User ID and password

[1822] What happens: The server contacts the database and verifies that the credentials match.

[1823] Output: The result of authentication success or failure is sent to the terminal.

[1824] Step 3:

[1825] For users who have been successfully authenticated, the device displays a screen for selecting categories for administrative procedures.

[1826] Input: Authentication success result

[1827] Operation: The terminal generates and displays a category selection screen for administrative procedures.

[1828] Output: The administrative procedure selection screen is displayed.

[1829] Step 4:

[1830] The user selects the desired administrative procedure, and the terminal transmits the selection information to the server.

[1831] Input: Selected information for administrative procedures

[1832] Operation: The device receives the information selected by the user and sends it to the server.

[1833] Output: The selection information is sent to the server.

[1834] Step 5:

[1835] The server retrieves detailed information about the selected administrative procedure from a database and sends it back to the terminal.

[1836] Input: Selection information

[1837] Operation: The server accesses the database and retrieves the necessary procedural information.

[1838] Output: The acquired procedure information is sent to the terminal.

[1839] Step 6:

[1840] The terminal displays the procedure information it has acquired, and the user enters the necessary information.

[1841] Input:Procedure information

[1842] Operation: The device generates an input form and displays it to the user. The user enters the required information.

[1843] Output: User input is saved to the device.

[1844] Step 7:

[1845] The device uses an emotion recognition engine to recognize the user's emotions in real time.

[1846] Input: User's facial expressions, tone of voice

[1847] How it works: The device uses an emotion recognition engine to analyze the data and recognize the user's emotions.

[1848] Output: User emotion data is obtained.

[1849] Step 8:

[1850] The server displays appropriate guides and recommended products to the user based on the emotional data.

[1851] Input: Emotion data

[1852] How it works: The server processes the acquired emotional data and generates the best guide and recommended products for the user.

[1853] Output: Guide and recommended product information is sent to the device.

[1854] Step 9:

[1855] The device displays guides and recommended products to the user, who then completes the input.

[1856] Input: Guide and recommended product information

[1857] Action: The terminal displays the information and the user completes the transaction.

[1858] Output: The completed input is saved to the device.

[1859] Step 10:

[1860] The terminal sends the completed procedure details to the server and performs validation.

[1861] Input: Completed procedure details

[1862] Operation: The terminal sends the procedure details to the server, which then validates them.

[1863] Output: The validation result is generated.

[1864] Step 11:

[1865] The server registers the procedure details that have been successfully validated in a database and sends a completion notification to the terminal.

[1866] Input: Validation result

[1867] Operation: The server registers the procedure details in the database, generates a completion notice, and sends it to the terminal.

[1868] Output: A notification of completion of the procedure is sent to the terminal.

[1869] Step 12:

[1870] The terminal displays a notification to the user that the procedure has been completed, and the server sends a confirmation email.

[1871] Input: Procedure completion notification

[1872] What happens: The device displays a notification and the server sends a confirmation email to the user.

[1873] Output: The user will receive a notification and a confirmation email.

[1874] Step 13:

[1875] The server stores the recognized emotion data as a log and uses it for future analysis.

[1876] Input: Emotion data

[1877] How it works: The server uses a log management system to store emotion data and manage it in an analyzable format.

[1878] Output: Emotion data is saved as a log.

[1879] The above are the specific processing steps of the system that realizes the application example. By accurately understanding the processing content of each step and its input and output, you can understand the overall picture of the system and implement it effectively.

[1880] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1881] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1882] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1883] [Fourth embodiment]

[1884] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1885] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1886] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1887] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1888] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1889] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1890] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1891] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1892] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1893] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1894] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1895] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1896] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1897] The present invention is a system that supports users in efficiently performing administrative procedures. This system includes means for receiving authentication information entered by a user and performing authentication, means for providing a screen for selecting an administrative procedure to a user who has been successfully authenticated, means for retrieving information necessary for the selected administrative procedure from a database and providing the information to the user, means for receiving and validating the procedure details entered by the user, and means for registering the successfully validated procedure details in the database and notifying the user of the completion of the procedure.

[1898] Overview of program processing flow

[1899] User authentication

[1900] 1. The terminal displays the user authentication screen.

[1901] The user enters their login ID and password.

[1902] 2. The device sends the authentication information entered by the user to the server.

[1903] The server checks the authentication information against a database to verify its validity.

[1904] 3. The server returns the authentication result to the terminal.

[1905] If the authentication is successful, proceed to the next step.

[1906] Choosing administrative procedures

[1907] 4. The terminal displays the administrative procedure category selection screen.

[1908] The user selects the procedure they wish to follow.

[1909] Example: Select "Notification of Moving Due to Moving."

[1910] 5. The device sends the selection information to the server.

[1911] The server retrieves detailed information about the selected procedure from a database.

[1912] 6. The server sends the procedure information back to the terminal.

[1913] Examples: a list of documents required for the moving-out notification, the location of the office, opening hours, etc.

[1914] Procedural input assistance

[1915] 7. The device will display the input form.

[1916] Provide users with fields to enter necessary information (e.g. new address, name, date of birth, etc.).

[1917] 8. The user enters the information.

[1918] The input is checked in real time to ensure there are no errors or omissions.

[1919] For example, when you enter your "new address," it will immediately check that it is in the correct format.

[1920] Input validation and procedure completion notification

[1921] 9. After the device has completed all the input fields, it will display a submit button.

[1922] The user confirms and presses send.

[1923] 10. The terminal sends the entered information to the server.

[1924] The server will reconfirm the information and register it in the database.

[1925] 11. The server sends a notification of completion of the procedure to the terminal and a confirmation email to the user.

[1926] The terminal will display a message to the user saying "The procedure is complete," and the entire process will be completed.

[1927] Specific examples

[1928] 1. Authentication Process

[1929] The device displays the authentication screen and the user enters "user123" and "password123".

[1930] The server receives the authentication information and returns a successful authentication after checking the database.

[1931] 2. Choice of administrative procedures

[1932] The device displays the category selection screen, and the user selects "Notification of Moving Out."

[1933] The server obtains detailed information about the moving-out notification and sends it to the terminal.

[1934] 3. Input assistance

[1935] The device displays an input form, and the user enters their new address as "No. XX, XX-chome, Minato-ku, Tokyo."

[1936] A format check is performed in real time, and if the format is correct, proceed to the next step.

[1937] 4. Complete the procedure

[1938] The user presses send and the device sends the data to the server.

[1939] The server registers the data, sends a notification of completion of the procedure to the terminal, and sends a confirmation email to the user.

[1940] This system allows users to complete administrative procedures efficiently and reliably, supporting them at each step of the process and significantly reducing the burden of the process.

[1941] The processing flow will be explained below.

[1942] Step 1:

[1943] The terminal displays the user authentication screen, and the user enters their login ID and password.

[1944] Step 2:

[1945] The user enters their ID and password. For example, they enter "user123" and "password123."

[1946] Step 3:

[1947] The terminal sends the entered authentication information to the server, which then checks the received authentication information against its database.

[1948] Step 4:

[1949] The server returns the authentication result to the terminal. If the authentication is successful, proceed to the next step. If the authentication is unsuccessful, return an error message.

[1950] Step 5:

[1951] The device displays a screen for the user to select a category for administrative procedures. For example, it displays a list of categories such as "Acquisition of Resident Registration," "Notification of Moving Out," and "Certificate Issuance."

[1952] Step 6:

[1953] The user selects the procedure they wish to perform. For example, they select "Notification of Moving Out."

[1954] Step 7:

[1955] The terminal sends the selection information to the server, which retrieves detailed information about the selected procedure from a database.

[1956] Step 8:

[1957] The server sends back the procedure information to the terminal, such as a list of documents required for the moving-out notification, the location of the counter, and reception hours.

[1958] Step 9:

[1959] The device displays the necessary information to the user and allows the user to access input forms.

[1960] Step 10:

[1961] The user enters the required information, such as new address, name, date of birth, etc.

[1962] Step 11:

[1963] The terminal validates input in real time, checking address format and required fields, and providing feedback to the user if there are any errors.

[1964] Step 12:

[1965] After the user has completed all the input fields, they check the information and click the submit button.

[1966] Step 13:

[1967] The terminal sends the input information to the server, which then reconfirms the received information and registers it in the database.

[1968] Step 14:

[1969] The server sends a notification to the terminal that the procedure has been completed. The notification includes detailed information about the procedure.

[1970] Step 15:

[1971] The device displays a transaction completion screen, informing the user that the transaction was successfully completed.

[1972] Step 16:

[1973] The server will send a confirmation email to the user, containing details of the procedure and next steps to take.

[1974] Example 1

[1975] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1976] In current administrative procedures, users often experience delays due to cumbersome procedures and incomplete documentation. Furthermore, because information is not checked or validated in real time, users may enter incorrect information and be required to resubmit the procedure. This not only wastes users' time and effort, but also reduces administrative processing efficiency. There is a need for improved system usability and user experience, especially for online procedures.

[1977] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1978] In this invention, the server includes means for receiving authentication information entered by a user and verifying it against a database for authentication; means for displaying a category selection screen and providing a screen for selecting an administrative procedure to a user who has been successfully authenticated; means for retrieving information necessary for the selected administrative procedure from the database and providing it to the user; means for receiving the procedure details entered by the user, performing a format check and validation in real time; and means for registering successfully validated procedure details in the database and notifying the user that the procedure has been completed. This enables users to perform administrative procedures online accurately and efficiently. Furthermore, real-time input checks and validations allow input errors to be detected early and prevent resubmission, thereby speeding up the procedure.

[1979] "User authentication" is the process in which a system receives authentication information, such as an ID and password, entered by a user and checks its validity against a database.

[1980] The "category selection screen" is an interface for selecting administrative procedures that is displayed to users who have been successfully authenticated.

[1981] "Database" means a digital storage system that stores user authentication information and information required for selected administrative procedures.

[1982] "User input" refers to the act of a user entering information required for a procedure through an interface such as a form.

[1983] "Real-time format checking" is the process of instantly verifying that the information entered by the user is in the correct format and displaying a warning if there are any errors.

[1984] "Validation" is the process of ensuring that user-entered data is accurate and contains all required information.

[1985] A "procedure completion notification" is a message that notifies the user that the procedure has been completed after the procedure details that have been successfully validated have been registered in the database.

[1986] A "confirmation email" is a notification sent to the user via email that the process has been completed.

[1987] The present invention is a system that helps users efficiently complete administrative procedures online. This system has multiple functions for user authentication, administrative procedure selection, procedure content input support, validation, and procedure completion notification.

[1988] This system is mainly composed of a server, a terminal, and a database. Below are the specific names of each piece of hardware and software, and details of each process.

[1989] User authentication

[1990] First, the terminal displays a user authentication screen. The user enters their login ID and password here, and the terminal sends the entered authentication information to the server. The server receives this information and performs authentication by checking it against a database such as OpenLDAP or MySQL. If authentication is successful, the server returns the authentication result to the terminal and proceeds to the next step.

[1991] Choosing administrative procedures

[1992] For users who have been successfully authenticated, the terminal displays a screen for selecting administrative procedures. When the user selects the appropriate procedure, the selection information is sent from the terminal to the server. The server retrieves the information necessary for the selected administrative procedure from a database such as PostgreSQL and sends it back to the terminal. For example, if a notification of moving out is selected, detailed information such as a list of required documents, the location of the counter, and reception hours is provided.

[1993] Procedural input assistance

[1994] Next, the terminal displays an input form and the user enters the necessary information (e.g., new address, name, date of birth, etc.). At this time, the terminal checks the format of the input in real time. For example, when "new address" is entered, the format is immediately confirmed and a warning is displayed if it is incorrect.

[1995] Validation and procedure completion notification

[1996] When the user completes all the input fields and presses the send button, the terminal sends the entered information to the server. The server then checks this information again and validates that the format and content are correct. If validation is successful, the information is registered in the database. Finally, the server notifies the terminal that the procedure is complete and sends a confirmation email to the user. The terminal displays a message saying "The procedure has been completed," and the entire procedure is complete.

[1997] Specific examples

[1998] 1. Authentication Process:

[1999] The device displays the authentication screen and the user enters "user123" and "password123."

[2000] The server receives the authentication information, checks it against a database, and returns a successful authentication.

[2001] 2. Administrative procedure options:

[2002] The device displays a category selection screen, and the user selects "Notification of Moving Out."

[2003] The server obtains detailed information about the moving-out notification and sends it to the terminal.

[2004] 3. Input assistance:

[2005] The device displays an input form, and the user enters the new address as "No. XX, XX-chome, Minato-ku, Tokyo."

[2006] A format check is performed in real time, and if the format is correct, proceed to the next step.

[2007] 4. Complete the process:

[2008] The user presses send and the device sends the data to the server.

[2009] The server registers the data, sends a notification of completion of the procedure to the terminal, and sends a confirmation email to the user.

[2010] This system allows users to complete administrative procedures online efficiently and reliably. Real-time input checks and validations prevent the entry of inaccurate information, enabling faster processing.

[2011] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2012] Step 1:

[2013] Enter and submit user credentials

[2014] The device displays the user authentication screen. The user enters their login ID and password, and the device sends the entered authentication information to the server.

[2015] Input: The user enters the ID "user123" and password "password123".

[2016] Data processing and calculation: The terminal encrypts the authentication information using AES and sends it to the server.

[2017] Output: Encrypted authentication information sent to the server.

[2018] Specific behavior:

[2019] The device will display the message "Please enter your ID and password."

[2020] The user enters the ID "user123" and password "password123".

[2021] The terminal encrypts the input information with AES.

[2022] The device sends the encrypted information to the server.

[2023] Step 2:

[2024] Authentication verification

[2025] The server checks the received authentication information against a database to verify its validity.

[2026] Input: Encrypted credentials.

[2027] Data processing and calculation: The server decrypts the AES encryption and retrieves the corresponding user information from the database (e.g., MySQL). It compares the information to verify its authenticity.

[2028] Output: Generates authentication results and returns them to the terminal.

[2029] Specific behavior:

[2030] The server receives the encrypted authentication information.

[2031] The server decrypts the AES encryption and extracts the ID and password.

[2032] The server retrieves the relevant user information from the database.

[2033] The server compares the authentication information with the database information to verify its validity.

[2034] The server generates an authentication result.

[2035] The server sends the authentication result to the terminal.

[2036] Step 3:

[2037] Viewing the authentication result and proceeding to the next step

[2038] The device displays the authentication result sent by the server, and if the authentication is successful, the user proceeds to the next step.

[2039] Input: The authentication result from the server.

[2040] Data processing and calculation: None in particular.

[2041] Output: Display the authentication result on the screen.

[2042] Specific behavior:

[2043] The terminal receives the authentication result from the server.

[2044] If the authentication is successful, the message "Authentication successful" is displayed.

[2045] If authentication fails, the message "Authentication failed. Please try again" is displayed.

[2046] Step 4:

[2047] Choosing administrative procedures

[2048] The device displays a screen for selecting administrative procedures. The user selects the procedure they wish to follow.

[2049] Input: User selection information.

[2050] Data processing and calculation: None in particular.

[2051] Output: Sends the user's selection to the server.

[2052] Specific behavior:

[2053] The device will display the message "Please select a procedure category."

[2054] The user selects "Notification of Moving Out."

[2055] The terminal transmits the selection information to the server.

[2056] Step 5:

[2057] Sending selection information and obtaining procedure information

[2058] The server retrieves the information required for the selected procedure from the database and sends it to the terminal.

[2059] Input: User selection information.

[2060] Data processing and calculation: The server retrieves the necessary information from the database (e.g., PostgreSQL).

[2061] Output: Sends procedural information to the terminal.

[2062] Specific behavior:

[2063] The server receives the selection information sent by the terminal.

[2064] The server retrieves the information required for the procedure from the database.

[2065] The server transmits the acquired information to the terminal.

[2066] Step 6:

[2067] Displaying procedural information and providing input forms

[2068] The terminal provides the user with the procedure information and displays an input form, which the user fills in.

[2069] Input: The procedure entered by the user.

[2070] Data processing and calculation: The terminal performs format checks in real time.

[2071] Output: Shows the user in real time whether the format is correct.

[2072] Specific behavior:

[2073] The terminal displays the procedural information it has acquired (e.g., list of required documents, location of counter, etc.).

[2074] The terminal displays a form for entering the procedure details.

[2075] The user enters their new address, name, and date of birth.

[2076] Checks the form for correctness as you fill it out and displays warnings if there are any errors.

[2077] Step 7:

[2078] Submitting input and final validation

[2079] The terminal sends the user's input to the server, which performs final validation.

[2080] Input: All the procedures entered by the user.

[2081] Data processing and calculation: The server will double-check all data to ensure the accuracy of the format and content.

[2082] Output: Generate validation results and prepare them for registration in the database.

[2083] Specific behavior:

[2084] The user completes all the input and presses the submit button.

[2085] The device sends the input to the server.

[2086] The server revalidates the data received to ensure there are no problems.

[2087] Data that passes validation is registered in the database.

[2088] Step 8:

[2089] Notification of completion of procedure and sending of confirmation email

[2090] The server sends a notification of completion of the procedure to the terminal and a confirmation email to the user.

[2091] Input: The procedure that was successfully validated.

[2092] Data processing and calculation: None in particular.

[2093] Output: Sends a completion notification to the terminal and a confirmation email to the user.

[2094] Specific behavior:

[2095] The server generates a procedure completion notification.

[2096] The server sends a message to the terminal saying "The procedure is complete."

[2097] The server sends a confirmation email to the user.

[2098] The device displays the completion notification to the user.

[2099] This allows users to efficiently complete all procedures online.

[2100] (Application example 1)

[2101] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2102] When carrying out administrative procedures, users face challenges such as long wait times at local counters and the time it takes to gather the information necessary for the procedure. Additionally, it is inconvenient for users to not be able to track the progress of the procedure in real time. These challenges are particularly pronounced when carrying out procedures at brick-and-mortar locations such as city halls and ward offices. Another problem is that if an input error or omission occurs in the procedure details, it is not possible to quickly correct it.

[2103] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2104] In this invention, the server includes: means for receiving authentication information entered by a user and performing authentication; means for providing a screen for selecting an administrative procedure to a user who has been successfully authenticated; means for retrieving information necessary for the selected administrative procedure from a database and providing it to the user; means for receiving and validating the procedure details entered by the user; means for registering successfully validated procedure details in a database and notifying the user that the procedure has been completed; means for the user to scan an identification code installed at an administrative facility and log in using the scan results; and means for displaying the progress of the procedure to the user in real time. This reduces waiting time for users on-site, allows them to quickly obtain the information they need, and allows them to check the progress of the procedure in real time. Furthermore, the ability to check and correct input information in real time improves the accuracy of the procedure and reduces the burden on the user.

[2105] "User authentication" is the process by which a user enters their identity information, which is then verified by the system.

[2106] "Administrative procedures" are procedures through which users submit applications or notifications to public institutions such as government agencies.

[2107] A "database" is a structured collection of data that allows information to be efficiently stored, managed, and retrieved.

[2108] "Validation" is the process of checking whether the entered data is of the correct format and content.

[2109] The "procedure completion notification" is a message to inform the user that the procedure has been completed successfully.

[2110] "Scanning an identification code" refers to the act of reading a code such as a QR code or barcode with a device and recognizing the information contained therein.

[2111] "Logging in" is the process by which a user enters authentication information and has their authentication accepted in order to access a system.

[2112] "Procedure progress display" is a function that displays the status and progress of ongoing procedures to users in real time.

[2113] "Real-time validation" is a process in which data entered by a user is verified instantly.

[2114] "Administrative facilities" are public buildings that provide administrative services, such as city halls and ward offices.

[2115] To implement this invention, the server, the terminal (such as a smartphone or tablet), and the user must each play their respective roles. Specific operation methods for each step are described below.

[2116] User authentication

[2117] First, the user scans the identification code installed at the city hall or ward office with the terminal and performs the authentication procedure using the result. The server receives this information and checks it against the database to verify the authenticity of the authentication. If the authentication is successful, the terminal proceeds to the next step.

[2118] Hardware and software used

[2119] Hardware: Smartphone with QR code reader

[2120] Software: iOS or Android application, SQLite database, Flask server

[2121] Specific examples

[2122] The user scans the QR code displayed at the city hall counter with their smartphone and logs in by entering "user123" and "password123."

[2123] Choosing administrative procedures

[2124] After successful authentication, the terminal displays a screen for the user to select the administrative procedure. The user selects the procedure they want and the information is sent to the server. The server retrieves the information required for the selected procedure from the database and provides it to the terminal.

[2125] Hardware and software used

[2126] Hardware: Smartphone

[2127] Software: iOS or Android application, Flask server

[2128] Specific examples

[2129] The user selects "Notification of Moving Out" and the information is sent to the server. The server retrieves the list of documents required for the notification and detailed information from the database and returns them to the terminal.

[2130] Enter the required information

[2131] The terminal provides the user with a form to enter the information required for the selected procedure. As the user enters the information, validation is performed in real time, and any confirmation or correction of the input is reflected immediately.

[2132] Hardware and software used

[2133] Hardware: Smartphone

[2134] Software: iOS or Android application, Flask server

[2135] Specific examples

[2136] The user enters their new address as "No. XX, XX-chome, Minato-ku, Tokyo," and the format is instantly checked. If the format is correct, they proceed to the next step.

[2137] Notification of completion of procedure

[2138] Once all the information has been entered, the user presses the send button, and the device sends the information to the server. The server then checks the information again, registers it in the database, and notifies the device that the procedure has been completed. At the same time, a confirmation email is sent to the user.

[2139] Hardware and software used

[2140] Hardware: Smartphones, servers

[2141] Software: iOS or Android application, Flask server, mail server

[2142] Specific examples

[2143] The user submits the information, the server registers the data in the database, the device displays a message saying "The procedure is complete," and a confirmation email is sent to the user.

[2144] Prompt sentence for generative AI model

[2145] Below are some example prompts to be input to the generative AI model:

[2146] I would like to scan a QR code at the city hall counter to complete the authentication process. Please tell me how to scan the QR code using a smartphone, and how to create a series of steps from logging in, selecting a procedure, entering the necessary information, and receiving a notification that the procedure has been completed.

[2147] This system allows users to complete procedures at city halls and ward offices quickly and efficiently. Users can reduce waiting times on-site and easily obtain the information they need. In addition, the system allows users to check and correct input information in real time, improving the accuracy of procedures and reducing the burden on users.

[2148] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2149] Step 1:

[2150] The user scans the identification code installed in the government facility. The user reads the identification code using a QR code reader on their smartphone. This input data is sent to the terminal and then sent to the server as authentication information.

[2151] Step 2:

[2152] The server receives the authentication information and checks it against the database. The server compares the entered authentication information with the database to verify the user's authenticity. If authentication is successful, the server returns a message indicating successful authentication to the terminal.

[2153] Step 3:

[2154] After successful authentication, the terminal displays a screen for the user to select an administrative procedure. The user selects the administrative procedure from the list and enters the relevant information. This input data is sent to the server.

[2155] Step 4:

[2156] The server retrieves the information required for the procedure selected by the user from a database. The server retrieves the relevant information from the database and returns it to the terminal. The information displayed on the terminal includes a list of documents required for the procedure and detailed information.

[2157] Step 5:

[2158] The terminal displays a form for the user to enter the required information. The user enters the information into the form and the data is validated in real time. If any inaccurate or missing data is found during this process, the terminal provides immediate feedback and the user can make corrections.

[2159] Step 6:

[2160] After completing the input, the user presses the send button. The terminal sends the input information to the server. The server checks the information again and saves it in the database. A notification that the procedure is complete is then sent to the terminal and displayed to the user. A confirmation email is also sent to the user.

[2161] Step 7:

[2162] After the transaction is completed, the terminal will display the transaction progress to the user in real time. The server will update the transaction status at each stage and send it to the terminal, allowing the user to have an overall understanding of the transaction.

[2163] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2164] The present invention is a system that supports users in efficiently performing administrative procedures, and aims to improve the user experience by combining it with an emotion engine that recognizes the user's emotions. This system includes means for receiving authentication information entered by the user and performing authentication, means for providing a screen for selecting an administrative procedure to a user who has been successfully authenticated, means for retrieving information necessary for the selected administrative procedure from a database and providing the user with the information, means for receiving the procedure details entered by the user and validating it, and means for registering the successfully validated procedure details in the database and notifying the user that the procedure has been completed.

[2165] Furthermore, it is equipped with an emotion engine that recognizes the user's emotions and has the ability to customize procedural guidance and support based on the user's emotions. It also includes a means to adaptively change the operation screen and messages according to the user's emotions, and a means to save and analyze the recognized emotion data as a log.

[2166] Overview of program processing flow

[2167] User authentication

[2168] 1. The terminal displays the user authentication screen.

[2169] The user enters their login ID and password.

[2170] 2. The user enters their authentication information. For example, they enter "user123" and "password123."

[2171] 3. The device sends the entered authentication information to the server.

[2172] The server checks the received authentication information against a database.

[2173] 4. The server returns the authentication result to the terminal. If the authentication is successful, proceed to the next step.

[2174] Choosing administrative procedures

[2175] 5. The terminal displays the administrative procedure category selection screen.

[2176] The user selects the procedure they wish to follow. Example: Select "Notification of Moving Out."

[2177] 6. The device sends the selection information to the server.

[2178] The server retrieves detailed information about the selected procedure from a database.

[2179] 7. The server sends the procedure information back to the terminal.

[2180] Example: Send information such as a list of documents required for submitting a moving-out notification, the location of the counter, and reception hours to the terminal.

[2181] Procedural input assistance

[2182] 8. The device will display the input form.

[2183] Provide users with fields to enter necessary information (e.g. new address, name, date of birth, etc.).

[2184] 9. The user enters the information.

[2185] The input is checked in real time to ensure there are no errors or omissions.

[2186] Emotion Recognition and Customization

[2187] 10. The device uses an emotion engine to recognize the user's emotions.

[2188] Emotion recognition is based on the user's facial expressions, tone of voice, and typing speed.

[2189] 11. The server generates appropriate guidance and messages based on the user's emotions based on the emotion engine.

[2190] Example: If the user seems anxious, display a supportive message such as "Is there anything I can help you with?"

[2191] Input validation and procedure completion notification

[2192] 12. After the device has completed all the input fields, it will display a submit button.

[2193] The user confirms and presses send.

[2194] 13. The terminal sends the entered information to the server.

[2195] The server will reconfirm the information and register it in the database.

[2196] 14. The server sends a procedure completion notification to the terminal.

[2197] The completion notice will include detailed information about the procedure.

[2198] 15. The device displays a confirmation screen, informing the user that the transaction was successfully completed.

[2199] 16. The server sends a confirmation email to the user, containing details of the transaction and next steps to take.

[2200] Emotion data logging and analysis

[2201] 17. The server stores the emotion data recognized by the emotion engine as a log.

[2202] This allows us to track user behavior history and emotional changes.

[2203] 18. The server analyzes the stored emotional data and uses it to improve procedures and enhance the user experience.

[2204] Specific examples

[2205] 1. Authentication Process

[2206] The device displays the authentication screen and the user enters "user123" and "password123".

[2207] The server receives the authentication information and returns a successful authentication after checking the database.

[2208] 2. Choice of administrative procedures

[2209] The device displays the category selection screen, and the user selects "Notification of Moving Out."

[2210] The server obtains detailed information about the moving-out notification and sends it to the terminal.

[2211] 3. Input Assistance and Emotion Recognition

[2212] The device displays an input form, and the user enters the new address information: "No. XX, XX-chome, Minato-ku, Tokyo."

[2213] The device validates input in real time and recognizes the user's emotions using an emotion engine.

[2214] The server provides appropriate guidance and messages based on emotion recognition.

[2215] 4. Complete the procedure

[2216] The user presses send and the device sends the data to the server.

[2217] The server registers the data, sends a notification of completion of the procedure to the terminal, and sends a confirmation email to the user.

[2218] The server stores and analyzes the emotional data in a log.

[2219] This invention not only enables users to complete administrative procedures efficiently and reliably, but also reduces the stress and anxiety they may feel during the process. The introduction of an emotion engine enables more personalized support, improving the user experience.

[2220] The processing flow will be explained below.

[2221] Step 1:

[2222] The terminal displays the user authentication screen, and the user enters their login ID and password.

[2223] Step 2:

[2224] The user enters their ID and password. For example, they enter "user123" and "password123."

[2225] Step 3:

[2226] The terminal sends the entered authentication information to the server, which then collates the received authentication information with a database and performs authentication.

[2227] Step 4:

[2228] The server returns the authentication result to the terminal. If the authentication is successful, proceed to the next step. If the authentication is unsuccessful, return an error message.

[2229] Step 5:

[2230] The device displays a screen for the user to select a category for administrative procedures. For example, a list of categories such as "Acquisition of Resident Registration," "Notification of Moving Out," and "Certificate Issuance" is displayed.

[2231] Step 6:

[2232] The user selects the procedure they wish to perform. For example, they select "Notification of Moving Out."

[2233] Step 7:

[2234] The terminal sends the selection information to the server, which retrieves detailed information about the selected procedure from a database.

[2235] Step 8:

[2236] The server sends back the procedure information to the terminal, such as a list of documents required for the moving-out notification, the location of the counter, and reception hours.

[2237] Step 9:

[2238] The device displays the necessary information to the user and allows the user to access input forms.

[2239] Step 10:

[2240] The user enters the required information, such as new address, name, date of birth, etc.

[2241] Step 11:

[2242] The terminal validates input in real time, checking address format and required fields, and providing feedback to the user if there are any errors.

[2243] Step 12:

[2244] The device activates an emotion engine to recognize the user's emotions as they are input, analyzing the user's facial expressions, tone of voice, and input speed.

[2245] Step 13:

[2246] The server generates appropriate guidance and messages based on the user's emotions recognized using an emotion engine. For example, if the user appears anxious, it will display a message such as "Would you like to consult a specialist?"

[2247] Step 14:

[2248] The device displays generated guides and messages to the user, assisting the user to smoothly proceed with operations.

[2249] Step 15:

[2250] After the user has completed all the input fields, they confirm the information and click the submit button.

[2251] Step 16:

[2252] The terminal sends the input information to the server, which then reconfirms the received information and registers it in the database.

[2253] Step 17:

[2254] The server sends a procedure completion notification to the terminal, which includes detailed procedure information.

[2255] Step 18:

[2256] The device displays a transaction completion screen, informing the user that the transaction was successfully completed.

[2257] Step 19:

[2258] The server will send a confirmation email to the user, containing details of the procedure and next steps to take.

[2259] Step 20:

[2260] The server stores the emotion data recognized by the emotion engine as a log, which allows users to track their operation history and changes in their emotions.

[2261] Step 20:

[2262] The server analyzes the stored emotional data and uses it to improve procedures and enhance the user experience.

[2263] Example 2

[2264] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2265] The problem with existing administrative procedure systems is that they provide uniform procedural guidelines without considering the user's emotions or stress level.In addition, there are cases where confirmation of user input and notification of procedure completion are delayed, which reduces the efficiency of the entire procedure.

[2266] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2267] In this invention, the server includes means for receiving authentication information entered by the user and performing authentication, means for providing a procedure screen to a user who has been successfully authenticated, means for obtaining information necessary for the selected procedure from an information storage device and providing it to the user, means for receiving the procedure details entered by the user and confirming the input, means for registering the successfully confirmed procedure details in the information storage device and notifying the user that the procedure has been completed, means for providing support based on the recognized emotion, and means for recording and analyzing emotion information. This allows the server to provide personalized support according to the user's emotions, reducing stress during the procedure and enabling the procedure to be completed efficiently.

[2268] "Authentication Information" refers to the ID and password entered by a user when accessing the system, or any other similar personal identification information.

[2269] The "procedure screen" is the interface for the user to input the details of the administrative procedure they have selected.

[2270] An "information storage device" is a database or storage system that stores information related to a procedure and allows data to be retrieved as needed.

[2271] "Input validation" refers to the process of checking whether the procedure details entered by the user are accurate and complete.

[2272] A "transaction completion notification" is a mechanism used to notify the user that the transaction has been successfully completed.

[2273] An "emotion processing mechanism" refers to the algorithms and hardware that recognize and analyze a user's emotions.

[2274] "Means for providing support based on emotions" refers to the system's ability to provide appropriate guidance or messages based on the user's recognized emotions.

[2275] "Emotional information" refers to data that indicates the user's emotional state, such as information obtained from facial expressions, tone of voice, and typing speed.

[2276] "Means of recording and analyzing" refers to the process of storing emotional information as a history and analyzing that data to help improve the user experience and the system.

[2277] The present invention is a system that helps users to efficiently carry out administrative procedures, and aims to improve the user experience by combining an emotion processing mechanism that recognizes the user's emotions. This system includes authentication functions, administrative procedure selection functions, input support functions, emotion recognition functions, and procedure completion notification functions.

[2278] Hardware and Software Configuration

[2279] The system uses the following hardware and software:

[2280] Server: Runs the database, authentication system, emotion processing mechanism, and procedure management system.

[2281] Device: The device that receives user input (PC, smartphone, tablet).

[2282] Database: Stores data related to administrative procedures (e.g., MySQL, PostgreSQL)

[2283] Emotion processing mechanism: Software used to recognize user emotions (e.g., OpenCV, TensorFlow)

[2284] Communication protocol: Used to send and receive data between the device and the server (e.g. HTTPS)

[2285] Specific processing flow of the system

[2286] 1. User authentication:

[2287] The device displays a user authentication screen, and the user enters their ID and password. The device then sends this information to the server.

[2288] The server checks the authentication information against a database and returns the result of authentication success or failure to the terminal.

[2289] 2. Administrative procedure options:

[2290] For users who have been successfully authenticated, the device displays a screen for selecting categories for administrative procedures.

[2291] The user selects the procedure they wish to perform and the device transmits the selection to the server.

[2292] 3. Input assistance:

[2293] The server retrieves the information required for the selected procedure from the database and sends it back to the terminal.

[2294] The terminal displays an input form and the user enters the required information.

[2295] 4. Emotion recognition:

[2296] The device uses an emotion processing mechanism to recognize the user's emotions based on facial expressions, voice tone, and input speed.

[2297] The server provides appropriate guidance and support based on the emotional information. For example, if the user seems anxious, it displays "Is there something I can help you with?"

[2298] 5. Notification of Completion of Procedure:

[2299] After the terminal completes all the input fields, it displays a submit button. When the user presses submit, the terminal sends the input data to the server.

[2300] The server checks the input data and registers it in the database, then sends a notification of completion of the procedure to the terminal and a confirmation email to the user.

[2301] 6. Emotional data logging and analysis:

[2302] The server stores the emotional data recognized by the emotion processing mechanism as a log and uses it to improve the user experience and procedures.

[2303] Specific examples

[2304] 1. Authentication Process:

[2305] The terminal displays the authentication screen, and the user enters "user123" and "password123." The server receives the authentication information, checks it against the database, and returns a successful authentication.

[2306] 2. Administrative procedure options:

[2307] The device displays a category selection screen, and the user selects "Notification of Moving Out." The server obtains detailed information about the notification of moving out and sends it to the device.

[2308] 3. Input assistance and emotion recognition:

[2309] The device displays an input form, and the user enters their new address, such as "No. XX, XX-chome, Minato-ku, Tokyo." The device validates the input in real time and recognizes the user's emotions using its emotion processing mechanism. The server then provides appropriate guidance and messages based on the emotion recognition.

[2310] 4. Complete the process:

[2311] The user presses send, and the device sends the data to the server. The server registers the data, sends a notification of completion to the device, and sends a confirmation email to the user. The server then stores the emotion data in a log and analyzes it.

[2312] Prompt Sentence Examples

[2313] After selecting "Notice of Moving Out," the message "Please contact us if you have any questions" will be displayed while you are entering the required information. Once the procedure is complete, the message "Thank you for completing the notification of moving out" will be displayed, and a confirmation email will be sent.

[2314] In this way, the present invention not only enables users to complete administrative procedures efficiently and reliably, but also reduces the stress and anxiety they may feel during the process. The introduction of an emotion processing mechanism provides more personalized support and improves the user experience.

[2315] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2316] Step 1:

[2317] The device displays the user authentication screen.

[2318] The device displays a screen for the user to enter their login ID and password. The user can enter the ID as "user123" and the password as "password123" at any time.

[2319] Step 2:

[2320] The user enters their credentials.

[2321] The user enters their ID and password in the input fields displayed on the screen and presses the login button. The ID and password are provided to the terminal as input data.

[2322] Step 3:

[2323] The terminal transmits the entered authentication information to the server.

[2324] The terminal uses the HTTPS protocol to send the entered ID and password to the server, which receives this information and processes the authentication information by packaging the data in JSON format and sending it.

[2325] Step 4:

[2326] The server checks the credentials against a database.

[2327] The server compares the received authentication information with the database to verify that the ID and password match. Specifically, it executes an SQL query to search for the corresponding record in the database and determines whether the authentication is successful (e.g., SQL query "SELECT FROM users WHERE ID = 'user123' AND password = 'password123'").

[2328] Step 5:

[2329] The server returns the authentication result to the terminal.

[2330] The server sends the authentication result in JSON format to the terminal. If successful, it returns a "Authentication successful" response, and if unsuccessful, it returns a "Authentication failed" response.

[2331] Step 6:

[2332] The terminal displays a screen for selecting categories for administrative procedures.

[2333] If authentication is successful, the device displays a screen for selecting administrative procedures, such as a list of procedures such as "Notification of Moving Out," "Notification of Moving In," and "Obtaining a Copy of Residence Certificate."

[2334] Step 7:

[2335] The user selects an administrative procedure.

[2336] The user selects the administrative procedure they wish to carry out and presses the select button. The selected procedure (e.g., "Notification of Moving Out") is then provided to the terminal as input data.

[2337] Step 8:

[2338] The terminal transmits the selection information to the server.

[2339] The terminal sends the selected procedure information to the server. The server receives this information and processes it. Specifically, it sends the selected procedure category in JSON format.

[2340] Step 9:

[2341] The server retrieves the details of the procedure from a database.

[2342] The server retrieves detailed information about the specified procedure from the database, using an SQL query to retrieve relevant information (e.g., required documents, requirements, and office locations) (e.g., "SELECT FROM procedures WHERE type = 'Notification of Moving Out'").

[2343] Step 10:

[2344] The server sends the procedure information back to the terminal.

[2345] The server sends the acquired procedure information in JSON format to the terminal, which receives this information and displays it to the user.

[2346] Step 11:

[2347] The device displays the input form.

[2348] The device will then display a form where you can enter the necessary details, including your new address, name, date of birth, etc.

[2349] Step 12:

[2350] The user enters information.

[2351] The user enters the required information into each form field. For example, the new address is "No. XX, Minato-ku, Tokyo" and the name is "Taro Yamada." The input information is provided to the terminal.

[2352] Step 13:

[2353] The terminal validates the input in real time.

[2354] The device uses JavaScript and regular expressions to check the information entered in real time, for example, to ensure that the postal code is formatted correctly and that all required fields are filled in.

[2355] Step 14:

[2356] The device uses an emotion processing mechanism to recognize the user's emotions.

[2357] The device uses a camera and microphone to input the user's facial expressions, voice tone, and typing speed into emotion recognition algorithms, which use OpenCV and TensorFlow to analyze the emotion data.

[2358] Step 15:

[2359] The server generates appropriate guidance and messages based on the user's emotions based on the emotion processing mechanism.

[2360] The server uses the recognized emotion data to generate an appropriate support message, for example, "Is there anything I can help you with?" if the user appears anxious.

[2361] Step 16:

[2362] After the terminal has completed all the input fields, it will display a submit button.

[2363] If all required fields are filled in correctly, the terminal will enable a submit button. When the user presses submit, the data will be sent to the server.

[2364] Step 17:

[2365] The terminal transmits the input information to the server.

[2366] The terminal sends all input data to the server in JSON format.

[2367] Step 18:

[2368] The server will reconfirm the information and register it in the database.

[2369] The server checks the received data, verifies its accuracy, and then stores the information in the database (e.g., "INSERT INTO procedures (user_id, procedure_type, details) VALUES (...);").

[2370] Step 19:

[2371] The server sends a procedure completion notification to the terminal.

[2372] Once the registration in the database is complete, the server sends a notification of completion of the procedure to the terminal, along with detailed information about the procedure to the user.

[2373] Step 20:

[2374] The device will display a completion screen.

[2375] The device will display a screen informing the user that the procedure is complete.

[2376] Step 21:

[2377] The server sends a confirmation email to the user.

[2378] The s...

Claims

1. means for receiving and authenticating user-entered authentication information; A means for providing a screen for selecting administrative procedures to a user who has been successfully authenticated; means for retrieving from the database and providing to the user the information required for the selected administrative procedure; A means for receiving and validating the procedure entered by the user; A means of registering the successfully validated procedure details in the database and notifying the completion of the procedure; A system including:

2. The system of claim 1 , further comprising means for sending a confirmation of completion of the procedure to the user.

3. The system according to claim 1, further comprising means for validating input procedure details in real time.

Images