System

Abstract

A system is provided.SOLUTION: This system includes a means for inputting an application content by a resident, a means for inputting basic information of the resident by the resident, a means for transmitting the input application content and basic information to a server, a means for receiving and analyzing the transmitted application content and basic information, a means for specifying a necessary document on the basis of an analysis result, and a means for presenting the specified necessary document list to the resident.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] When residents carry out administrative procedures, the required documents include resident registration certificates, but there are many different types of documents, making it difficult to accurately understand which documents are required. This poses a problem: it takes a great deal of time and effort to gather the necessary documents before going to the counter. In particular, it takes time to obtain the correct documents in advance based on the application content, making the procedures at the counter inefficient. To solve this problem, a system is needed that allows residents to understand the correct required documents in advance based on the application content and prepare them efficiently. [Means for solving the problem]

[0005] The present invention provides a means for residents to input application details, a means for residents to input their own basic information, and a means for transmitting the input application details and basic information to a server, thereby enabling residents to easily transmit the necessary information. Furthermore, the server has a means for receiving and analyzing the transmitted application details and basic information, automatically identifying the necessary documents corresponding to the application details. As a result, the server presents a list of identified necessary documents to residents, allowing them to clearly understand which documents they need to prepare in advance. Furthermore, the present invention provides a means for residents to prepare documents based on the required documents indicated, supporting residents in efficiently preparing the correct documents. Furthermore, the present invention provides a means for residents to upload documents prepared online for advance confirmation, allowing for advance confirmation of procedures and preventing inadequate preparation. Finally, the server has a means for verifying received document data and notifying residents of the results, allowing residents to complete the necessary document confirmation before visiting the counter, thereby smoothly progressing through the procedures.

[0006] "Resident" refers to an individual who resides in a particular municipality or region.

[0007] "Application content" refers to the specific type and purpose of the procedure that a resident wishes to submit for administrative processing.

[0008] "Basic information" refers to information necessary to identify a resident, such as their name, address, and telephone number.

[0009] "Terminal" refers to devices such as computers, smartphones, and tablets that residents use to input and view data.

[0010] "Server" refers to the central computing system that receives, analyzes, and processes data sent by residents.

[0011] A "data packet" refers to a unit of a series of data sent from a terminal to a server.

[0012] "Analysis" refers to the process of breaking down received data and extracting the necessary information.

[0013] A "database" is a large collection of data stored on a server, and refers to a system that manages and provides information according to the application content.

[0014] "Required documents" refers to official documents and certificates required to carry out certain administrative procedures.

[0015] "Identify" means to clearly identify what is needed based on given conditions and information.

[0016] "Presenting" refers to visually showing specific information to residents.

[0017] "Preparing" refers to having what is needed for a particular purpose in advance.

[0018] "Preliminary confirmation" refers to checking the contents of the necessary documents in advance and verifying that there are no errors in the procedures.

[0019] "Uploading" refers to sending data from a terminal to a server.

[0020] "Verify" refers to the process of checking whether the data or documents received are accurate.

[0021] "Notify" refers to contacting residents with verification results and other important information. [Brief explanation of the drawings]

[0022] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3]FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0023] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0024] First, the terms used in the following description will be explained.

[0025] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0026] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0027] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0028] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0029] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0030] [First embodiment]

[0031] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0032] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0033] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0034] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0035] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0036] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0037] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0038] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0039] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0040] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0041] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0042] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0043] The system of the present invention aims to present necessary documents according to the application contents in advance so that residents can smoothly carry out administrative procedures. This system includes a process in which the user (resident) inputs the application contents and basic information, and the server identifies and presents the appropriate necessary documents based on that information.

[0044] System configuration

[0045] This system consists of the following main components:

[0046] 1. User Device

[0047] A device used by users (residents) to enter application details and basic information. This includes smartphones, PCs, tablets, etc.

[0048] 2. Server

[0049] This is a central computing system that receives and analyzes application details and basic information sent from user terminals.

[0050] 3. Database

[0051] This is a database that manages information on required documents. The server references this database based on the analysis results and identifies the required documents.

[0052] Program processing overview

[0053] 1. The user enters the application details and basic information

[0054] The user accesses the system using their own terminal and selects or inputs the application details (e.g., "address change procedure"), as well as basic information such as name, address, and phone number.

[0055] 2. The device sends the input data to the server

[0056] The terminal collects the application details and basic information input by the user into one data packet and transmits it to the server.

[0057] 3. The server analyzes the received data

[0058] The server receives the data packet sent from the terminal and analyzes the application and basic information, which is then used to reference the database.

[0059] 4. The server identifies the required documents

[0060] Based on the analyzed application details, the server refers to the database and identifies the necessary documents for the application. For example, it identifies that a copy of the residence certificate and identification documents are required for an address change procedure.

[0061] 5. The server sends the list of required documents to the user's device.

[0062] The server sends the list of required documents to the user terminal, which displays the list to the user, allowing the user to know in advance which documents they need to prepare.

[0063] 6. User prepares documents

[0064] The user prepares the necessary documents based on the list of required documents provided. For example, the user may obtain a copy of their resident registration card from the city hall and prepare a driver's license.

[0065] 7. Optional - User makes pre-confirmation reservation

[0066] Users can upload the documents they have prepared online for advance confirmation, allowing them to check whether they have all the necessary documents before going to the counter.

[0067] Specific examples

[0068] Example 1: Address change procedure

[0069] User A has moved to a new address and wants to change his / her address. User A accesses the system using his / her smartphone and selects "Change of Address Procedure."

[0070] Next, enter basic information such as your name, old address, new address, and phone number.

[0071] User A's smartphone sends this information to the server.

[0072] The server identifies the documents required for the address change procedure from the database and notifies User A that a "copy of resident registration" and "identification documents" are required.

[0073] User A obtains a copy of his / her resident registration card from the city hall and prepares his / her driver's license.

[0074] By uploading these documents online and having them checked in advance, the process at the counter can be completed smoothly.

[0075] In this way, the system of the present invention supports residents in efficiently preparing for administrative procedures, and provides functions that speed up and improve the accuracy of procedures at the counter.

[0076] The processing flow will be explained below.

[0077] Step 1:

[0078] The user accesses the system using their own terminal and selects the application content, such as "address change procedure," from the menu displayed on the system interface.

[0079] Step 2:

[0080] The user enters basic information such as name, old address, new address, phone number, etc. This information must be entered accurately as it is required for procedures related to the application.

[0081] Step 3:

[0082] The terminal collects the application details and basic information entered by the user into a single data packet, sends the collected data packet to the server, and notifies the user that the data transmission has been completed successfully.

[0083] Step 4:

[0084] The server receives the data packet sent from the device, analyzes the received data packet, and individually extracts the application details (e.g., "change of address") and basic information (name, old address, new address, phone number, etc.).

[0085] Step 5:

[0086] Based on the application details extracted by the server, the server refers to an internal database to identify the documents required for the address change procedure. For example, it identifies that a "copy of the residence certificate" and "identification documents" are required for the address change procedure.

[0087] Step 6:

[0088] The server sends the specified list of required documents to the user terminal in a data packet, which includes the types of documents required and specific descriptions.

[0089] Step 7:

[0090] The device displays the list of required documents received from the server to the user. For example, the message "The following documents are required for address change procedures: 1. Copy of residence certificate 2. Identification document (driver's license, etc.)" is displayed.

[0091] Step 8:

[0092] The user prepares the necessary documents based on the list of required documents provided. For example, the user obtains a copy of their resident registration card from the city hall and prepares their driver's license.

[0093] Step 9:

[0094] As an optional feature, users can upload documents they have prepared online for pre-checking, and the server will then validate the documents received and check for any errors.

[0095] Step 10:

[0096] The server verifies the received documents and notifies the user of the results. The user can then check the verification results and smoothly proceed with the procedure at the counter.

[0097] Example 1

[0098] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0099] With the current administrative procedure system, residents are unable to ascertain the necessary documents in advance, which often results in delays in procedures at the counter. In addition, if there are any deficiencies or omissions in the application details, residents must redo the procedure, which places a significant burden on them. Furthermore, because documents cannot be checked online, there are many cases where procedures are carried out without sufficient preparation in advance. Therefore, there is a need for a system that allows residents to efficiently prepare for administrative procedures and improves the speed and accuracy of procedures at the counter.

[0100] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0101] In this invention, the server includes a means for residents to input application details and basic information using their own terminals, and a process for the server to identify and present the appropriate required documents; a means for displaying an error message if there are any omissions or errors when the applicant inputs the basic information; and a means for generating a log and sending an alert when the server analyzes the received data. This allows residents to know in advance which documents they need to prepare, allowing for smoother procedures at the counter. Furthermore, early detection of omissions or errors eliminates the need to redo the procedures. Furthermore, advance document confirmation online allows for more efficient procedure preparation.

[0102] "Residents" refers to ordinary individuals who carry out administrative procedures.

[0103] "Application details" refers to the specific types of procedures that residents enter when carrying out administrative procedures.

[0104] "Basic information" refers to personal information such as name, address, and telephone number.

[0105] "Terminal" refers to electronic devices such as smartphones, computers, and tablets.

[0106] "Server" refers to the central computer system that receives and analyzes data sent by residents and identifies required documents.

[0107] "Data Packet" refers to a collection of information including application details and basic information.

[0108] "Parsing" refers to the process by which the server extracts and understands the application and basic information from the data packets it receives.

[0109] "Database" refers to the information management system in which information on required documents is stored.

[0110] "List of required documents" refers to a list of documents that residents must prepare based on the application details.

[0111] A "prompt" refers to a specific instruction that is input into a generative AI model.

[0112] "Error message" refers to a warning message that is displayed when there is an error or omission in the information entered.

[0113] "HTTPS protocol" refers to a secure communications protocol used when transmitting data.

[0114] A "buffer" refers to a storage area within a server that temporarily stores data.

[0115] "Log" refers to a record of system operations, errors, etc.

[0116] "Pre-check" refers to the process of checking preparatory documents before proceeding.

[0117] "Upload" refers to the act of sending data from a terminal to a server.

[0118] The system of the present invention aims to present necessary documents according to the application details in advance so that residents can complete administrative procedures smoothly. This system involves a process in which residents input the application details and basic information, and the server identifies and presents the appropriate necessary documents based on that information.

[0119] System configuration

[0120] This system consists of the following main components:

[0121] 1. User Device

[0122] A device used by users (residents) to enter application details and basic information. This includes smartphones, PCs, tablets, etc.

[0123] 2. Server

[0124] This is a central computing system that receives and analyzes application details and basic information sent from user terminals.

[0125] 3. Database

[0126] This is a database that manages information on required documents. The server references this database based on the analysis results and identifies the required documents.

[0127] Program processing overview

[0128] 1. The user enters the application details and basic information

[0129] The user accesses the system using their own terminal and selects or inputs the application details (e.g., "address change procedure"), as well as basic information such as name, address, and phone number.

[0130] 2. The device sends the input data to the server

[0131] The terminal collects the application details and basic information entered by the user into a single data packet and sends it to the server. The data is encrypted using the HTTPS protocol during transmission.

[0132] 3. The server analyzes the received data

[0133] The server receives the data packet sent from the terminal and analyzes the application content and basic information using common data analysis algorithms and natural language processing techniques.

[0134] 4. The server identifies the required documents

[0135] The server then references the database based on the analyzed application content and identifies the necessary documents for the application. For example, it identifies that a copy of the residence certificate and identification documents are required for an address change procedure. During the analysis process, a log is generated to record the progress and any errors.

[0136] 5. The server sends the list of required documents to the user's device.

[0137] The server sends the list of required documents to the user terminal, which displays the list to the user, allowing the user to know in advance which documents they need to prepare.

[0138] 6. User prepares documents

[0139] The user prepares the necessary documents based on the list of required documents provided. For example, the user obtains a copy of their resident registration card from the city hall and prepares their driver's license.

[0140] 7. User makes advance confirmation reservation (optional)

[0141] Users can upload the prepared documents online for pre-checking. This is done via the system's check page, and the server receives the uploaded documents and checks their contents. The check result will be notified to the user.

[0142] Specific examples

[0143] Example 1: Address change procedure

[0144] User A has moved to a new address and wants to change his / her address. User A accesses the system using his / her smartphone and selects "Change of Address Procedure."

[0145] Next, enter basic information such as your name, old address, new address, and phone number.

[0146] User A's smartphone sends this information to the server.

[0147] The server identifies the documents required for the address change procedure from the database and notifies User A that a "copy of resident registration" and "identification documents" are required.

[0148] User A obtains a copy of his / her resident registration card from the city hall and prepares his / her driver's license.

[0149] By uploading these documents online and having them checked in advance, the process at the counter can be completed smoothly.

[0150] Prompt Sentence Examples

[0151] You can get more detailed help and explanations by inputting the following prompts into the generative AI model:

[0152] If a user wants to change their address because they're moving, what information should they enter and what documents should they prepare? The prompt sequence is as follows:

[0153] 1. Select "Change of Address Procedure" as the application content.

[0154] 2. Enter basic information such as your name, old address, new address, and phone number.

[0155] 3. The server identifies the necessary documents and notifies the user that a "copy of residence certificate" and "identification documents" are required.

[0156] 4. The user prepares these documents.

[0157] 5. Optionally, users can upload documents online for pre-verification.

[0158] This system provides support to residents to efficiently prepare for administrative procedures and expedite procedures at the counter.

[0159] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0160] Step 1:

[0161] The user enters the application details and basic information. The user accesses the system using their own device (smartphone, PC, tablet). They enter their ID and password on the login screen to authenticate. After logging in, they select the application details, such as "Address Change Procedure," from the main menu. Next, they enter basic information such as name, old address, new address, and phone number for each field. Once all information has been entered, they click the "Submit" button. Based on the user's input, the system acquires the application details and basic information as data.

[0162] Step 2:

[0163] The terminal sends the input data to the server. The terminal compiles the application details and basic information entered by the user into a single JSON format data packet. This data packet is sent to the server using the HTTPS protocol. The data is encrypted during transmission to ensure security. The input data is sent to the server in JSON format and is temporarily stored in a buffer on the server.

[0164] Step 3:

[0165] The server analyzes the received data. The server receives data packets sent from the terminal and stores them in a buffer. A back-end program retrieves the data from the buffer and analyzes the application content and basic information. This analysis uses common data analysis algorithms and natural language processing techniques. The analyzed data is then formatted in preparation for a database query. During the analysis process, logs are generated and alerts are sent.

[0166] Step 4:

[0167] The server identifies the required documents. Based on the analyzed application details, the server executes a database query to identify the required documents. The database stores a list of required documents for each application. For example, it identifies that a "change of address procedure" requires a "copy of resident registration" and "identification documents." The server receives the results of the database query and compiles the list of required documents into a response data packet.

[0168] Step 5:

[0169] The server sends a list of required documents to the user terminal. The server then sends the generated response data packet to the user terminal using the HTTPS protocol. The user terminal analyzes the received data packet and displays the list of required documents on the screen. This allows the user to check the documents that need to be prepared in advance.

[0170] Step 6:

[0171] The user prepares the documents. The user prepares the documents based on the displayed list of required documents. For example, the user goes to the city hall to obtain a copy of the resident registration card and prepares a driver's license. The user can enter the preparation status into the system in the form of a check box and check the progress.

[0172] Step 7:

[0173] The user makes a reservation for advance verification (optional). The user accesses the system again to have the prepared documents verified online. They go to the document upload screen and upload scans or images of their "copy of resident registration" and "identification documents." Once the upload is complete, they click the "Request verification" button. The server receives the uploaded documents and verifies their contents. The verification results are notified to the user's device, and they can see which documents are missing.

[0174] (Application example 1)

[0175] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0176] In conventional administrative procedure systems, it was difficult for users to understand in advance what documents were required for their application, which often made the procedures cumbersome. Another problem was that procedures at the counter did not proceed smoothly. In addition, there was no way for residents to check information in real time using advanced devices such as smart glasses, making it difficult to complete procedures efficiently.

[0177] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0178] In this invention, the server includes a means for residents to input application details, a means for residents to input their own basic information, a means for transmitting the input application details and basic information to the server, a means for receiving and analyzing the transmitted application details and basic information, a means for identifying required documents based on the analysis results, a means for presenting a list of identified required documents to the resident, and a means for presenting the list of required documents to the resident in real time using smart glasses. This allows residents to know and prepare the necessary documents in advance, allowing for smooth procedures at the counter. In addition, using smart glasses allows for real-time information acquisition, enabling efficient procedures.

[0179] A "resident" is an individual who resides in a particular area and is required to carry out administrative procedures.

[0180] "Application details" refers to information that indicates the specific types and details of administrative procedures that residents wish to carry out.

[0181] "Basic information" refers to data that identifies a resident, such as their name, address, and phone number.

[0182] "Server" refers to a central computing system that receives and analyzes application details and basic information sent by users.

[0183] The "list of required documents" is a list of documents that need to be prepared according to the application content.

[0184] "Smart glasses" are advanced computing devices that can be worn by a user to display information in their field of vision.

[0185] A "database" is an information storage system that manages information on required documents and is referenced by the server.

[0186] "Analysis" refers to data processing to identify required documents based on the application details and basic information received by the server.

[0187] "Documents" are documents necessary for carrying out administrative procedures.

[0188] "Transmission" is the process of sending data from a user terminal to a server.

[0189] System configuration

[0190] A system for implementing the present invention comprises the following major components:

[0191] 1. User Device

[0192] A device used by users (residents) to enter application details and basic information. This includes smart glasses, smartphones, PCs, tablets, etc.

[0193] 2. Server

[0194] This is a central computing system that receives and analyzes application details and basic information sent from user terminals.

[0195] 3. Database

[0196] This is a database that manages information on required documents. The server references this database based on the analysis results and identifies the required documents.

[0197] Program processing overview

[0198] User terminal

[0199] By using the smart glasses, users can intuitively input application details and basic information. The smart glasses support users by displaying input forms and guides in their field of vision.

[0200] server

[0201] The system receives and analyzes the application details and basic information sent from the device. Based on the analysis, it identifies the necessary documents from a database. Natural language processing technology can be used for the analysis, and accuracy can be improved by utilizing generative AI models (e.g., GPT-3 (registered trademark)).

[0202] Database

[0203] The database stores information on documents required for various administrative procedures. The server references the database based on the analysis results and identifies the necessary documents appropriate for the application.

[0204] User Notifications

[0205] The identified list of required documents will be displayed in real time on the user's smart glasses, allowing the user to know and prepare the necessary documents in advance.

[0206] Operation procedures and usage examples

[0207] Let's say a user arrives at city hall and wants to change their address because they have moved to a new address. They launch the app installed on their smart glasses and select "Change of Address Procedure." Next, they enter basic information such as their name, old address, new address, and phone number. The user data is sent from the smart glasses to the server, which analyzes it. After a few seconds, a message appears saying, "To change your address, you will need a copy of your resident registration card and a form of identification (driver's license)."

[0208] Prompt Sentence Examples

[0209] "The user enters the request 'Change of Address' and basic information (name, old address, new address, phone number). The server analyzes this information, identifies the required documents, and generates a list. The required documents are presented to the user in real time through the smart glasses. Please explain this process in natural language."

[0210] As a result, users can smoothly complete procedures at the counter. In addition, by using smart glasses, they can obtain information in real time, making procedures more efficient.

[0211] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0212] Step 1:

[0213] The user starts up the smart glasses and enters the application details and basic information. A menu for selecting "Address Change Procedure" appears on the smart glasses screen. The user then uses touch or voice input to enter basic information such as name, old address, new address, and phone number. The entered data is temporarily stored in the internal memory.

[0214] Input: Application details selected by the user (e.g., address change procedure) and basic information (name, old address, new address, phone number)

[0215] Output: Temporarily save input data

[0216] Step 2:

[0217] The user device sends the entered application details and basic information to the server. A data packet is generated through the smart glasses' communication module and sent as a POST request to the server's API endpoint.

[0218] Input: Data entered by the user (application details and basic information)

[0219] Output: Data packet sent to the server

[0220] Step 3:

[0221] The server analyzes the received data. The server deserializes the received data packet and analyzes the application content and basic information. It performs natural language analysis using a generative AI model to extract parameters to identify required documents.

[0222] Input: Submitted application details and basic information

[0223] Output: Parsed parameters

[0224] Step 4:

[0225] The server identifies the required documents. The server sends a query to the database and lists the documents required for the relevant procedure based on the parsed parameters. The listed document information is organized as structured data within the server.

[0226] Input: Parsed parameters (e.g., documents required for address change procedures)

[0227] Output: Required documents list

[0228] Step 5:

[0229] The server sends the required document list to the user terminal. The compiled required document list is converted back into data packets and sent to the smart glasses. If communication is successful, the smart glasses receive the data and display the required document list on their screen.

[0230] Input: Required documents list

[0231] Output: Sending data packet and displaying list of required documents

[0232] Step 6:

[0233] The user prepares the necessary documents (e.g., a copy of the resident registration card and identification documents) while looking at the display screen of the smart glasses. The user physically collects and prepares the documents according to the displayed instructions.

[0234] Input: List of required documents displayed on smart glasses

[0235] Output: Prepared document

[0236] Step 7:

[0237] (Optional) The user uploads the documents they have prepared for pre-check online. Using smart glasses or other devices, they take photos or scans of the documents and enter them into a dedicated upload form, then send them to the server. The server then checks the uploaded data to ensure that the required documents are properly prepared.

[0238] Input: Uploaded document data

[0239] Output: Document pre-check results

[0240] By following the above steps, users can grasp the necessary documents in real time and carry out administrative procedures efficiently and smoothly.

[0241] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0242] The system of the present invention aims to present necessary documents in advance according to the application details so that residents can complete administrative procedures smoothly. This system involves a process in which the user (resident) inputs the application details and basic information, and the server identifies and presents the appropriate necessary documents based on that information. The present invention also aims to improve the user experience by combining it with an emotion engine that recognizes the user's emotions.

[0243] System configuration

[0244] This system consists of the following main components:

[0245] 1. User Device

[0246] A device used by users (residents) to enter application details and basic information. This includes smartphones, PCs, tablets, etc.

[0247] It is equipped with an emotion engine that recognizes the user's emotions in real time.

[0248] 2. Server

[0249] This is a central computing system that receives and analyzes application details and basic information sent from user terminals.

[0250] The necessary documents are identified and the results are sent to the user's terminal.

[0251] 3. Database

[0252] This is a database that manages information on required documents. The server references this database based on the analysis results and identifies the required documents.

[0253] 4. Emotion Engine

[0254] It is an engine for recognizing the user's emotions, analyzing the emotional state (e.g., stress, happiness, etc.) when the user inputs.

[0255] The interface and message content are adjusted based on the output of the emotion engine.

[0256] Program processing overview

[0257] 1. The user enters the application details and basic information

[0258] The user accesses the system using their own terminal and selects or inputs the application details (e.g., "address change procedure"), as well as basic information such as name, address, and phone number.

[0259] The emotion engine recognizes and analyzes the emotions expressed by users as they type.

[0260] 2. The device sends the input data to the server

[0261] The terminal collects the application details and basic information input by the user into one data packet and transmits it to the server.

[0262] 3. The server analyzes the received data

[0263] The server receives the data packet sent from the terminal and analyzes the application and basic information, which is then used to reference the database.

[0264] 4. The server identifies the required documents

[0265] Based on the analyzed application details, the server refers to the database to identify the necessary documents for the application. For example, it identifies that a copy of the residence certificate and identification documents are required for an address change procedure.

[0266] 5. The server sends the list of required documents to the user's device.

[0267] The server sends the identified list of required documents to the user's terminal, which then displays the list to the user, allowing the user to know in advance which documents they need to prepare.

[0268] 6. Interface adjustment according to user emotions

[0269] If the user's stress level is high based on the output of the emotion engine, the interface display and messages are adjusted, such as adding guide messages or suggesting ways to help the user relax.

[0270] 7. User prepares documents

[0271] The user prepares the necessary documents based on the list of required documents provided. For example, the user may obtain a copy of their resident registration card from the city hall and prepare a driver's license.

[0272] 8. Optional - User makes pre-confirmation reservation

[0273] Users can upload prepared documents online for advance confirmation, and the server will then verify the received documents and check for any errors.

[0274] 9. The server verifies the document data

[0275] The server verifies the received documents and notifies the user of the results. The user can then check the verification results and smoothly proceed with the procedure at the counter.

[0276] Specific examples

[0277] Example 1: Address change procedure

[0278] User A has moved to a new address and wants to change his / her address. User A accesses the system using his / her smartphone and selects "Change of Address Procedure."

[0279] Next, the user enters basic information such as name, old address, new address, phone number, etc. The emotion engine recognizes User A's emotions while entering these details, and if it detects high stress, the system displays a gentle guide message to support User A.

[0280] User A's smartphone sends this information to the server.

[0281] The server identifies the documents required for the address change procedure from the database and notifies User A that a "copy of resident registration" and "identification documents" are required.

[0282] User A obtains a copy of his / her resident registration card from the city hall and prepares his / her driver's license.

[0283] By uploading these documents online and having them checked in advance, the process at the counter can be completed smoothly.

[0284] In this way, the system of the present invention aims not only to enable residents to efficiently prepare for administrative procedures, but also to improve the user experience by incorporating an emotion engine, which reduces user stress and allows procedures to proceed more smoothly.

[0285] The processing flow will be explained below.

[0286] Step 1:

[0287] The user accesses the system using their own terminal and selects the application content, such as "address change procedure," from the menu displayed on the interface.

[0288] Step 2:

[0289] The user enters basic information such as name, old address, new address, phone number, etc. This information must be entered accurately as it is required for procedures related to the application.

[0290] Step 3:

[0291] The emotion engine recognizes the user's emotions in real time. While the user is typing on the device, it uses facial recognition technology and voice analysis to analyze their emotional state, such as stress or happiness.

[0292] Step 4:

[0293] The emotion engine adjusts the interface display and messages based on the user's emotional state. For example, if the user is feeling stressed, more helpful and easy-to-understand guidance messages will be displayed.

[0294] Step 5:

[0295] The terminal assembles the application details and basic information entered by the user into a single data packet and sends it to the server. The user is notified that the data transmission has been completed successfully.

[0296] Step 6:

[0297] The server receives the data packet sent from the device, analyzes the received data packet, and individually extracts the application details (e.g., "change of address") and basic information (name, old address, new address, phone number, etc.).

[0298] Step 7:

[0299] Based on the application details extracted by the server, the server refers to an internal database to identify the documents required for the address change procedure. For example, it identifies that a "copy of the residence certificate" and "identification documents" are required.

[0300] Step 8:

[0301] The server sends the list of required documents to the user's terminal in a data packet, which contains detailed information about the required documents, how to obtain them, and how to submit them.

[0302] Step 9:

[0303] The device displays the list of required documents received from the server to the user. The message displayed is, "The following documents are required for the address change procedure: 1. Copy of residence certificate 2. Identification document (driver's license, etc.)."

[0304] Step 10:

[0305] The user prepares the necessary documents based on the list of required documents provided. For example, the user obtains a copy of their resident registration card from the city hall and prepares their driver's license.

[0306] Step 11:

[0307] Users can upload documents they have prepared for pre-verification online, by taking a scan or photo of the document and submitting it to the system.

[0308] Step 12:

[0309] The server validates the document data received to ensure accuracy and completeness, especially to ensure the document format and content are correct.

[0310] Step 13:

[0311] The server notifies the user of the verification results. The user checks the results and, if any corrections are necessary, submits the documents again. After the final verification is complete, the procedure at the counter can proceed smoothly.

[0312] Example 2

[0313] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0314] In modern administrative procedures, it is extremely important for residents to prepare the appropriate necessary documents in advance. However, it is often unclear which documents should be prepared, which results in wasted time and effort during the procedure. Furthermore, the procedure can become even more difficult if residents experience emotional stress. For this reason, there is a need for residents to carry out administrative procedures efficiently and smoothly.

[0315] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for receiving and analyzing the transmitted application content and basic information, means for identifying appropriate required documents from a database based on the analysis, means for presenting the identified list of required documents to the resident, emotion recognition means for recognizing and analyzing the resident's emotions in real time, and means for adjusting the interface according to the resident's emotions. This allows the resident to clearly understand which documents they need to prepare, reduces emotional stress, and allows the procedure to proceed smoothly.

[0316] "Residents" refers to users who carry out administrative procedures, and are applicants on an individual or household basis.

[0317] "Application details" refers to the specific procedural items that residents enter or select when carrying out administrative procedures.

[0318] "Basic information" refers to the personal information of residents required for the application process, and specifically includes name, address, telephone number, etc.

[0319] "Server" refers to a central computing system for receiving and analyzing data sent from resident devices.

[0320] The "database" is a data storage system that the server references based on the analysis results and manages information on required documents.

[0321] "Emotion recognition means" refers to technology for recognizing and analyzing residents' emotions in real time.

[0322] "Interface" refers to the screen display and operation methods that residents use to interact with the system.

[0323] "Required Document List" refers to a list of documents required for a specified application procedure.

[0324] The system of this invention aims to help residents complete administrative procedures smoothly by presenting the necessary documents in advance according to the application content. This system is mainly composed of a user terminal, a server, and a database. Furthermore, it aims to improve the user experience by utilizing emotion recognition technology to analyze the emotions of residents when completing procedures and adjust the interface accordingly.

[0325] System configuration

[0326] 1. User Device

[0327] A user terminal is a device used by a user to input application details and basic information. It includes smartphones, PCs, tablets, etc.

[0328] The device is equipped with emotion recognition means to recognize and analyze the emotional state of residents in real time when they input information, using facial recognition and voice analysis technologies.

[0329] 2. Server

[0330] The server is a central computing system that receives and analyzes the application and basic information sent from the user terminal. This analysis is used to determine which required documents are needed.

[0331] Examples of specific software used include Python and R for data analysis, and SQL for database integration.

[0332] 3. Database

[0333] The database is a storage system for managing information on required documents. A typical example is a relational database such as PostgreSQL. The server references the database based on the analysis results and identifies the required documents.

[0334] 4. Emotion recognition means

[0335] Emotion recognition is a technology that recognizes and analyzes the user's emotions in real time. Based on the analysis results, it is possible to adjust the user interface and message content.

[0336] Specifically, the emotion recognition algorithm uses a generative AI model to analyze the user's facial expressions and tone of voice.

[0337] Specific examples

[0338] Address change procedures

[0339] Example 1: User A moves to a new address

[0340] User A accesses the system using a smartphone, logs in, and selects "Address change procedure."

[0341] Next, User A inputs his / her name, old address, new address, and phone number. If the emotion recognition means detects stress in User A, the system will display a friendly guide message to support him / her.

[0342] User A's smartphone assembles this information into a data packet and sends it to the server.

[0343] The server identifies the documents required for the address change procedure from the database and notifies User A that a "copy of resident registration" and "identification documents" are required.

[0344] User A obtains a copy of his / her resident registration card from the city hall and prepares his / her driver's license.

[0345] Furthermore, these documents can be uploaded online for pre-checking and the server will verify the documents.

[0346] The verification result is notified to User A, who can then check it and smoothly proceed with the procedure at the counter.

[0347] In this way, the system of the present invention aims not only to enable residents to efficiently prepare for administrative procedures, but also to improve the user experience by combining emotion recognition means, which can reduce residents' stress and make procedures more comfortable.

[0348] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0349] Step 1:

[0350] A user accesses the system. Specifically, the user accesses the system's web page using a smartphone, PC, or tablet, and a login screen appears. Here, the user enters their user ID and password to log in. The entered login information is sent by the device to the server. The server compares the entered user ID and password with a database and performs authentication. If authentication is successful, the user can proceed to the next screen.

[0351] Step 2:

[0352] The user inputs the application details and basic information. The user selects a specific application, such as "address change procedure," and inputs basic information such as name, old address, new address, and phone number. The input data is stored in the device's memory. In addition, an emotion recognition means analyzes the user's facial expressions and voice in real time to determine stress levels, etc. Specifically, the camera and microphone are used to capture the user's emotional data, which is then analyzed by the generative AI model.

[0353] Step 3:

[0354] The device sends the input data to the server. The application details and basic information entered by the user, as well as the emotional data analyzed by the emotion recognition means, are compiled into a single data packet and sent to the server via the Internet. At this time, the data is encrypted using the HTTPS protocol. The structure of the transmitted data is in JSON format, with the necessary information included in each field (e.g., { "Application details": "Change of address", "Name": "Yamada Taro", "Old address": "Tokyo", "New address": "Kanagawa", "Emotion data": { "Stress level": 0.75}}).

[0355] Step 4:

[0356] The server analyzes the received data. The server analyzes the received data packets and extracts the application details, basic information, and emotion data. To perform the analysis, it issues a query to the database and extracts the necessary information. Specifically, it uses an SQL query to obtain the information required for the "change of address procedure" and analyzes it together with the basic information. As a result of the analysis, it identifies which necessary documents are required.

[0357] Step 5:

[0358] The server identifies the required documents. Based on the analyzed application details, the server references the database and identifies the required documents appropriate for the application details. For example, it identifies that a "copy of resident registration" and "identification documents" are required for an address change procedure. This information is compiled into a list and sent to the user's terminal.

[0359] Step 6:

[0360] The server sends a list of required documents to the user's terminal. The server then sends the identified list of required documents in JSON format to the user's terminal. The sent data is received by the terminal and displayed to the user. The user can check which documents they need to prepare.

[0361] Step 7:

[0362] The user device adjusts the interface based on the emotion analysis results. If the emotion recognition means detects that the user's stress level is high, the system displays a gentle guide message. Specifically, the system displays advice for the user to relax and messages that clearly explain the steps of the procedure.

[0363] Step 8:

[0364] The user prepares the necessary documents. Based on the list of required documents provided, the user obtains the necessary documents from city hall or related institutions. For example, the user obtains a copy of their resident registration card from city hall and has their driver's license ready.

[0365] Step 9:

[0366] The user uploads documents online (optional). The user can upload the prepared documents to the system online. The uploaded data is sent from the terminal to the server, and the server verifies the received documents. After verification, the result is notified to the user. This process makes the procedure at the counter go more smoothly.

[0367] (Application example 2)

[0368] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0369] The process of preparing the necessary documents for administrative procedures often increases the amount of work and stress users experience. Furthermore, while the user experience is important for purchasing high-value items on online shopping sites, the process can be complicated and stressful. This can lead to users feeling confused and anxious about the process, ultimately making it difficult for them to complete the procedure.

[0370] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for analyzing the emotional state of the resident using an emotion recognition engine, means for adjusting the interface and presenting a friendly guide message based on the emotional state of the resident, and means for presenting a list of required documents. This allows the user's emotional state to be analyzed in real time and the interface and message content to be adjusted, allowing the user to proceed with the procedure with peace of mind.

[0371] "Residents" are users who use the system to input application details and basic information, identify required documents, and prepare the documents.

[0372] "Application content" refers to the information or content that a user must enter to proceed with an administrative procedure or a specific process.

[0373] "Basic information" refers to personal information such as name, address, and telephone number that is required when a user carries out a specific procedure.

[0374] A "communications network" is a computer network for sending and receiving information, such as the Internet.

[0375] "Server" means a central computing system that receives and analyzes the application and basic information sent by the User, and identifies and presents the required documents.

[0376] An "emotion recognition engine" is a software engine for analyzing a user's emotional state in real time.

[0377] An "interface" is a screen or operating environment that allows interaction between a user and a system.

[0378] The "list of required documents" is a list of documents that the user must prepare in order to proceed with the procedure.

[0379] A "gentle guide message" is a calming guide message that is provided to a user when the user feels stressed while proceeding with a procedure.

[0380] The system of the present invention aims to improve the user experience by using an emotion recognition engine to help residents smoothly complete administrative procedures and purchase procedures for high-value items on online shopping sites. This system is composed of the following main components:

[0381] The entire system includes a user terminal where users can input application details and basic information, a server that receives and analyzes the input data and identifies and presents required documents, a database that manages required document information, and an emotion recognition engine that recognizes the user's emotional state in real time.

[0382] 1. User Device

[0383] The user terminal is a device where the user can input application details and basic information. This includes smartphones and tablets. This terminal is equipped with an emotion recognition engine that analyzes the user's emotional state in real time.

[0384] 2. Server

[0385] The server receives and analyzes the application details and basic information sent from the user terminal via the communication network. Based on the analyzed data, the server identifies the required documents and sends a list of them to the user terminal.

[0386] 3. Database

[0387] The database is a component for managing information on required documents, and the server identifies the required documents by referencing them based on the analysis results.

[0388] 4. Emotion Recognition Engine

[0389] An emotion recognition engine is a software engine that analyzes the user's emotional state (stress, happiness, etc.) when inputting information. Based on the output of this engine, it has the ability to adjust the interface and message content of the user's device.

[0390] In this system, users enter their application details and basic information and send it to the server. The server analyzes the received data, identifies a list of required documents, and displays it on the user's device. If the user's emotional state is stressful, the interface is adjusted based on the output of the emotion recognition engine, and a friendly guidance message is displayed.

[0391] For example, if User A is about to purchase a high-priced item, he or she will use a smartphone to enter the necessary information. At this time, the emotion recognition engine will analyze User A's emotions and, if it determines that User A is under high stress, the interface will display a friendly guide message and briefly explain the procedure.

[0392] Specific examples

[0393] As an example of user input, if the text "I'm trying to purchase an expensive item, but I'm confused about the procedure" is given, the emotion recognition engine will identify the emotional state based on this input.

[0394] Example prompt sentence:

[0395] The EmotionEngine analyzes user input to identify their emotional state. Given the following input text, return an appropriate emotion (e.g., stress, happiness, etc.): Input text: "I'm trying to purchase an expensive item, but I'm having trouble with the process."

[0396] In this way, the system of the present invention recognizes and analyzes the user's emotional state and dynamically adjusts the interface and message content to allow the user to proceed smoothly, improving the user experience and reducing stress during the process.

[0397] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0398] Step 1:

[0399] The user inputs the application details and basic information into the user device (smartphone or tablet). The input details include the application details, such as "purchase a high-priced item," as well as basic information such as name, address, and phone number. The user device is equipped with an emotion recognition engine, which analyzes the user's emotional state in real time.

[0400] input:

[0401] Application details (e.g., purchasing a high-priced item)

[0402] Basic information (name, address, phone number, etc.)

[0403] output:

[0404] Emotional state analysis results (e.g., stress)

[0405] Step 2:

[0406] The user terminal transmits the input application details and basic information to the server via a communication network. The transmitted data includes the application details, basic information, and the analysis results of the emotional state.

[0407] input:

[0408] Application details and basic information

[0409] Emotional state analysis results

[0410] output:

[0411] Data packets sent to the server

[0412] Step 3:

[0413] The server analyzes the received data packet (application details, basic information, and emotional state analysis results). Based on the analyzed data, the server refers to a database to identify the required documents.

[0414] input:

[0415] Received data packet (application details, basic information, emotional state)

[0416] output:

[0417] Required Documents List

[0418] Step 4:

[0419] The server sends the specified list of required documents to the user terminal, which receives the list and presents it to the user.

[0420] input:

[0421] Identified list of required documents

[0422] output:

[0423] Required document list sent to user device

[0424] Step 5:

[0425] The interface of the user's device is adjusted based on the analysis results of the emotion recognition engine. Specifically, if the user is in a stressful state, a gentle guidance message is displayed. If the user's emotional state is relaxed, the normal interface is displayed.

[0426] input:

[0427] Emotional state analysis results

[0428] output:

[0429] Adjusted interface (e.g. friendly guide messages)

[0430] Step 6:

[0431] The user prepares the documents based on the required document list provided, and then uploads them to the server online according to the workflow.

[0432] input:

[0433] Required Documents List

[0434] output:

[0435] Prepared necessary documents

[0436] Step 7:

[0437] The server verifies the uploaded documents and notifies the user of the results, informing them if the documents are accurate or if additional documents are required.

[0438] input:

[0439] Uploaded documents

[0440] output:

[0441] Document verification results (e.g., no errors, additional documents required)

[0442] Through these steps, the system helps users to complete administrative procedures and purchase procedures for high-value items smoothly and without stress.

[0443] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0444] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0445] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0446] [Second embodiment]

[0447] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0448] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0449] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0450] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0451] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0452] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0453] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0454] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0455] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0456] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0457] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0458] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0459] The system of the present invention aims to present necessary documents according to the application contents in advance so that residents can smoothly carry out administrative procedures. This system includes a process in which the user (resident) inputs the application contents and basic information, and the server identifies and presents the appropriate necessary documents based on that information.

[0460] System configuration

[0461] This system consists of the following main components:

[0462] 1. User Device

[0463] A device used by users (residents) to enter application details and basic information. This includes smartphones, PCs, tablets, etc.

[0464] 2. Server

[0465] This is a central computing system that receives and analyzes application details and basic information sent from user terminals.

[0466] 3. Database

[0467] This is a database that manages information on required documents. The server references this database based on the analysis results and identifies the required documents.

[0468] Program processing overview

[0469] 1. The user enters the application details and basic information

[0470] The user accesses the system using their own terminal and selects or inputs the application details (e.g., "address change procedure"), as well as basic information such as name, address, and phone number.

[0471] 2. The device sends the input data to the server

[0472] The terminal collects the application details and basic information input by the user into one data packet and transmits it to the server.

[0473] 3. The server analyzes the received data

[0474] The server receives the data packet sent from the terminal and analyzes the application and basic information, which is then used to reference the database.

[0475] 4. The server identifies the required documents

[0476] Based on the analyzed application details, the server refers to the database and identifies the necessary documents for the application. For example, it identifies that a copy of the residence certificate and identification documents are required for an address change procedure.

[0477] 5. The server sends the list of required documents to the user's device.

[0478] The server sends the list of required documents to the user terminal, which displays the list to the user, allowing the user to know in advance which documents they need to prepare.

[0479] 6. User prepares documents

[0480] The user prepares the necessary documents based on the list of required documents provided. For example, the user may obtain a copy of their resident registration card from the city hall and prepare a driver's license.

[0481] 7. Optional - User makes pre-confirmation reservation

[0482] Users can upload the documents they have prepared online for advance confirmation, allowing them to check whether they have all the necessary documents before going to the counter.

[0483] Specific examples

[0484] Example 1: Address change procedure

[0485] User A has moved to a new address and wants to change his / her address. User A accesses the system using his / her smartphone and selects "Change of Address Procedure."

[0486] Next, enter basic information such as your name, old address, new address, and phone number.

[0487] User A's smartphone sends this information to the server.

[0488] The server identifies the documents required for the address change procedure from the database and notifies User A that a "copy of resident registration" and "identification documents" are required.

[0489] User A obtains a copy of his / her resident registration card from the city hall and prepares his / her driver's license.

[0490] By uploading these documents online and having them checked in advance, the process at the counter can be completed smoothly.

[0491] In this way, the system of the present invention supports residents in efficiently preparing for administrative procedures, and provides functions that speed up and improve the accuracy of procedures at the counter.

[0492] The processing flow will be explained below.

[0493] Step 1:

[0494] The user accesses the system using their own terminal and selects the application content, such as "address change procedure," from the menu displayed on the system interface.

[0495] Step 2:

[0496] The user enters basic information such as name, old address, new address, phone number, etc. This information must be entered accurately as it is required for procedures related to the application.

[0497] Step 3:

[0498] The terminal collects the application details and basic information entered by the user into a single data packet, sends the collected data packet to the server, and notifies the user that the data transmission has been completed successfully.

[0499] Step 4:

[0500] The server receives the data packet sent from the device, analyzes the received data packet, and individually extracts the application details (e.g., "change of address") and basic information (name, old address, new address, phone number, etc.).

[0501] Step 5:

[0502] Based on the application details extracted by the server, the server refers to an internal database to identify the documents required for the address change procedure. For example, it identifies that a "copy of the residence certificate" and "identification documents" are required for the address change procedure.

[0503] Step 6:

[0504] The server sends the specified list of required documents to the user terminal in a data packet, which includes the types of documents required and specific descriptions.

[0505] Step 7:

[0506] The device displays the list of required documents received from the server to the user. For example, the message "The following documents are required for address change procedures: 1. Copy of residence certificate 2. Identification document (driver's license, etc.)" is displayed.

[0507] Step 8:

[0508] The user prepares the necessary documents based on the list of required documents provided. For example, the user obtains a copy of their resident registration card from the city hall and prepares their driver's license.

[0509] Step 9:

[0510] As an optional feature, users can upload documents they have prepared online for pre-checking, and the server will then validate the documents received and check for any errors.

[0511] Step 10:

[0512] The server verifies the received documents and notifies the user of the results. The user can then check the verification results and smoothly proceed with the procedure at the counter.

[0513] Example 1

[0514] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0515] With the current administrative procedure system, residents are unable to ascertain the necessary documents in advance, which often results in delays in procedures at the counter. In addition, if there are any deficiencies or omissions in the application details, residents must redo the procedure, which places a significant burden on them. Furthermore, because documents cannot be checked online, there are many cases where procedures are carried out without sufficient preparation in advance. Therefore, there is a need for a system that allows residents to efficiently prepare for administrative procedures and improves the speed and accuracy of procedures at the counter.

[0516] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0517] In this invention, the server includes a means for residents to input application details and basic information using their own terminals, and a process for the server to identify and present the appropriate required documents; a means for displaying an error message if there are any omissions or errors when the applicant inputs the basic information; and a means for generating a log and sending an alert when the server analyzes the received data. This allows residents to know in advance which documents they need to prepare, allowing for smoother procedures at the counter. Furthermore, early detection of omissions or errors eliminates the need to redo the procedures. Furthermore, advance document confirmation online allows for more efficient procedure preparation.

[0518] "Residents" refers to ordinary individuals who carry out administrative procedures.

[0519] "Application details" refers to the specific types of procedures that residents enter when carrying out administrative procedures.

[0520] "Basic information" refers to personal information such as name, address, and telephone number.

[0521] "Terminal" refers to electronic devices such as smartphones, computers, and tablets.

[0522] "Server" refers to the central computer system that receives and analyzes data sent by residents and identifies required documents.

[0523] "Data Packet" refers to a collection of information including application details and basic information.

[0524] "Parsing" refers to the process by which the server extracts and understands the application and basic information from the data packets it receives.

[0525] "Database" refers to the information management system in which information on required documents is stored.

[0526] "List of required documents" refers to a list of documents that residents must prepare based on the application details.

[0527] A "prompt" refers to a specific instruction that is input into a generative AI model.

[0528] "Error message" refers to a warning message that is displayed when there is an error or omission in the information entered.

[0529] "HTTPS protocol" refers to a secure communications protocol used when transmitting data.

[0530] A "buffer" refers to a storage area within a server that temporarily stores data.

[0531] "Log" refers to a record of system operations, errors, etc.

[0532] "Pre-check" refers to the process of checking preparatory documents before proceeding.

[0533] "Upload" refers to the act of sending data from a terminal to a server.

[0534] The system of the present invention aims to present necessary documents according to the application details in advance so that residents can complete administrative procedures smoothly. This system involves a process in which residents input the application details and basic information, and the server identifies and presents the appropriate necessary documents based on that information.

[0535] System configuration

[0536] This system consists of the following main components:

[0537] 1. User Device

[0538] A device used by users (residents) to enter application details and basic information. This includes smartphones, PCs, tablets, etc.

[0539] 2. Server

[0540] This is a central computing system that receives and analyzes application details and basic information sent from user terminals.

[0541] 3. Database

[0542] This is a database that manages information on required documents. The server references this database based on the analysis results and identifies the required documents.

[0543] Program processing overview

[0544] 1. The user enters the application details and basic information

[0545] The user accesses the system using their own terminal and selects or inputs the application details (e.g., "address change procedure"), as well as basic information such as name, address, and phone number.

[0546] 2. The device sends the input data to the server

[0547] The terminal collects the application details and basic information entered by the user into a single data packet and sends it to the server. The data is encrypted using the HTTPS protocol during transmission.

[0548] 3. The server analyzes the received data

[0549] The server receives the data packet sent from the terminal and analyzes the application content and basic information using common data analysis algorithms and natural language processing techniques.

[0550] 4. The server identifies the required documents

[0551] The server then references the database based on the analyzed application content and identifies the necessary documents for the application. For example, it identifies that a copy of the residence certificate and identification documents are required for an address change procedure. During the analysis process, a log is generated to record the progress and any errors.

[0552] 5. The server sends the list of required documents to the user's device.

[0553] The server sends the list of required documents to the user terminal, which displays the list to the user, allowing the user to know in advance which documents they need to prepare.

[0554] 6. User prepares documents

[0555] The user prepares the necessary documents based on the list of required documents provided. For example, the user obtains a copy of their resident registration card from the city hall and prepares their driver's license.

[0556] 7. User makes advance confirmation reservation (optional)

[0557] Users can upload the prepared documents online for pre-checking. This is done via the system's check page, and the server receives the uploaded documents and checks their contents. The check result will be notified to the user.

[0558] Specific examples

[0559] Example 1: Address change procedure

[0560] User A has moved to a new address and wants to change his / her address. User A accesses the system using his / her smartphone and selects "Change of Address Procedure."

[0561] Next, enter basic information such as your name, old address, new address, and phone number.

[0562] User A's smartphone sends this information to the server.

[0563] The server identifies the documents required for the address change procedure from the database and notifies User A that a "copy of resident registration" and "identification documents" are required.

[0564] User A obtains a copy of his / her resident registration card from the city hall and prepares his / her driver's license.

[0565] By uploading these documents online and having them checked in advance, the process at the counter can be completed smoothly.

[0566] Prompt Sentence Examples

[0567] You can get more detailed help and explanations by inputting the following prompts into the generative AI model:

[0568] If a user wants to change their address because they're moving, what information should they enter and what documents should they prepare? The prompt sequence is as follows:

[0569] 1. Select "Change of Address Procedure" as the application content.

[0570] 2. Enter basic information such as your name, old address, new address, and phone number.

[0571] 3. The server identifies the necessary documents and notifies the user that a "copy of residence certificate" and "identification documents" are required.

[0572] 4. The user prepares these documents.

[0573] 5. Optionally, users can upload documents online for pre-verification.

[0574] This system provides support to residents to efficiently prepare for administrative procedures and expedite procedures at the counter.

[0575] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0576] Step 1:

[0577] The user enters the application details and basic information. The user accesses the system using their own device (smartphone, PC, tablet). They enter their ID and password on the login screen to authenticate. After logging in, they select the application details, such as "Address Change Procedure," from the main menu. Next, they enter basic information such as name, old address, new address, and phone number for each field. Once all information has been entered, they click the "Submit" button. Based on the user's input, the system acquires the application details and basic information as data.

[0578] Step 2:

[0579] The terminal sends the input data to the server. The terminal compiles the application details and basic information entered by the user into a single JSON format data packet. This data packet is sent to the server using the HTTPS protocol. The data is encrypted during transmission to ensure security. The input data is sent to the server in JSON format and is temporarily stored in a buffer on the server.

[0580] Step 3:

[0581] The server analyzes the received data. The server receives data packets sent from the terminal and stores them in a buffer. A back-end program retrieves the data from the buffer and analyzes the application content and basic information. This analysis uses common data analysis algorithms and natural language processing techniques. The analyzed data is then formatted in preparation for a database query. During the analysis process, logs are generated and alerts are sent.

[0582] Step 4:

[0583] The server identifies the required documents. Based on the analyzed application details, the server executes a database query to identify the required documents. The database stores a list of required documents for each application. For example, it identifies that a "change of address procedure" requires a "copy of resident registration" and "identification documents." The server receives the results of the database query and compiles the list of required documents into a response data packet.

[0584] Step 5:

[0585] The server sends a list of required documents to the user terminal. The server then sends the generated response data packet to the user terminal using the HTTPS protocol. The user terminal analyzes the received data packet and displays the list of required documents on the screen. This allows the user to check the documents that need to be prepared in advance.

[0586] Step 6:

[0587] The user prepares the documents. The user prepares the documents based on the displayed list of required documents. For example, the user goes to the city hall to obtain a copy of the resident registration card and prepares a driver's license. The user can enter the preparation status into the system in the form of a check box and check the progress.

[0588] Step 7:

[0589] The user makes a reservation for advance verification (optional). The user accesses the system again to have the prepared documents verified online. They go to the document upload screen and upload scans or images of their "copy of resident registration" and "identification documents." Once the upload is complete, they click the "Request verification" button. The server receives the uploaded documents and verifies their contents. The verification results are notified to the user's device, and they can see which documents are missing.

[0590] (Application example 1)

[0591] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0592] In conventional administrative procedure systems, it was difficult for users to understand in advance what documents were required for their application, which often made the procedures cumbersome. Another problem was that procedures at the counter did not proceed smoothly. In addition, there was no way for residents to check information in real time using advanced devices such as smart glasses, making it difficult to complete procedures efficiently.

[0593] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0594] In this invention, the server includes a means for residents to input application details, a means for residents to input their own basic information, a means for transmitting the input application details and basic information to the server, a means for receiving and analyzing the transmitted application details and basic information, a means for identifying required documents based on the analysis results, a means for presenting a list of identified required documents to the resident, and a means for presenting the list of required documents to the resident in real time using smart glasses. This allows residents to know and prepare the necessary documents in advance, allowing for smooth procedures at the counter. In addition, using smart glasses allows for real-time information acquisition, enabling efficient procedures.

[0595] A "resident" is an individual who resides in a particular area and is required to carry out administrative procedures.

[0596] "Application details" refers to information that indicates the specific types and details of administrative procedures that residents wish to carry out.

[0597] "Basic information" refers to data that identifies a resident, such as their name, address, and phone number.

[0598] "Server" refers to a central computing system that receives and analyzes application details and basic information sent by users.

[0599] The "list of required documents" is a list of documents that need to be prepared according to the application content.

[0600] "Smart glasses" are advanced computing devices that can be worn by a user to display information in their field of vision.

[0601] A "database" is an information storage system that manages information on required documents and is referenced by the server.

[0602] "Analysis" refers to data processing to identify required documents based on the application details and basic information received by the server.

[0603] "Documents" are documents necessary for carrying out administrative procedures.

[0604] "Transmission" is the process of sending data from a user terminal to a server.

[0605] System configuration

[0606] A system for implementing the present invention comprises the following major components:

[0607] 1. User Device

[0608] A device used by users (residents) to enter application details and basic information. This includes smart glasses, smartphones, PCs, tablets, etc.

[0609] 2. Server

[0610] This is a central computing system that receives and analyzes application details and basic information sent from user terminals.

[0611] 3. Database

[0612] This is a database that manages information on required documents. The server references this database based on the analysis results and identifies the required documents.

[0613] Program processing overview

[0614] User terminal

[0615] By using the smart glasses, users can intuitively input application details and basic information. The smart glasses support users by displaying input forms and guides in their field of vision.

[0616] server

[0617] The system receives and analyzes the application details and basic information sent from the device. Based on the analysis, it identifies the necessary documents from a database. Natural language processing technology can be used for the analysis, and accuracy can be improved by utilizing generative AI models (e.g., GPT-3).

[0618] Database

[0619] The database stores information on documents required for various administrative procedures. The server references the database based on the analysis results and identifies the necessary documents appropriate for the application.

[0620] User Notifications

[0621] The identified list of required documents will be displayed in real time on the user's smart glasses, allowing the user to know and prepare the necessary documents in advance.

[0622] Operation procedures and usage examples

[0623] Let's say a user arrives at city hall and wants to change their address because they have moved to a new address. They launch the app installed on their smart glasses and select "Change of Address Procedure." Next, they enter basic information such as their name, old address, new address, and phone number. The user data is sent from the smart glasses to the server, which analyzes it. After a few seconds, a message appears saying, "To change your address, you will need a copy of your resident registration card and a form of identification (driver's license)."

[0624] Prompt Sentence Examples

[0625] "The user enters the request 'Change of Address' and basic information (name, old address, new address, phone number). The server analyzes this information, identifies the required documents, and generates a list. The required documents are presented to the user in real time through the smart glasses. Please explain this process in natural language."

[0626] As a result, users can smoothly complete procedures at the counter. In addition, by using smart glasses, they can obtain information in real time, making procedures more efficient.

[0627] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0628] Step 1:

[0629] The user starts up the smart glasses and enters the application details and basic information. A menu for selecting "Address Change Procedure" appears on the smart glasses screen. The user then uses touch or voice input to enter basic information such as name, old address, new address, and phone number. The entered data is temporarily stored in the internal memory.

[0630] Input: Application details selected by the user (e.g., address change procedure) and basic information (name, old address, new address, phone number)

[0631] Output: Temporarily save input data

[0632] Step 2:

[0633] The user device sends the entered application details and basic information to the server. A data packet is generated through the smart glasses' communication module and sent as a POST request to the server's API endpoint.

[0634] Input: Data entered by the user (application details and basic information)

[0635] Output: Data packet sent to the server

[0636] Step 3:

[0637] The server analyzes the received data. The server deserializes the received data packet and analyzes the application content and basic information. It performs natural language analysis using a generative AI model to extract parameters to identify required documents.

[0638] Input: Submitted application details and basic information

[0639] Output: Parsed parameters

[0640] Step 4:

[0641] The server identifies the required documents. The server sends a query to the database and lists the documents required for the relevant procedure based on the parsed parameters. The listed document information is organized as structured data within the server.

[0642] Input: Parsed parameters (e.g., documents required for address change procedures)

[0643] Output: Required documents list

[0644] Step 5:

[0645] The server sends the required document list to the user terminal. The compiled required document list is converted back into data packets and sent to the smart glasses. If communication is successful, the smart glasses receive the data and display the required document list on their screen.

[0646] Input: Required documents list

[0647] Output: Sending data packet and displaying list of required documents

[0648] Step 6:

[0649] The user prepares the necessary documents (e.g., a copy of the resident registration card and identification documents) while looking at the display screen of the smart glasses. The user physically collects and prepares the documents according to the displayed instructions.

[0650] Input: List of required documents displayed on smart glasses

[0651] Output: Prepared document

[0652] Step 7:

[0653] (Optional) The user uploads the documents they have prepared for pre-check online. Using smart glasses or other devices, they take photos or scans of the documents and enter them into a dedicated upload form, then send them to the server. The server then checks the uploaded data to ensure that the required documents are properly prepared.

[0654] Input: Uploaded document data

[0655] Output: Document pre-check results

[0656] By following the above steps, users can grasp the necessary documents in real time and carry out administrative procedures efficiently and smoothly.

[0657] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0658] The system of the present invention aims to present necessary documents in advance according to the application details so that residents can complete administrative procedures smoothly. This system involves a process in which the user (resident) inputs the application details and basic information, and the server identifies and presents the appropriate necessary documents based on that information. The present invention also aims to improve the user experience by combining it with an emotion engine that recognizes the user's emotions.

[0659] System configuration

[0660] This system consists of the following main components:

[0661] 1. User Device

[0662] A device used by users (residents) to enter application details and basic information. This includes smartphones, PCs, tablets, etc.

[0663] It is equipped with an emotion engine that recognizes the user's emotions in real time.

[0664] 2. Server

[0665] This is a central computing system that receives and analyzes application details and basic information sent from user terminals.

[0666] The necessary documents are identified and the results are sent to the user's terminal.

[0667] 3. Database

[0668] This is a database that manages information on required documents. The server references this database based on the analysis results and identifies the required documents.

[0669] 4. Emotion Engine

[0670] It is an engine for recognizing the user's emotions, analyzing the emotional state (e.g., stress, happiness, etc.) when the user inputs.

[0671] The interface and message content are adjusted based on the output of the emotion engine.

[0672] Program processing overview

[0673] 1. The user enters the application details and basic information

[0674] The user accesses the system using their own terminal and selects or inputs the application details (e.g., "address change procedure"), as well as basic information such as name, address, and phone number.

[0675] The emotion engine recognizes and analyzes the emotions expressed by users as they type.

[0676] 2. The device sends the input data to the server

[0677] The terminal collects the application details and basic information input by the user into one data packet and transmits it to the server.

[0678] 3. The server analyzes the received data

[0679] The server receives the data packet sent from the terminal and analyzes the application and basic information, which is then used to reference the database.

[0680] 4. The server identifies the required documents

[0681] Based on the analyzed application details, the server refers to the database to identify the necessary documents for the application. For example, it identifies that a copy of the residence certificate and identification documents are required for an address change procedure.

[0682] 5. The server sends the list of required documents to the user's device.

[0683] The server sends the identified list of required documents to the user's terminal, which then displays the list to the user, allowing the user to know in advance which documents they need to prepare.

[0684] 6. Interface adjustment according to user emotions

[0685] If the user's stress level is high based on the output of the emotion engine, the interface display and messages are adjusted, such as adding guide messages or suggesting ways to help the user relax.

[0686] 7. User prepares documents

[0687] The user prepares the necessary documents based on the list of required documents provided. For example, the user may obtain a copy of their resident registration card from the city hall and prepare a driver's license.

[0688] 8. Optional - User makes pre-confirmation reservation

[0689] Users can upload prepared documents online for advance confirmation, and the server will then verify the received documents and check for any errors.

[0690] 9. The server verifies the document data

[0691] The server verifies the received documents and notifies the user of the results. The user can then check the verification results and smoothly proceed with the procedure at the counter.

[0692] Specific examples

[0693] Example 1: Address change procedure

[0694] User A has moved to a new address and wants to change his / her address. User A accesses the system using his / her smartphone and selects "Change of Address Procedure."

[0695] Next, the user enters basic information such as name, old address, new address, phone number, etc. The emotion engine recognizes User A's emotions while entering these details, and if it detects high stress, the system displays a gentle guide message to support User A.

[0696] User A's smartphone sends this information to the server.

[0697] The server identifies the documents required for the address change procedure from the database and notifies User A that a "copy of resident registration" and "identification documents" are required.

[0698] User A obtains a copy of his / her resident registration card from the city hall and prepares his / her driver's license.

[0699] By uploading these documents online and having them checked in advance, the process at the counter can be completed smoothly.

[0700] In this way, the system of the present invention aims not only to enable residents to efficiently prepare for administrative procedures, but also to improve the user experience by incorporating an emotion engine, which reduces user stress and allows procedures to proceed more smoothly.

[0701] The processing flow will be explained below.

[0702] Step 1:

[0703] The user accesses the system using their own terminal and selects the application content, such as "address change procedure," from the menu displayed on the interface.

[0704] Step 2:

[0705] The user enters basic information such as name, old address, new address, phone number, etc. This information must be entered accurately as it is required for procedures related to the application.

[0706] Step 3:

[0707] The emotion engine recognizes the user's emotions in real time. While the user is typing on the device, it uses facial recognition technology and voice analysis to analyze their emotional state, such as stress or happiness.

[0708] Step 4:

[0709] The emotion engine adjusts the interface display and messages based on the user's emotional state. For example, if the user is feeling stressed, more helpful and easy-to-understand guidance messages will be displayed.

[0710] Step 5:

[0711] The terminal assembles the application details and basic information entered by the user into a single data packet and sends it to the server. The user is notified that the data transmission has been completed successfully.

[0712] Step 6:

[0713] The server receives the data packet sent from the device, analyzes the received data packet, and individually extracts the application details (e.g., "change of address") and basic information (name, old address, new address, phone number, etc.).

[0714] Step 7:

[0715] Based on the application details extracted by the server, the server refers to an internal database to identify the documents required for the address change procedure. For example, it identifies that a "copy of the residence certificate" and "identification documents" are required.

[0716] Step 8:

[0717] The server sends the list of required documents to the user's terminal in a data packet, which contains detailed information about the required documents, how to obtain them, and how to submit them.

[0718] Step 9:

[0719] The device displays the list of required documents received from the server to the user. The message displayed is, "The following documents are required for the address change procedure: 1. Copy of residence certificate 2. Identification document (driver's license, etc.)."

[0720] Step 10:

[0721] The user prepares the necessary documents based on the list of required documents provided. For example, the user obtains a copy of their resident registration card from the city hall and prepares their driver's license.

[0722] Step 11:

[0723] Users can upload documents they have prepared for pre-verification online, by taking a scan or photo of the document and submitting it to the system.

[0724] Step 12:

[0725] The server validates the document data received to ensure accuracy and completeness, especially to ensure the document format and content are correct.

[0726] Step 13:

[0727] The server notifies the user of the verification results. The user checks the results and, if any corrections are necessary, submits the documents again. After the final verification is complete, the procedure at the counter can proceed smoothly.

[0728] Example 2

[0729] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0730] In modern administrative procedures, it is extremely important for residents to prepare the appropriate necessary documents in advance. However, it is often unclear which documents should be prepared, which results in wasted time and effort during the procedure. Furthermore, the procedure can become even more difficult if residents experience emotional stress. For this reason, there is a need for residents to carry out administrative procedures efficiently and smoothly.

[0731] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for receiving and analyzing the transmitted application content and basic information, means for identifying appropriate required documents from a database based on the analysis, means for presenting the identified list of required documents to the resident, emotion recognition means for recognizing and analyzing the resident's emotions in real time, and means for adjusting the interface according to the resident's emotions. This allows the resident to clearly understand which documents they need to prepare, reduces emotional stress, and allows the procedure to proceed smoothly.

[0732] "Residents" refers to users who carry out administrative procedures, and are applicants on an individual or household basis.

[0733] "Application details" refers to the specific procedural items that residents enter or select when carrying out administrative procedures.

[0734] "Basic information" refers to the personal information of residents required for the application process, and specifically includes name, address, telephone number, etc.

[0735] "Server" refers to a central computing system for receiving and analyzing data sent from resident devices.

[0736] The "database" is a data storage system that the server references based on the analysis results and manages information on required documents.

[0737] "Emotion recognition means" refers to technology for recognizing and analyzing residents' emotions in real time.

[0738] "Interface" refers to the screen display and operation methods that residents use to interact with the system.

[0739] "Required Document List" refers to a list of documents required for a specified application procedure.

[0740] The system of this invention aims to help residents complete administrative procedures smoothly by presenting the necessary documents in advance according to the application content. This system is mainly composed of a user terminal, a server, and a database. Furthermore, it aims to improve the user experience by utilizing emotion recognition technology to analyze the emotions of residents when completing procedures and adjust the interface accordingly.

[0741] System configuration

[0742] 1. User Device

[0743] A user terminal is a device used by a user to input application details and basic information. It includes smartphones, PCs, tablets, etc.

[0744] The device is equipped with emotion recognition means to recognize and analyze the emotional state of residents in real time when they input information, using facial recognition and voice analysis technologies.

[0745] 2. Server

[0746] The server is a central computing system that receives and analyzes the application and basic information sent from the user terminal. This analysis is used to determine which required documents are needed.

[0747] Examples of specific software used include Python and R for data analysis, and SQL for database integration.

[0748] 3. Database

[0749] The database is a storage system for managing information on required documents. A typical example is a relational database such as PostgreSQL. The server references the database based on the analysis results and identifies the required documents.

[0750] 4. Emotion recognition means

[0751] Emotion recognition is a technology that recognizes and analyzes the user's emotions in real time. Based on the analysis results, it is possible to adjust the user interface and message content.

[0752] Specifically, the emotion recognition algorithm uses a generative AI model to analyze the user's facial expressions and tone of voice.

[0753] Specific examples

[0754] Address change procedures

[0755] Example 1: User A moves to a new address

[0756] User A accesses the system using a smartphone, logs in, and selects "Address change procedure."

[0757] Next, User A inputs his / her name, old address, new address, and phone number. If the emotion recognition means detects stress in User A, the system will display a friendly guide message to support him / her.

[0758] User A's smartphone assembles this information into a data packet and sends it to the server.

[0759] The server identifies the documents required for the address change procedure from the database and notifies User A that a "copy of resident registration" and "identification documents" are required.

[0760] User A obtains a copy of his / her resident registration card from the city hall and prepares his / her driver's license.

[0761] Furthermore, these documents can be uploaded online for pre-checking and the server will verify the documents.

[0762] The verification result is notified to User A, who can then check it and smoothly proceed with the procedure at the counter.

[0763] In this way, the system of the present invention aims not only to enable residents to efficiently prepare for administrative procedures, but also to improve the user experience by combining emotion recognition means, which can reduce residents' stress and make procedures more comfortable.

[0764] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0765] Step 1:

[0766] A user accesses the system. Specifically, the user accesses the system's web page using a smartphone, PC, or tablet, and a login screen appears. Here, the user enters their user ID and password to log in. The entered login information is sent by the device to the server. The server compares the entered user ID and password with a database and performs authentication. If authentication is successful, the user can proceed to the next screen.

[0767] Step 2:

[0768] The user inputs the application details and basic information. The user selects a specific application, such as "address change procedure," and inputs basic information such as name, old address, new address, and phone number. The input data is stored in the device's memory. In addition, an emotion recognition means analyzes the user's facial expressions and voice in real time to determine stress levels, etc. Specifically, the camera and microphone are used to capture the user's emotional data, which is then analyzed by the generative AI model.

[0769] Step 3:

[0770] The device sends the input data to the server. The application details and basic information entered by the user, as well as the emotional data analyzed by the emotion recognition means, are compiled into a single data packet and sent to the server via the Internet. At this time, the data is encrypted using the HTTPS protocol. The structure of the transmitted data is in JSON format, with the necessary information included in each field (e.g., { "Application details": "Change of address", "Name": "Yamada Taro", "Old address": "Tokyo", "New address": "Kanagawa", "Emotion data": { "Stress level": 0.75}}).

[0771] Step 4:

[0772] The server analyzes the received data. The server analyzes the received data packets and extracts the application details, basic information, and emotion data. To perform the analysis, it issues a query to the database and extracts the necessary information. Specifically, it uses an SQL query to obtain the information required for the "change of address procedure" and analyzes it together with the basic information. As a result of the analysis, it identifies which necessary documents are required.

[0773] Step 5:

[0774] The server identifies the required documents. Based on the analyzed application details, the server references the database and identifies the required documents appropriate for the application details. For example, it identifies that a "copy of resident registration" and "identification documents" are required for an address change procedure. This information is compiled into a list and sent to the user's terminal.

[0775] Step 6:

[0776] The server sends a list of required documents to the user's terminal. The server then sends the identified list of required documents in JSON format to the user's terminal. The sent data is received by the terminal and displayed to the user. The user can check which documents they need to prepare.

[0777] Step 7:

[0778] The user device adjusts the interface based on the emotion analysis results. If the emotion recognition means detects that the user's stress level is high, the system displays a gentle guide message. Specifically, the system displays advice for the user to relax and messages that clearly explain the steps of the procedure.

[0779] Step 8:

[0780] The user prepares the necessary documents. Based on the list of required documents provided, the user obtains the necessary documents from city hall or related institutions. For example, the user obtains a copy of their resident registration card from city hall and has their driver's license ready.

[0781] Step 9:

[0782] The user uploads documents online (optional). The user can upload the prepared documents to the system online. The uploaded data is sent from the terminal to the server, and the server verifies the received documents. After verification, the result is notified to the user. This process makes the procedure at the counter go more smoothly.

[0783] (Application example 2)

[0784] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0785] The process of preparing the necessary documents for administrative procedures often increases the amount of work and stress users experience. Furthermore, while the user experience is important for purchasing high-value items on online shopping sites, the process can be complicated and stressful. This can lead to users feeling confused and anxious about the process, ultimately making it difficult for them to complete the procedure.

[0786] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for analyzing the emotional state of the resident using an emotion recognition engine, means for adjusting the interface and presenting a friendly guide message based on the emotional state of the resident, and means for presenting a list of required documents. This allows the user's emotional state to be analyzed in real time and the interface and message content to be adjusted, allowing the user to proceed with the procedure with peace of mind.

[0787] "Residents" are users who use the system to input application details and basic information, identify required documents, and prepare the documents.

[0788] "Application content" refers to the information or content that a user must enter to proceed with an administrative procedure or a specific process.

[0789] "Basic information" refers to personal information such as name, address, and telephone number that is required when a user carries out a specific procedure.

[0790] A "communications network" is a computer network for sending and receiving information, such as the Internet.

[0791] "Server" means a central computing system that receives and analyzes the application and basic information sent by the User, and identifies and presents the required documents.

[0792] An "emotion recognition engine" is a software engine for analyzing a user's emotional state in real time.

[0793] An "interface" is a screen or operating environment that allows interaction between a user and a system.

[0794] The "list of required documents" is a list of documents that the user must prepare in order to proceed with the procedure.

[0795] A "gentle guide message" is a calming guide message that is provided to a user when the user feels stressed while proceeding with a procedure.

[0796] The system of the present invention aims to improve the user experience by using an emotion recognition engine to help residents smoothly complete administrative procedures and purchase procedures for high-value items on online shopping sites. This system is composed of the following main components:

[0797] The entire system includes a user terminal where users can input application details and basic information, a server that receives and analyzes the input data and identifies and presents required documents, a database that manages required document information, and an emotion recognition engine that recognizes the user's emotional state in real time.

[0798] 1. User Device

[0799] The user terminal is a device where the user can input application details and basic information. This includes smartphones and tablets. This terminal is equipped with an emotion recognition engine that analyzes the user's emotional state in real time.

[0800] 2. Server

[0801] The server receives and analyzes the application details and basic information sent from the user terminal via the communication network. Based on the analyzed data, the server identifies the required documents and sends a list of them to the user terminal.

[0802] 3. Database

[0803] The database is a component for managing information on required documents, and the server identifies the required documents by referencing them based on the analysis results.

[0804] 4. Emotion Recognition Engine

[0805] An emotion recognition engine is a software engine that analyzes the user's emotional state (stress, happiness, etc.) when inputting information. Based on the output of this engine, it has the ability to adjust the interface and message content of the user's device.

[0806] In this system, users enter their application details and basic information and send it to the server. The server analyzes the received data, identifies a list of required documents, and displays it on the user's device. If the user's emotional state is stressful, the interface is adjusted based on the output of the emotion recognition engine, and a friendly guidance message is displayed.

[0807] For example, if User A is about to purchase a high-priced item, he or she will use a smartphone to enter the necessary information. At this time, the emotion recognition engine will analyze User A's emotions and, if it determines that User A is under high stress, the interface will display a friendly guide message and briefly explain the procedure.

[0808] Specific examples

[0809] As an example of user input, if the text "I'm trying to purchase an expensive item, but I'm confused about the procedure" is given, the emotion recognition engine will identify the emotional state based on this input.

[0810] Example prompt sentence:

[0811] The EmotionEngine analyzes user input to identify their emotional state. Given the following input text, return an appropriate emotion (e.g., stress, happiness, etc.): Input text: "I'm trying to purchase an expensive item, but I'm having trouble with the process."

[0812] In this way, the system of the present invention recognizes and analyzes the user's emotional state and dynamically adjusts the interface and message content to allow the user to proceed smoothly, improving the user experience and reducing stress during the process.

[0813] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0814] Step 1:

[0815] The user inputs the application details and basic information into the user device (smartphone or tablet). The input details include the application details, such as "purchase a high-priced item," as well as basic information such as name, address, and phone number. The user device is equipped with an emotion recognition engine, which analyzes the user's emotional state in real time.

[0816] input:

[0817] Application details (e.g., purchasing a high-priced item)

[0818] Basic information (name, address, phone number, etc.)

[0819] output:

[0820] Emotional state analysis results (e.g., stress)

[0821] Step 2:

[0822] The user terminal transmits the input application details and basic information to the server via a communication network. The transmitted data includes the application details, basic information, and the analysis results of the emotional state.

[0823] input:

[0824] Application details and basic information

[0825] Emotional state analysis results

[0826] output:

[0827] Data packets sent to the server

[0828] Step 3:

[0829] The server analyzes the received data packet (application details, basic information, and emotional state analysis results). Based on the analyzed data, the server refers to a database to identify the required documents.

[0830] input:

[0831] Received data packet (application details, basic information, emotional state)

[0832] output:

[0833] Required Documents List

[0834] Step 4:

[0835] The server sends the specified list of required documents to the user terminal, which receives the list and presents it to the user.

[0836] input:

[0837] Identified list of required documents

[0838] output:

[0839] Required document list sent to user device

[0840] Step 5:

[0841] The interface of the user's device is adjusted based on the analysis results of the emotion recognition engine. Specifically, if the user is in a stressful state, a gentle guidance message is displayed. If the user's emotional state is relaxed, the normal interface is displayed.

[0842] input:

[0843] Emotional state analysis results

[0844] output:

[0845] Adjusted interface (e.g. friendly guide messages)

[0846] Step 6:

[0847] The user prepares the documents based on the required document list provided, and then uploads them to the server online according to the workflow.

[0848] input:

[0849] Required Documents List

[0850] output:

[0851] Prepared necessary documents

[0852] Step 7:

[0853] The server verifies the uploaded documents and notifies the user of the results, informing them if the documents are accurate or if additional documents are required.

[0854] input:

[0855] Uploaded documents

[0856] output:

[0857] Document verification results (e.g., no errors, additional documents required)

[0858] Through these steps, the system helps users to complete administrative procedures and purchase procedures for high-value items smoothly and without stress.

[0859] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0860] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0861] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0862] [Third embodiment]

[0863] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0864] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0865] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0866] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0867] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0868] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0869] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0870] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0871] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0872] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0873] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0874] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0875] The system of the present invention aims to present necessary documents according to the application contents in advance so that residents can smoothly carry out administrative procedures. This system includes a process in which the user (resident) inputs the application contents and basic information, and the server identifies and presents the appropriate necessary documents based on that information.

[0876] System configuration

[0877] This system consists of the following main components:

[0878] 1. User Device

[0879] A device used by users (residents) to enter application details and basic information. This includes smartphones, PCs, tablets, etc.

[0880] 2. Server

[0881] This is a central computing system that receives and analyzes application details and basic information sent from user terminals.

[0882] 3. Database

[0883] This is a database that manages information on required documents. The server references this database based on the analysis results and identifies the required documents.

[0884] Program processing overview

[0885] 1. The user enters the application details and basic information

[0886] The user accesses the system using their own terminal and selects or inputs the application details (e.g., "address change procedure"), as well as basic information such as name, address, and phone number.

[0887] 2. The device sends the input data to the server

[0888] The terminal collects the application details and basic information input by the user into one data packet and transmits it to the server.

[0889] 3. The server analyzes the received data

[0890] The server receives the data packet sent from the terminal and analyzes the application and basic information, which is then used to reference the database.

[0891] 4. The server identifies the required documents

[0892] Based on the analyzed application details, the server refers to the database and identifies the necessary documents for the application. For example, it identifies that a copy of the residence certificate and identification documents are required for an address change procedure.

[0893] 5. The server sends the list of required documents to the user's device.

[0894] The server sends the list of required documents to the user terminal, which displays the list to the user, allowing the user to know in advance which documents they need to prepare.

[0895] 6. User prepares documents

[0896] The user prepares the necessary documents based on the list of required documents provided. For example, the user may obtain a copy of their resident registration card from the city hall and prepare a driver's license.

[0897] 7. Optional - User makes pre-confirmation reservation

[0898] Users can upload the documents they have prepared online for advance confirmation, allowing them to check whether they have all the necessary documents before going to the counter.

[0899] Specific examples

[0900] Example 1: Address change procedure

[0901] User A has moved to a new address and wants to change his / her address. User A accesses the system using his / her smartphone and selects "Change of Address Procedure."

[0902] Next, enter basic information such as your name, old address, new address, and phone number.

[0903] User A's smartphone sends this information to the server.

[0904] The server identifies the documents required for the address change procedure from the database and notifies User A that a "copy of resident registration" and "identification documents" are required.

[0905] User A obtains a copy of his / her resident registration card from the city hall and prepares his / her driver's license.

[0906] By uploading these documents online and having them checked in advance, the process at the counter can be completed smoothly.

[0907] In this way, the system of the present invention supports residents in efficiently preparing for administrative procedures, and provides functions that speed up and improve the accuracy of procedures at the counter.

[0908] The processing flow will be explained below.

[0909] Step 1:

[0910] The user accesses the system using their own terminal and selects the application content, such as "address change procedure," from the menu displayed on the system interface.

[0911] Step 2:

[0912] The user enters basic information such as name, old address, new address, phone number, etc. This information must be entered accurately as it is required for procedures related to the application.

[0913] Step 3:

[0914] The terminal collects the application details and basic information entered by the user into a single data packet, sends the collected data packet to the server, and notifies the user that the data transmission has been completed successfully.

[0915] Step 4:

[0916] The server receives the data packet sent from the device, analyzes the received data packet, and individually extracts the application details (e.g., "change of address") and basic information (name, old address, new address, phone number, etc.).

[0917] Step 5:

[0918] Based on the application details extracted by the server, the server refers to an internal database to identify the documents required for the address change procedure. For example, it identifies that a "copy of the residence certificate" and "identification documents" are required for the address change procedure.

[0919] Step 6:

[0920] The server sends the specified list of required documents to the user terminal in a data packet, which includes the types of documents required and specific descriptions.

[0921] Step 7:

[0922] The device displays the list of required documents received from the server to the user. For example, the message "The following documents are required for address change procedures: 1. Copy of residence certificate 2. Identification document (driver's license, etc.)" is displayed.

[0923] Step 8:

[0924] The user prepares the necessary documents based on the list of required documents provided. For example, the user obtains a copy of their resident registration card from the city hall and prepares their driver's license.

[0925] Step 9:

[0926] As an optional feature, users can upload documents they have prepared online for pre-checking, and the server will then validate the documents received and check for any errors.

[0927] Step 10:

[0928] The server verifies the received documents and notifies the user of the results. The user can then check the verification results and smoothly proceed with the procedure at the counter.

[0929] Example 1

[0930] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0931] With the current administrative procedure system, residents are unable to ascertain the necessary documents in advance, which often results in delays in procedures at the counter. In addition, if there are any deficiencies or omissions in the application details, residents must redo the procedure, which places a significant burden on them. Furthermore, because documents cannot be checked online, there are many cases where procedures are carried out without sufficient preparation in advance. Therefore, there is a need for a system that allows residents to efficiently prepare for administrative procedures and improves the speed and accuracy of procedures at the counter.

[0932] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0933] In this invention, the server includes a means for residents to input application details and basic information using their own terminals, and a process for the server to identify and present the appropriate required documents; a means for displaying an error message if there are any omissions or errors when the applicant inputs the basic information; and a means for generating a log and sending an alert when the server analyzes the received data. This allows residents to know in advance which documents they need to prepare, allowing for smoother procedures at the counter. Furthermore, early detection of omissions or errors eliminates the need to redo the procedures. Furthermore, advance document confirmation online allows for more efficient procedure preparation.

[0934] "Residents" refers to ordinary individuals who carry out administrative procedures.

[0935] "Application details" refers to the specific types of procedures that residents enter when carrying out administrative procedures.

[0936] "Basic information" refers to personal information such as name, address, and telephone number.

[0937] "Terminal" refers to electronic devices such as smartphones, computers, and tablets.

[0938] "Server" refers to the central computer system that receives and analyzes data sent by residents and identifies required documents.

[0939] "Data Packet" refers to a collection of information including application details and basic information.

[0940] "Parsing" refers to the process by which the server extracts and understands the application and basic information from the data packets it receives.

[0941] "Database" refers to the information management system in which information on required documents is stored.

[0942] "List of required documents" refers to a list of documents that residents must prepare based on the application details.

[0943] A "prompt" refers to a specific instruction that is input into a generative AI model.

[0944] "Error message" refers to a warning message that is displayed when there is an error or omission in the information entered.

[0945] "HTTPS protocol" refers to a secure communications protocol used when transmitting data.

[0946] A "buffer" refers to a storage area within a server that temporarily stores data.

[0947] "Log" refers to a record of system operations, errors, etc.

[0948] "Pre-check" refers to the process of checking preparatory documents before proceeding.

[0949] "Upload" refers to the act of sending data from a terminal to a server.

[0950] The system of the present invention aims to present necessary documents according to the application details in advance so that residents can complete administrative procedures smoothly. This system involves a process in which residents input the application details and basic information, and the server identifies and presents the appropriate necessary documents based on that information.

[0951] System configuration

[0952] This system consists of the following main components:

[0953] 1. User Device

[0954] A device used by users (residents) to enter application details and basic information. This includes smartphones, PCs, tablets, etc.

[0955] 2. Server

[0956] This is a central computing system that receives and analyzes application details and basic information sent from user terminals.

[0957] 3. Database

[0958] This is a database that manages information on required documents. The server references this database based on the analysis results and identifies the required documents.

[0959] Program processing overview

[0960] 1. The user enters the application details and basic information

[0961] The user accesses the system using their own terminal and selects or inputs the application details (e.g., "address change procedure"), as well as basic information such as name, address, and phone number.

[0962] 2. The device sends the input data to the server

[0963] The terminal collects the application details and basic information entered by the user into a single data packet and sends it to the server. The data is encrypted using the HTTPS protocol during transmission.

[0964] 3. The server analyzes the received data

[0965] The server receives the data packet sent from the terminal and analyzes the application content and basic information using common data analysis algorithms and natural language processing techniques.

[0966] 4. The server identifies the required documents

[0967] The server then references the database based on the analyzed application content and identifies the necessary documents for the application. For example, it identifies that a copy of the residence certificate and identification documents are required for an address change procedure. During the analysis process, a log is generated to record the progress and any errors.

[0968] 5. The server sends the list of required documents to the user's device.

[0969] The server sends the list of required documents to the user terminal, which displays the list to the user, allowing the user to know in advance which documents they need to prepare.

[0970] 6. User prepares documents

[0971] The user prepares the necessary documents based on the list of required documents provided. For example, the user obtains a copy of their resident registration card from the city hall and prepares their driver's license.

[0972] 7. User makes advance confirmation reservation (optional)

[0973] Users can upload the prepared documents online for pre-checking. This is done via the system's check page, and the server receives the uploaded documents and checks their contents. The check result will be notified to the user.

[0974] Specific examples

[0975] Example 1: Address change procedure

[0976] User A has moved to a new address and wants to change his / her address. User A accesses the system using his / her smartphone and selects "Change of Address Procedure."

[0977] Next, enter basic information such as your name, old address, new address, and phone number.

[0978] User A's smartphone sends this information to the server.

[0979] The server identifies the documents required for the address change procedure from the database and notifies User A that a "copy of resident registration" and "identification documents" are required.

[0980] User A obtains a copy of his / her resident registration card from the city hall and prepares his / her driver's license.

[0981] By uploading these documents online and having them checked in advance, the process at the counter can be completed smoothly.

[0982] Prompt Sentence Examples

[0983] You can get more detailed help and explanations by inputting the following prompts into the generative AI model:

[0984] If a user wants to change their address because they're moving, what information should they enter and what documents should they prepare? The prompt sequence is as follows:

[0985] 1. Select "Change of Address Procedure" as the application content.

[0986] 2. Enter basic information such as your name, old address, new address, and phone number.

[0987] 3. The server identifies the necessary documents and notifies the user that a "copy of residence certificate" and "identification documents" are required.

[0988] 4. The user prepares these documents.

[0989] 5. Optionally, users can upload documents online for pre-verification.

[0990] This system provides support to residents to efficiently prepare for administrative procedures and expedite procedures at the counter.

[0991] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0992] Step 1:

[0993] The user enters the application details and basic information. The user accesses the system using their own device (smartphone, PC, tablet). They enter their ID and password on the login screen to authenticate. After logging in, they select the application details, such as "Address Change Procedure," from the main menu. Next, they enter basic information such as name, old address, new address, and phone number for each field. Once all information has been entered, they click the "Submit" button. Based on the user's input, the system acquires the application details and basic information as data.

[0994] Step 2:

[0995] The terminal sends the input data to the server. The terminal compiles the application details and basic information entered by the user into a single JSON format data packet. This data packet is sent to the server using the HTTPS protocol. The data is encrypted during transmission to ensure security. The input data is sent to the server in JSON format and is temporarily stored in a buffer on the server.

[0996] Step 3:

[0997] The server analyzes the received data. The server receives data packets sent from the terminal and stores them in a buffer. A back-end program retrieves the data from the buffer and analyzes the application content and basic information. This analysis uses common data analysis algorithms and natural language processing techniques. The analyzed data is then formatted in preparation for a database query. During the analysis process, logs are generated and alerts are sent.

[0998] Step 4:

[0999] The server identifies the required documents. Based on the analyzed application details, the server executes a database query to identify the required documents. The database stores a list of required documents for each application. For example, it identifies that a "change of address procedure" requires a "copy of resident registration" and "identification documents." The server receives the results of the database query and compiles the list of required documents into a response data packet.

[1000] Step 5:

[1001] The server sends a list of required documents to the user terminal. The server then sends the generated response data packet to the user terminal using the HTTPS protocol. The user terminal analyzes the received data packet and displays the list of required documents on the screen. This allows the user to check the documents that need to be prepared in advance.

[1002] Step 6:

[1003] The user prepares the documents. The user prepares the documents based on the displayed list of required documents. For example, the user goes to the city hall to obtain a copy of the resident registration card and prepares a driver's license. The user can enter the preparation status into the system in the form of a check box and check the progress.

[1004] Step 7:

[1005] The user makes a reservation for advance verification (optional). The user accesses the system again to have the prepared documents verified online. They go to the document upload screen and upload scans or images of their "copy of resident registration" and "identification documents." Once the upload is complete, they click the "Request verification" button. The server receives the uploaded documents and verifies their contents. The verification results are notified to the user's device, and they can see which documents are missing.

[1006] (Application example 1)

[1007] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1008] In conventional administrative procedure systems, it was difficult for users to understand in advance what documents were required for their application, which often made the procedures cumbersome. Another problem was that procedures at the counter did not proceed smoothly. In addition, there was no way for residents to check information in real time using advanced devices such as smart glasses, making it difficult to complete procedures efficiently.

[1009] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1010] In this invention, the server includes a means for residents to input application details, a means for residents to input their own basic information, a means for transmitting the input application details and basic information to the server, a means for receiving and analyzing the transmitted application details and basic information, a means for identifying required documents based on the analysis results, a means for presenting a list of identified required documents to the resident, and a means for presenting the list of required documents to the resident in real time using smart glasses. This allows residents to know and prepare the necessary documents in advance, allowing for smooth procedures at the counter. In addition, using smart glasses allows for real-time information acquisition, enabling efficient procedures.

[1011] A "resident" is an individual who resides in a particular area and is required to carry out administrative procedures.

[1012] "Application details" refers to information that indicates the specific types and details of administrative procedures that residents wish to carry out.

[1013] "Basic information" refers to data that identifies a resident, such as their name, address, and phone number.

[1014] "Server" refers to a central computing system that receives and analyzes application details and basic information sent by users.

[1015] The "list of required documents" is a list of documents that need to be prepared according to the application content.

[1016] "Smart glasses" are advanced computing devices that can be worn by a user to display information in their field of vision.

[1017] A "database" is an information storage system that manages information on required documents and is referenced by the server.

[1018] "Analysis" refers to data processing to identify required documents based on the application details and basic information received by the server.

[1019] "Documents" are documents necessary for carrying out administrative procedures.

[1020] "Transmission" is the process of sending data from a user terminal to a server.

[1021] System configuration

[1022] A system for implementing the present invention comprises the following major components:

[1023] 1. User Device

[1024] A device used by users (residents) to enter application details and basic information. This includes smart glasses, smartphones, PCs, tablets, etc.

[1025] 2. Server

[1026] This is a central computing system that receives and analyzes application details and basic information sent from user terminals.

[1027] 3. Database

[1028] This is a database that manages information on required documents. The server references this database based on the analysis results and identifies the required documents.

[1029] Program processing overview

[1030] User terminal

[1031] By using the smart glasses, users can intuitively input application details and basic information. The smart glasses support users by displaying input forms and guides in their field of vision.

[1032] server

[1033] The system receives and analyzes the application details and basic information sent from the device. Based on the analysis, it identifies the necessary documents from a database. Natural language processing technology can be used for the analysis, and accuracy can be improved by utilizing generative AI models (e.g., GPT-3).

[1034] Database

[1035] The database stores information on documents required for various administrative procedures. The server references the database based on the analysis results and identifies the necessary documents appropriate for the application.

[1036] User Notifications

[1037] The identified list of required documents will be displayed in real time on the user's smart glasses, allowing the user to know and prepare the necessary documents in advance.

[1038] Operation procedures and usage examples

[1039] Let's say a user arrives at city hall and wants to change their address because they have moved to a new address. They launch the app installed on their smart glasses and select "Change of Address Procedure." Next, they enter basic information such as their name, old address, new address, and phone number. The user data is sent from the smart glasses to the server, which analyzes it. After a few seconds, a message appears saying, "To change your address, you will need a copy of your resident registration card and a form of identification (driver's license)."

[1040] Prompt Sentence Examples

[1041] "The user enters the request 'Change of Address' and basic information (name, old address, new address, phone number). The server analyzes this information, identifies the required documents, and generates a list. The required documents are presented to the user in real time through the smart glasses. Please explain this process in natural language."

[1042] As a result, users can smoothly complete procedures at the counter. In addition, by using smart glasses, they can obtain information in real time, making procedures more efficient.

[1043] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1044] Step 1:

[1045] The user starts up the smart glasses and enters the application details and basic information. A menu for selecting "Address Change Procedure" appears on the smart glasses screen. The user then uses touch or voice input to enter basic information such as name, old address, new address, and phone number. The entered data is temporarily stored in the internal memory.

[1046] Input: Application details selected by the user (e.g., address change procedure) and basic information (name, old address, new address, phone number)

[1047] Output: Temporarily save input data

[1048] Step 2:

[1049] The user device sends the entered application details and basic information to the server. A data packet is generated through the smart glasses' communication module and sent as a POST request to the server's API endpoint.

[1050] Input: Data entered by the user (application details and basic information)

[1051] Output: Data packet sent to the server

[1052] Step 3:

[1053] The server analyzes the received data. The server deserializes the received data packet and analyzes the application content and basic information. It performs natural language analysis using a generative AI model to extract parameters to identify required documents.

[1054] Input: Submitted application details and basic information

[1055] Output: Parsed parameters

[1056] Step 4:

[1057] The server identifies the required documents. The server sends a query to the database and lists the documents required for the relevant procedure based on the parsed parameters. The listed document information is organized as structured data within the server.

[1058] Input: Parsed parameters (e.g., documents required for address change procedures)

[1059] Output: Required documents list

[1060] Step 5:

[1061] The server sends the required document list to the user terminal. The compiled required document list is converted back into data packets and sent to the smart glasses. If communication is successful, the smart glasses receive the data and display the required document list on their screen.

[1062] Input: Required documents list

[1063] Output: Sending data packet and displaying list of required documents

[1064] Step 6:

[1065] The user prepares the necessary documents (e.g., a copy of the resident registration card and identification documents) while looking at the display screen of the smart glasses. The user physically collects and prepares the documents according to the displayed instructions.

[1066] Input: List of required documents displayed on smart glasses

[1067] Output: Prepared document

[1068] Step 7:

[1069] (Optional) The user uploads the documents they have prepared for pre-check online. Using smart glasses or other devices, they take photos or scans of the documents and enter them into a dedicated upload form, then send them to the server. The server then checks the uploaded data to ensure that the required documents are properly prepared.

[1070] Input: Uploaded document data

[1071] Output: Document pre-check results

[1072] By following the above steps, users can grasp the necessary documents in real time and carry out administrative procedures efficiently and smoothly.

[1073] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1074] The system of the present invention aims to present necessary documents in advance according to the application details so that residents can complete administrative procedures smoothly. This system involves a process in which the user (resident) inputs the application details and basic information, and the server identifies and presents the appropriate necessary documents based on that information. The present invention also aims to improve the user experience by combining it with an emotion engine that recognizes the user's emotions.

[1075] System configuration

[1076] This system consists of the following main components:

[1077] 1. User Device

[1078] A device used by users (residents) to enter application details and basic information. This includes smartphones, PCs, tablets, etc.

[1079] It is equipped with an emotion engine that recognizes the user's emotions in real time.

[1080] 2. Server

[1081] This is a central computing system that receives and analyzes application details and basic information sent from user terminals.

[1082] The necessary documents are identified and the results are sent to the user's terminal.

[1083] 3. Database

[1084] This is a database that manages information on required documents. The server references this database based on the analysis results and identifies the required documents.

[1085] 4. Emotion Engine

[1086] It is an engine for recognizing the user's emotions, analyzing the emotional state (e.g., stress, happiness, etc.) when the user inputs.

[1087] The interface and message content are adjusted based on the output of the emotion engine.

[1088] Program processing overview

[1089] 1. The user enters the application details and basic information

[1090] The user accesses the system using their own terminal and selects or inputs the application details (e.g., "address change procedure"), as well as basic information such as name, address, and phone number.

[1091] The emotion engine recognizes and analyzes the emotions expressed by users as they type.

[1092] 2. The device sends the input data to the server

[1093] The terminal collects the application details and basic information input by the user into one data packet and transmits it to the server.

[1094] 3. The server analyzes the received data

[1095] The server receives the data packet sent from the terminal and analyzes the application and basic information, which is then used to reference the database.

[1096] 4. The server identifies the required documents

[1097] Based on the analyzed application details, the server refers to the database to identify the necessary documents for the application. For example, it identifies that a copy of the residence certificate and identification documents are required for an address change procedure.

[1098] 5. The server sends the list of required documents to the user's device.

[1099] The server sends the identified list of required documents to the user's terminal, which then displays the list to the user, allowing the user to know in advance which documents they need to prepare.

[1100] 6. Interface adjustment according to user emotions

[1101] If the user's stress level is high based on the output of the emotion engine, the interface display and messages are adjusted, such as adding guide messages or suggesting ways to help the user relax.

[1102] 7. User prepares documents

[1103] The user prepares the necessary documents based on the list of required documents provided. For example, the user may obtain a copy of their resident registration card from the city hall and prepare a driver's license.

[1104] 8. Optional - User makes pre-confirmation reservation

[1105] Users can upload prepared documents online for advance confirmation, and the server will then verify the received documents and check for any errors.

[1106] 9. The server verifies the document data

[1107] The server verifies the received documents and notifies the user of the results. The user can then check the verification results and smoothly proceed with the procedure at the counter.

[1108] Specific examples

[1109] Example 1: Address change procedure

[1110] User A has moved to a new address and wants to change his / her address. User A accesses the system using his / her smartphone and selects "Change of Address Procedure."

[1111] Next, the user enters basic information such as name, old address, new address, phone number, etc. The emotion engine recognizes User A's emotions while entering these details, and if it detects high stress, the system displays a gentle guide message to support User A.

[1112] User A's smartphone sends this information to the server.

[1113] The server identifies the documents required for the address change procedure from the database and notifies User A that a "copy of resident registration" and "identification documents" are required.

[1114] User A obtains a copy of his / her resident registration card from the city hall and prepares his / her driver's license.

[1115] By uploading these documents online and having them checked in advance, the process at the counter can be completed smoothly.

[1116] In this way, the system of the present invention aims not only to enable residents to efficiently prepare for administrative procedures, but also to improve the user experience by incorporating an emotion engine, which reduces user stress and allows procedures to proceed more smoothly.

[1117] The processing flow will be explained below.

[1118] Step 1:

[1119] The user accesses the system using their own terminal and selects the application content, such as "address change procedure," from the menu displayed on the interface.

[1120] Step 2:

[1121] The user enters basic information such as name, old address, new address, phone number, etc. This information must be entered accurately as it is required for procedures related to the application.

[1122] Step 3:

[1123] The emotion engine recognizes the user's emotions in real time. While the user is typing on the device, it uses facial recognition technology and voice analysis to analyze their emotional state, such as stress or happiness.

[1124] Step 4:

[1125] The emotion engine adjusts the interface display and messages based on the user's emotional state. For example, if the user is feeling stressed, more helpful and easy-to-understand guidance messages will be displayed.

[1126] Step 5:

[1127] The terminal assembles the application details and basic information entered by the user into a single data packet and sends it to the server. The user is notified that the data transmission has been completed successfully.

[1128] Step 6:

[1129] The server receives the data packet sent from the device, analyzes the received data packet, and individually extracts the application details (e.g., "change of address") and basic information (name, old address, new address, phone number, etc.).

[1130] Step 7:

[1131] Based on the application details extracted by the server, the server refers to an internal database to identify the documents required for the address change procedure. For example, it identifies that a "copy of the residence certificate" and "identification documents" are required.

[1132] Step 8:

[1133] The server sends the list of required documents to the user's terminal in a data packet, which contains detailed information about the required documents, how to obtain them, and how to submit them.

[1134] Step 9:

[1135] The device displays the list of required documents received from the server to the user. The message displayed is, "The following documents are required for the address change procedure: 1. Copy of residence certificate 2. Identification document (driver's license, etc.)."

[1136] Step 10:

[1137] The user prepares the necessary documents based on the list of required documents provided. For example, the user obtains a copy of their resident registration card from the city hall and prepares their driver's license.

[1138] Step 11:

[1139] Users can upload documents they have prepared for pre-verification online, by taking a scan or photo of the document and submitting it to the system.

[1140] Step 12:

[1141] The server validates the document data received to ensure accuracy and completeness, especially to ensure the document format and content are correct.

[1142] Step 13:

[1143] The server notifies the user of the verification results. The user checks the results and, if any corrections are necessary, submits the documents again. After the final verification is complete, the procedure at the counter can proceed smoothly.

[1144] Example 2

[1145] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1146] In modern administrative procedures, it is extremely important for residents to prepare the appropriate necessary documents in advance. However, it is often unclear which documents should be prepared, which results in wasted time and effort during the procedure. Furthermore, the procedure can become even more difficult if residents experience emotional stress. For this reason, there is a need for residents to carry out administrative procedures efficiently and smoothly.

[1147] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for receiving and analyzing the transmitted application content and basic information, means for identifying appropriate required documents from a database based on the analysis, means for presenting the identified list of required documents to the resident, emotion recognition means for recognizing and analyzing the resident's emotions in real time, and means for adjusting the interface according to the resident's emotions. This allows the resident to clearly understand which documents they need to prepare, reduces emotional stress, and allows the procedure to proceed smoothly.

[1148] "Residents" refers to users who carry out administrative procedures, and are applicants on an individual or household basis.

[1149] "Application details" refers to the specific procedural items that residents enter or select when carrying out administrative procedures.

[1150] "Basic information" refers to the personal information of residents required for the application process, and specifically includes name, address, telephone number, etc.

[1151] "Server" refers to a central computing system for receiving and analyzing data sent from resident devices.

[1152] The "database" is a data storage system that the server references based on the analysis results and manages information on required documents.

[1153] "Emotion recognition means" refers to technology for recognizing and analyzing residents' emotions in real time.

[1154] "Interface" refers to the screen display and operation methods that residents use to interact with the system.

[1155] "Required Document List" refers to a list of documents required for a specified application procedure.

[1156] The system of this invention aims to help residents complete administrative procedures smoothly by presenting the necessary documents in advance according to the application content. This system is mainly composed of a user terminal, a server, and a database. Furthermore, it aims to improve the user experience by utilizing emotion recognition technology to analyze the emotions of residents when completing procedures and adjust the interface accordingly.

[1157] System configuration

[1158] 1. User Device

[1159] A user terminal is a device used by a user to input application details and basic information. It includes smartphones, PCs, tablets, etc.

[1160] The device is equipped with emotion recognition means to recognize and analyze the emotional state of residents in real time when they input information, using facial recognition and voice analysis technologies.

[1161] 2. Server

[1162] The server is a central computing system that receives and analyzes the application and basic information sent from the user terminal. This analysis is used to determine which required documents are needed.

[1163] Examples of specific software used include Python and R for data analysis, and SQL for database integration.

[1164] 3. Database

[1165] The database is a storage system for managing information on required documents. A typical example is a relational database such as PostgreSQL. The server references the database based on the analysis results and identifies the required documents.

[1166] 4. Emotion recognition means

[1167] Emotion recognition is a technology that recognizes and analyzes the user's emotions in real time. Based on the analysis results, it is possible to adjust the user interface and message content.

[1168] Specifically, the emotion recognition algorithm uses a generative AI model to analyze the user's facial expressions and tone of voice.

[1169] Specific examples

[1170] Address change procedures

[1171] Example 1: User A moves to a new address

[1172] User A accesses the system using a smartphone, logs in, and selects "Address change procedure."

[1173] Next, User A inputs his / her name, old address, new address, and phone number. If the emotion recognition means detects stress in User A, the system will display a friendly guide message to support him / her.

[1174] User A's smartphone assembles this information into a data packet and sends it to the server.

[1175] The server identifies the documents required for the address change procedure from the database and notifies User A that a "copy of resident registration" and "identification documents" are required.

[1176] User A obtains a copy of his / her resident registration card from the city hall and prepares his / her driver's license.

[1177] Furthermore, these documents can be uploaded online for pre-checking and the server will verify the documents.

[1178] The verification result is notified to User A, who can then check it and smoothly proceed with the procedure at the counter.

[1179] In this way, the system of the present invention aims not only to enable residents to efficiently prepare for administrative procedures, but also to improve the user experience by combining emotion recognition means, which can reduce residents' stress and make procedures more comfortable.

[1180] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1181] Step 1:

[1182] A user accesses the system. Specifically, the user accesses the system's web page using a smartphone, PC, or tablet, and a login screen appears. Here, the user enters their user ID and password to log in. The entered login information is sent by the device to the server. The server compares the entered user ID and password with a database and performs authentication. If authentication is successful, the user can proceed to the next screen.

[1183] Step 2:

[1184] The user inputs the application details and basic information. The user selects a specific application, such as "address change procedure," and inputs basic information such as name, old address, new address, and phone number. The input data is stored in the device's memory. In addition, an emotion recognition means analyzes the user's facial expressions and voice in real time to determine stress levels, etc. Specifically, the camera and microphone are used to capture the user's emotional data, which is then analyzed by the generative AI model.

[1185] Step 3:

[1186] The device sends the input data to the server. The application details and basic information entered by the user, as well as the emotional data analyzed by the emotion recognition means, are compiled into a single data packet and sent to the server via the Internet. At this time, the data is encrypted using the HTTPS protocol. The structure of the transmitted data is in JSON format, with the necessary information included in each field (e.g., { "Application details": "Change of address", "Name": "Yamada Taro", "Old address": "Tokyo", "New address": "Kanagawa", "Emotion data": { "Stress level": 0.75}}).

[1187] Step 4:

[1188] The server analyzes the received data. The server analyzes the received data packets and extracts the application details, basic information, and emotion data. To perform the analysis, it issues a query to the database and extracts the necessary information. Specifically, it uses an SQL query to obtain the information required for the "change of address procedure" and analyzes it together with the basic information. As a result of the analysis, it identifies which necessary documents are required.

[1189] Step 5:

[1190] The server identifies the required documents. Based on the analyzed application details, the server references the database and identifies the required documents appropriate for the application details. For example, it identifies that a "copy of resident registration" and "identification documents" are required for an address change procedure. This information is compiled into a list and sent to the user's terminal.

[1191] Step 6:

[1192] The server sends a list of required documents to the user's terminal. The server then sends the identified list of required documents in JSON format to the user's terminal. The sent data is received by the terminal and displayed to the user. The user can check which documents they need to prepare.

[1193] Step 7:

[1194] The user device adjusts the interface based on the emotion analysis results. If the emotion recognition means detects that the user's stress level is high, the system displays a gentle guide message. Specifically, the system displays advice for the user to relax and messages that clearly explain the steps of the procedure.

[1195] Step 8:

[1196] The user prepares the necessary documents. Based on the list of required documents provided, the user obtains the necessary documents from city hall or related institutions. For example, the user obtains a copy of their resident registration card from city hall and has their driver's license ready.

[1197] Step 9:

[1198] The user uploads documents online (optional). The user can upload the prepared documents to the system online. The uploaded data is sent from the terminal to the server, and the server verifies the received documents. After verification, the result is notified to the user. This process makes the procedure at the counter go more smoothly.

[1199] (Application example 2)

[1200] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1201] The process of preparing the necessary documents for administrative procedures often increases the amount of work and stress users experience. Furthermore, while the user experience is important for purchasing high-value items on online shopping sites, the process can be complicated and stressful. This can lead to users feeling confused and anxious about the process, ultimately making it difficult for them to complete the procedure.

[1202] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for analyzing the emotional state of the resident using an emotion recognition engine, means for adjusting the interface and presenting a friendly guide message based on the emotional state of the resident, and means for presenting a list of required documents. This allows the user's emotional state to be analyzed in real time and the interface and message content to be adjusted, allowing the user to proceed with the procedure with peace of mind.

[1203] "Residents" are users who use the system to input application details and basic information, identify required documents, and prepare the documents.

[1204] "Application content" refers to the information or content that a user must enter to proceed with an administrative procedure or a specific process.

[1205] "Basic information" refers to personal information such as name, address, and telephone number that is required when a user carries out a specific procedure.

[1206] A "communications network" is a computer network for sending and receiving information, such as the Internet.

[1207] "Server" means a central computing system that receives and analyzes the application and basic information sent by the User, and identifies and presents the required documents.

[1208] An "emotion recognition engine" is a software engine for analyzing a user's emotional state in real time.

[1209] An "interface" is a screen or operating environment that allows interaction between a user and a system.

[1210] The "list of required documents" is a list of documents that the user must prepare in order to proceed with the procedure.

[1211] A "gentle guide message" is a calming guide message that is provided to a user when the user feels stressed while proceeding with a procedure.

[1212] The system of the present invention aims to improve the user experience by using an emotion recognition engine to help residents smoothly complete administrative procedures and purchase procedures for high-value items on online shopping sites. This system is composed of the following main components:

[1213] The entire system includes a user terminal where users can input application details and basic information, a server that receives and analyzes the input data and identifies and presents required documents, a database that manages required document information, and an emotion recognition engine that recognizes the user's emotional state in real time.

[1214] 1. User Device

[1215] The user terminal is a device where the user can input application details and basic information. This includes smartphones and tablets. This terminal is equipped with an emotion recognition engine that analyzes the user's emotional state in real time.

[1216] 2. Server

[1217] The server receives and analyzes the application details and basic information sent from the user terminal via the communication network. Based on the analyzed data, the server identifies the required documents and sends a list of them to the user terminal.

[1218] 3. Database

[1219] The database is a component for managing information on required documents, and the server identifies the required documents by referencing them based on the analysis results.

[1220] 4. Emotion Recognition Engine

[1221] An emotion recognition engine is a software engine that analyzes the user's emotional state (stress, happiness, etc.) when inputting information. Based on the output of this engine, it has the ability to adjust the interface and message content of the user's device.

[1222] In this system, users enter their application details and basic information and send it to the server. The server analyzes the received data, identifies a list of required documents, and displays it on the user's device. If the user's emotional state is stressful, the interface is adjusted based on the output of the emotion recognition engine, and a friendly guidance message is displayed.

[1223] For example, if User A is about to purchase a high-priced item, he or she will use a smartphone to enter the necessary information. At this time, the emotion recognition engine will analyze User A's emotions and, if it determines that User A is under high stress, the interface will display a friendly guide message and briefly explain the procedure.

[1224] Specific examples

[1225] As an example of user input, if the text "I'm trying to purchase an expensive item, but I'm confused about the procedure" is given, the emotion recognition engine will identify the emotional state based on this input.

[1226] Example prompt sentence:

[1227] The EmotionEngine analyzes user input to identify their emotional state. Given the following input text, return an appropriate emotion (e.g., stress, happiness, etc.): Input text: "I'm trying to purchase an expensive item, but I'm having trouble with the process."

[1228] In this way, the system of the present invention recognizes and analyzes the user's emotional state and dynamically adjusts the interface and message content to allow the user to proceed smoothly, improving the user experience and reducing stress during the process.

[1229] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1230] Step 1:

[1231] The user inputs the application details and basic information into the user device (smartphone or tablet). The input details include the application details, such as "purchase a high-priced item," as well as basic information such as name, address, and phone number. The user device is equipped with an emotion recognition engine, which analyzes the user's emotional state in real time.

[1232] input:

[1233] Application details (e.g., purchasing a high-priced item)

[1234] Basic information (name, address, phone number, etc.)

[1235] output:

[1236] Emotional state analysis results (e.g., stress)

[1237] Step 2:

[1238] The user terminal transmits the input application details and basic information to the server via a communication network. The transmitted data includes the application details, basic information, and the analysis results of the emotional state.

[1239] input:

[1240] Application details and basic information

[1241] Emotional state analysis results

[1242] output:

[1243] Data packets sent to the server

[1244] Step 3:

[1245] The server analyzes the received data packet (application details, basic information, and emotional state analysis results). Based on the analyzed data, the server refers to a database to identify the required documents.

[1246] input:

[1247] Received data packet (application details, basic information, emotional state)

[1248] output:

[1249] Required Documents List

[1250] Step 4:

[1251] The server sends the specified list of required documents to the user terminal, which receives the list and presents it to the user.

[1252] input:

[1253] Identified list of required documents

[1254] output:

[1255] Required document list sent to user device

[1256] Step 5:

[1257] The interface of the user's device is adjusted based on the analysis results of the emotion recognition engine. Specifically, if the user is in a stressful state, a gentle guidance message is displayed. If the user's emotional state is relaxed, the normal interface is displayed.

[1258] input:

[1259] Emotional state analysis results

[1260] output:

[1261] Adjusted interface (e.g. friendly guide messages)

[1262] Step 6:

[1263] The user prepares the documents based on the required document list provided, and then uploads them to the server online according to the workflow.

[1264] input:

[1265] Required Documents List

[1266] output:

[1267] Prepared necessary documents

[1268] Step 7:

[1269] The server verifies the uploaded documents and notifies the user of the results, informing them if the documents are accurate or if additional documents are required.

[1270] input:

[1271] Uploaded documents

[1272] output:

[1273] Document verification results (e.g., no errors, additional documents required)

[1274] Through these steps, the system helps users to complete administrative procedures and purchase procedures for high-value items smoothly and without stress.

[1275] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1276] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1277] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1278] [Fourth embodiment]

[1279] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1280] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1281] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1282] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1283] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1284] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1285] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1286] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1287] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1288] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1289] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1290] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1291] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1292] The system of the present invention aims to present necessary documents according to the application contents in advance so that residents can smoothly carry out administrative procedures. This system includes a process in which the user (resident) inputs the application contents and basic information, and the server identifies and presents the appropriate necessary documents based on that information.

[1293] System configuration

[1294] This system consists of the following main components:

[1295] 1. User Device

[1296] A device used by users (residents) to enter application details and basic information. This includes smartphones, PCs, tablets, etc.

[1297] 2. Server

[1298] This is a central computing system that receives and analyzes application details and basic information sent from user terminals.

[1299] 3. Database

[1300] This is a database that manages information on required documents. The server references this database based on the analysis results and identifies the required documents.

[1301] Program processing overview

[1302] 1. The user enters the application details and basic information

[1303] The user accesses the system using their own terminal and selects or inputs the application details (e.g., "address change procedure"), as well as basic information such as name, address, and phone number.

[1304] 2. The device sends the input data to the server

[1305] The terminal collects the application details and basic information input by the user into one data packet and transmits it to the server.

[1306] 3. The server analyzes the received data

[1307] The server receives the data packet sent from the terminal and analyzes the application and basic information, which is then used to reference the database.

[1308] 4. The server identifies the required documents

[1309] Based on the analyzed application details, the server refers to the database and identifies the necessary documents for the application. For example, it identifies that a copy of the residence certificate and identification documents are required for an address change procedure.

[1310] 5. The server sends the list of required documents to the user's device.

[1311] The server sends the list of required documents to the user terminal, which displays the list to the user, allowing the user to know in advance which documents they need to prepare.

[1312] 6. User prepares documents

[1313] The user prepares the necessary documents based on the list of required documents provided. For example, the user may obtain a copy of their resident registration card from the city hall and prepare a driver's license.

[1314] 7. Optional - User makes pre-confirmation reservation

[1315] Users can upload the documents they have prepared online for advance confirmation, allowing them to check whether they have all the necessary documents before going to the counter.

[1316] Specific examples

[1317] Example 1: Address change procedure

[1318] User A has moved to a new address and wants to change his / her address. User A accesses the system using his / her smartphone and selects "Change of Address Procedure."

[1319] Next, enter basic information such as your name, old address, new address, and phone number.

[1320] User A's smartphone sends this information to the server.

[1321] The server identifies the documents required for the address change procedure from the database and notifies User A that a "copy of resident registration" and "identification documents" are required.

[1322] User A obtains a copy of his / her resident registration card from the city hall and prepares his / her driver's license.

[1323] By uploading these documents online and having them checked in advance, the process at the counter can be completed smoothly.

[1324] In this way, the system of the present invention supports residents in efficiently preparing for administrative procedures, and provides functions that speed up and improve the accuracy of procedures at the counter.

[1325] The processing flow will be explained below.

[1326] Step 1:

[1327] The user accesses the system using their own terminal and selects the application content, such as "address change procedure," from the menu displayed on the system interface.

[1328] Step 2:

[1329] The user enters basic information such as name, old address, new address, phone number, etc. This information must be entered accurately as it is required for procedures related to the application.

[1330] Step 3:

[1331] The terminal collects the application details and basic information entered by the user into a single data packet, sends the collected data packet to the server, and notifies the user that the data transmission has been completed successfully.

[1332] Step 4:

[1333] The server receives the data packet sent from the device, analyzes the received data packet, and individually extracts the application details (e.g., "change of address") and basic information (name, old address, new address, phone number, etc.).

[1334] Step 5:

[1335] Based on the application details extracted by the server, the server refers to an internal database to identify the documents required for the address change procedure. For example, it identifies that a "copy of the residence certificate" and "identification documents" are required for the address change procedure.

[1336] Step 6:

[1337] The server sends the specified list of required documents to the user terminal in a data packet, which includes the types of documents required and specific descriptions.

[1338] Step 7:

[1339] The device displays the list of required documents received from the server to the user. For example, the message "The following documents are required for address change procedures: 1. Copy of residence certificate 2. Identification document (driver's license, etc.)" is displayed.

[1340] Step 8:

[1341] The user prepares the necessary documents based on the list of required documents provided. For example, the user obtains a copy of their resident registration card from the city hall and prepares their driver's license.

[1342] Step 9:

[1343] As an optional feature, users can upload documents they have prepared online for pre-checking, and the server will then validate the documents received and check for any errors.

[1344] Step 10:

[1345] The server verifies the received documents and notifies the user of the results. The user can then check the verification results and smoothly proceed with the procedure at the counter.

[1346] Example 1

[1347] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1348] With the current administrative procedure system, residents are unable to ascertain the necessary documents in advance, which often results in delays in procedures at the counter. In addition, if there are any deficiencies or omissions in the application details, residents must redo the procedure, which places a significant burden on them. Furthermore, because documents cannot be checked online, there are many cases where procedures are carried out without sufficient preparation in advance. Therefore, there is a need for a system that allows residents to efficiently prepare for administrative procedures and improves the speed and accuracy of procedures at the counter.

[1349] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1350] In this invention, the server includes a means for residents to input application details and basic information using their own terminals, and a process for the server to identify and present the appropriate required documents; a means for displaying an error message if there are any omissions or errors when the applicant inputs the basic information; and a means for generating a log and sending an alert when the server analyzes the received data. This allows residents to know in advance which documents they need to prepare, allowing for smoother procedures at the counter. Furthermore, early detection of omissions or errors eliminates the need to redo the procedures. Furthermore, advance document confirmation online allows for more efficient procedure preparation.

[1351] "Residents" refers to ordinary individuals who carry out administrative procedures.

[1352] "Application details" refers to the specific types of procedures that residents enter when carrying out administrative procedures.

[1353] "Basic information" refers to personal information such as name, address, and telephone number.

[1354] "Terminal" refers to electronic devices such as smartphones, computers, and tablets.

[1355] "Server" refers to the central computer system that receives and analyzes data sent by residents and identifies required documents.

[1356] "Data Packet" refers to a collection of information including application details and basic information.

[1357] "Parsing" refers to the process by which the server extracts and understands the application and basic information from the data packets it receives.

[1358] "Database" refers to the information management system in which information on required documents is stored.

[1359] "List of required documents" refers to a list of documents that residents must prepare based on the application details.

[1360] A "prompt" refers to a specific instruction that is input into a generative AI model.

[1361] "Error message" refers to a warning message that is displayed when there is an error or omission in the information entered.

[1362] "HTTPS protocol" refers to a secure communications protocol used when transmitting data.

[1363] A "buffer" refers to a storage area within a server that temporarily stores data.

[1364] "Log" refers to a record of system operations, errors, etc.

[1365] "Pre-check" refers to the process of checking preparatory documents before proceeding.

[1366] "Upload" refers to the act of sending data from a terminal to a server.

[1367] The system of the present invention aims to present necessary documents according to the application details in advance so that residents can complete administrative procedures smoothly. This system involves a process in which residents input the application details and basic information, and the server identifies and presents the appropriate necessary documents based on that information.

[1368] System configuration

[1369] This system consists of the following main components:

[1370] 1. User Device

[1371] A device used by users (residents) to enter application details and basic information. This includes smartphones, PCs, tablets, etc.

[1372] 2. Server

[1373] This is a central computing system that receives and analyzes application details and basic information sent from user terminals.

[1374] 3. Database

[1375] This is a database that manages information on required documents. The server references this database based on the analysis results and identifies the required documents.

[1376] Program processing overview

[1377] 1. The user enters the application details and basic information

[1378] The user accesses the system using their own terminal and selects or inputs the application details (e.g., "address change procedure"), as well as basic information such as name, address, and phone number.

[1379] 2. The device sends the input data to the server

[1380] The terminal collects the application details and basic information entered by the user into a single data packet and sends it to the server. The data is encrypted using the HTTPS protocol during transmission.

[1381] 3. The server analyzes the received data

[1382] The server receives the data packet sent from the terminal and analyzes the application content and basic information using common data analysis algorithms and natural language processing techniques.

[1383] 4. The server identifies the required documents

[1384] The server then references the database based on the analyzed application content and identifies the necessary documents for the application. For example, it identifies that a copy of the residence certificate and identification documents are required for an address change procedure. During the analysis process, a log is generated to record the progress and any errors.

[1385] 5. The server sends the list of required documents to the user's device.

[1386] The server sends the list of required documents to the user terminal, which displays the list to the user, allowing the user to know in advance which documents they need to prepare.

[1387] 6. User prepares documents

[1388] The user prepares the necessary documents based on the list of required documents provided. For example, the user obtains a copy of their resident registration card from the city hall and prepares their driver's license.

[1389] 7. User makes advance confirmation reservation (optional)

[1390] Users can upload the prepared documents online for pre-checking. This is done via the system's check page, and the server receives the uploaded documents and checks their contents. The check result will be notified to the user.

[1391] Specific examples

[1392] Example 1: Address change procedure

[1393] User A has moved to a new address and wants to change his / her address. User A accesses the system using his / her smartphone and selects "Change of Address Procedure."

[1394] Next, enter basic information such as your name, old address, new address, and phone number.

[1395] User A's smartphone sends this information to the server.

[1396] The server identifies the documents required for the address change procedure from the database and notifies User A that a "copy of resident registration" and "identification documents" are required.

[1397] User A obtains a copy of his / her resident registration card from the city hall and prepares his / her driver's license.

[1398] By uploading these documents online and having them checked in advance, the process at the counter can be completed smoothly.

[1399] Prompt Sentence Examples

[1400] You can get more detailed help and explanations by inputting the following prompts into the generative AI model:

[1401] If a user wants to change their address because they're moving, what information should they enter and what documents should they prepare? The prompt sequence is as follows:

[1402] 1. Select "Change of Address Procedure" as the application content.

[1403] 2. Enter basic information such as your name, old address, new address, and phone number.

[1404] 3. The server identifies the necessary documents and notifies the user that a "copy of residence certificate" and "identification documents" are required.

[1405] 4. The user prepares these documents.

[1406] 5. Optionally, users can upload documents online for pre-verification.

[1407] This system provides support to residents to efficiently prepare for administrative procedures and expedite procedures at the counter.

[1408] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1409] Step 1:

[1410] The user enters the application details and basic information. The user accesses the system using their own device (smartphone, PC, tablet). They enter their ID and password on the login screen to authenticate. After logging in, they select the application details, such as "Address Change Procedure," from the main menu. Next, they enter basic information such as name, old address, new address, and phone number for each field. Once all information has been entered, they click the "Submit" button. Based on the user's input, the system acquires the application details and basic information as data.

[1411] Step 2:

[1412] The terminal sends the input data to the server. The terminal compiles the application details and basic information entered by the user into a single JSON format data packet. This data packet is sent to the server using the HTTPS protocol. The data is encrypted during transmission to ensure security. The input data is sent to the server in JSON format and is temporarily stored in a buffer on the server.

[1413] Step 3:

[1414] The server analyzes the received data. The server receives data packets sent from the terminal and stores them in a buffer. A back-end program retrieves the data from the buffer and analyzes the application content and basic information. This analysis uses common data analysis algorithms and natural language processing techniques. The analyzed data is then formatted in preparation for a database query. During the analysis process, logs are generated and alerts are sent.

[1415] Step 4:

[1416] The server identifies the required documents. Based on the analyzed application details, the server executes a database query to identify the required documents. The database stores a list of required documents for each application. For example, it identifies that a "change of address procedure" requires a "copy of resident registration" and "identification documents." The server receives the results of the database query and compiles the list of required documents into a response data packet.

[1417] Step 5:

[1418] The server sends a list of required documents to the user terminal. The server then sends the generated response data packet to the user terminal using the HTTPS protocol. The user terminal analyzes the received data packet and displays the list of required documents on the screen. This allows the user to check the documents that need to be prepared in advance.

[1419] Step 6:

[1420] The user prepares the documents. The user prepares the documents based on the displayed list of required documents. For example, the user goes to the city hall to obtain a copy of the resident registration card and prepares a driver's license. The user can enter the preparation status into the system in the form of a check box and check the progress.

[1421] Step 7:

[1422] The user makes a reservation for advance verification (optional). The user accesses the system again to have the prepared documents verified online. They go to the document upload screen and upload scans or images of their "copy of resident registration" and "identification documents." Once the upload is complete, they click the "Request verification" button. The server receives the uploaded documents and verifies their contents. The verification results are notified to the user's device, and they can see which documents are missing.

[1423] (Application example 1)

[1424] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1425] In conventional administrative procedure systems, it was difficult for users to understand in advance what documents were required for their application, which often made the procedures cumbersome. Another problem was that procedures at the counter did not proceed smoothly. In addition, there was no way for residents to check information in real time using advanced devices such as smart glasses, making it difficult to complete procedures efficiently.

[1426] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1427] In this invention, the server includes a means for residents to input application details, a means for residents to input their own basic information, a means for transmitting the input application details and basic information to the server, a means for receiving and analyzing the transmitted application details and basic information, a means for identifying required documents based on the analysis results, a means for presenting a list of identified required documents to the resident, and a means for presenting the list of required documents to the resident in real time using smart glasses. This allows residents to know and prepare the necessary documents in advance, allowing for smooth procedures at the counter. In addition, using smart glasses allows for real-time information acquisition, enabling efficient procedures.

[1428] A "resident" is an individual who resides in a particular area and is required to carry out administrative procedures.

[1429] "Application details" refers to information that indicates the specific types and details of administrative procedures that residents wish to carry out.

[1430] "Basic information" refers to data that identifies a resident, such as their name, address, and phone number.

[1431] "Server" refers to a central computing system that receives and analyzes application details and basic information sent by users.

[1432] The "list of required documents" is a list of documents that need to be prepared according to the application content.

[1433] "Smart glasses" are advanced computing devices that can be worn by a user to display information in their field of vision.

[1434] A "database" is an information storage system that manages information on required documents and is referenced by the server.

[1435] "Analysis" refers to data processing to identify required documents based on the application details and basic information received by the server.

[1436] "Documents" are documents necessary for carrying out administrative procedures.

[1437] "Transmission" is the process of sending data from a user terminal to a server.

[1438] System configuration

[1439] A system for implementing the present invention comprises the following major components:

[1440] 1. User Device

[1441] A device used by users (residents) to enter application details and basic information. This includes smart glasses, smartphones, PCs, tablets, etc.

[1442] 2. Server

[1443] This is a central computing system that receives and analyzes application details and basic information sent from user terminals.

[1444] 3. Database

[1445] This is a database that manages information on required documents. The server references this database based on the analysis results and identifies the required documents.

[1446] Program processing overview

[1447] User terminal

[1448] By using the smart glasses, users can intuitively input application details and basic information. The smart glasses support users by displaying input forms and guides in their field of vision.

[1449] server

[1450] The system receives and analyzes the application details and basic information sent from the device. Based on the analysis, it identifies the necessary documents from a database. Natural language processing technology can be used for the analysis, and accuracy can be improved by utilizing generative AI models (e.g., GPT-3).

[1451] Database

[1452] The database stores information on documents required for various administrative procedures. The server references the database based on the analysis results and identifies the necessary documents appropriate for the application.

[1453] User Notifications

[1454] The identified list of required documents will be displayed in real time on the user's smart glasses, allowing the user to know and prepare the necessary documents in advance.

[1455] Operation procedures and usage examples

[1456] Let's say a user arrives at city hall and wants to change their address because they have moved to a new address. They launch the app installed on their smart glasses and select "Change of Address Procedure." Next, they enter basic information such as their name, old address, new address, and phone number. The user data is sent from the smart glasses to the server, which analyzes it. After a few seconds, a message appears saying, "To change your address, you will need a copy of your resident registration card and a form of identification (driver's license)."

[1457] Prompt Sentence Examples

[1458] "The user enters the request 'Change of Address' and basic information (name, old address, new address, phone number). The server analyzes this information, identifies the required documents, and generates a list. The required documents are presented to the user in real time through the smart glasses. Please explain this process in natural language."

[1459] As a result, users can smoothly complete procedures at the counter. In addition, by using smart glasses, they can obtain information in real time, making procedures more efficient.

[1460] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1461] Step 1:

[1462] The user starts up the smart glasses and enters the application details and basic information. A menu for selecting "Address Change Procedure" appears on the smart glasses screen. The user then uses touch or voice input to enter basic information such as name, old address, new address, and phone number. The entered data is temporarily stored in the internal memory.

[1463] Input: Application details selected by the user (e.g., address change procedure) and basic information (name, old address, new address, phone number)

[1464] Output: Temporarily save input data

[1465] Step 2:

[1466] The user device sends the entered application details and basic information to the server. A data packet is generated through the smart glasses' communication module and sent as a POST request to the server's API endpoint.

[1467] Input: Data entered by the user (application details and basic information)

[1468] Output: Data packet sent to the server

[1469] Step 3:

[1470] The server analyzes the received data. The server deserializes the received data packet and analyzes the application content and basic information. It performs natural language analysis using a generative AI model to extract parameters to identify required documents.

[1471] Input: Submitted application details and basic information

[1472] Output: Parsed parameters

[1473] Step 4:

[1474] The server identifies the required documents. The server sends a query to the database and lists the documents required for the relevant procedure based on the parsed parameters. The listed document information is organized as structured data within the server.

[1475] Input: Parsed parameters (e.g., documents required for address change procedures)

[1476] Output: Required documents list

[1477] Step 5:

[1478] The server sends the required document list to the user terminal. The compiled required document list is converted back into data packets and sent to the smart glasses. If communication is successful, the smart glasses receive the data and display the required document list on their screen.

[1479] Input: Required documents list

[1480] Output: Sending data packet and displaying list of required documents

[1481] Step 6:

[1482] The user prepares the necessary documents (e.g., a copy of the resident registration card and identification documents) while looking at the display screen of the smart glasses. The user physically collects and prepares the documents according to the displayed instructions.

[1483] Input: List of required documents displayed on smart glasses

[1484] Output: Prepared document

[1485] Step 7:

[1486] (Optional) The user uploads the documents they have prepared for pre-check online. Using smart glasses or other devices, they take photos or scans of the documents and enter them into a dedicated upload form, then send them to the server. The server then checks the uploaded data to ensure that the required documents are properly prepared.

[1487] Input: Uploaded document data

[1488] Output: Document pre-check results

[1489] By following the above steps, users can grasp the necessary documents in real time and carry out administrative procedures efficiently and smoothly.

[1490] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1491] The system of the present invention aims to present necessary documents in advance according to the application details so that residents can complete administrative procedures smoothly. This system involves a process in which the user (resident) inputs the application details and basic information, and the server identifies and presents the appropriate necessary documents based on that information. The present invention also aims to improve the user experience by combining it with an emotion engine that recognizes the user's emotions.

[1492] System configuration

[1493] This system consists of the following main components:

[1494] 1. User Device

[1495] A device used by users (residents) to enter application details and basic information. This includes smartphones, PCs, tablets, etc.

[1496] It is equipped with an emotion engine that recognizes the user's emotions in real time.

[1497] 2. Server

[1498] This is a central computing system that receives and analyzes application details and basic information sent from user terminals.

[1499] The necessary documents are identified and the results are sent to the user's terminal.

[1500] 3. Database

[1501] This is a database that manages information on required documents. The server references this database based on the analysis results and identifies the required documents.

[1502] 4. Emotion Engine

[1503] It is an engine for recognizing the user's emotions, analyzing the emotional state (e.g., stress, happiness, etc.) when the user inputs.

[1504] The interface and message content are adjusted based on the output of the emotion engine.

[1505] Program processing overview

[1506] 1. The user enters the application details and basic information

[1507] The user accesses the system using their own terminal and selects or inputs the application details (e.g., "address change procedure"), as well as basic information such as name, address, and phone number.

[1508] The emotion engine recognizes and analyzes the emotions expressed by users as they type.

[1509] 2. The device sends the input data to the server

[1510] The terminal collects the application details and basic information input by the user into one data packet and transmits it to the server.

[1511] 3. The server analyzes the received data

[1512] The server receives the data packet sent from the terminal and analyzes the application and basic information, which is then used to reference the database.

[1513] 4. The server identifies the required documents

[1514] Based on the analyzed application details, the server refers to the database to identify the necessary documents for the application. For example, it identifies that a copy of the residence certificate and identification documents are required for an address change procedure.

[1515] 5. The server sends the list of required documents to the user's device.

[1516] The server sends the identified list of required documents to the user's terminal, which then displays the list to the user, allowing the user to know in advance which documents they need to prepare.

[1517] 6. Interface adjustment according to user emotions

[1518] If the user's stress level is high based on the output of the emotion engine, the interface display and messages are adjusted, such as adding guide messages or suggesting ways to help the user relax.

[1519] 7. User prepares documents

[1520] The user prepares the necessary documents based on the list of required documents provided. For example, the user may obtain a copy of their resident registration card from the city hall and prepare a driver's license.

[1521] 8. Optional - User makes pre-confirmation reservation

[1522] Users can upload prepared documents online for advance confirmation, and the server will then verify the received documents and check for any errors.

[1523] 9. The server verifies the document data

[1524] The server verifies the received documents and notifies the user of the results. The user can then check the verification results and smoothly proceed with the procedure at the counter.

[1525] Specific examples

[1526] Example 1: Address change procedure

[1527] User A has moved to a new address and wants to change his / her address. User A accesses the system using his / her smartphone and selects "Change of Address Procedure."

[1528] Next, the user enters basic information such as name, old address, new address, phone number, etc. The emotion engine recognizes User A's emotions while entering these details, and if it detects high stress, the system displays a gentle guide message to support User A.

[1529] User A's smartphone sends this information to the server.

[1530] The server identifies the documents required for the address change procedure from the database and notifies User A that a "copy of resident registration" and "identification documents" are required.

[1531] User A obtains a copy of his / her resident registration card from the city hall and prepares his / her driver's license.

[1532] By uploading these documents online and having them checked in advance, the process at the counter can be completed smoothly.

[1533] In this way, the system of the present invention aims not only to enable residents to efficiently prepare for administrative procedures, but also to improve the user experience by incorporating an emotion engine, which reduces user stress and allows procedures to proceed more smoothly.

[1534] The processing flow will be explained below.

[1535] Step 1:

[1536] The user accesses the system using their own terminal and selects the application content, such as "address change procedure," from the menu displayed on the interface.

[1537] Step 2:

[1538] The user enters basic information such as name, old address, new address, phone number, etc. This information must be entered accurately as it is required for procedures related to the application.

[1539] Step 3:

[1540] The emotion engine recognizes the user's emotions in real time. While the user is typing on the device, it uses facial recognition technology and voice analysis to analyze their emotional state, such as stress or happiness.

[1541] Step 4:

[1542] The emotion engine adjusts the interface display and messages based on the user's emotional state. For example, if the user is feeling stressed, more helpful and easy-to-understand guidance messages will be displayed.

[1543] Step 5:

[1544] The terminal assembles the application details and basic information entered by the user into a single data packet and sends it to the server. The user is notified that the data transmission has been completed successfully.

[1545] Step 6:

[1546] The server receives the data packet sent from the device, analyzes the received data packet, and individually extracts the application details (e.g., "change of address") and basic information (name, old address, new address, phone number, etc.).

[1547] Step 7:

[1548] Based on the application details extracted by the server, the server refers to an internal database to identify the documents required for the address change procedure. For example, it identifies that a "copy of the residence certificate" and "identification documents" are required.

[1549] Step 8:

[1550] The server sends the list of required documents to the user's terminal in a data packet, which contains detailed information about the required documents, how to obtain them, and how to submit them.

[1551] Step 9:

[1552] The device displays the list of required documents received from the server to the user. The message displayed is, "The following documents are required for the address change procedure: 1. Copy of residence certificate 2. Identification document (driver's license, etc.)."

[1553] Step 10:

[1554] The user prepares the necessary documents based on the list of required documents provided. For example, the user obtains a copy of their resident registration card from the city hall and prepares their driver's license.

[1555] Step 11:

[1556] Users can upload documents they have prepared for pre-verification online, by taking a scan or photo of the document and submitting it to the system.

[1557] Step 12:

[1558] The server validates the document data received to ensure accuracy and completeness, especially to ensure the document format and content are correct.

[1559] Step 13:

[1560] The server notifies the user of the verification results. The user checks the results and, if any corrections are necessary, submits the documents again. After the final verification is complete, the procedure at the counter can proceed smoothly.

[1561] Example 2

[1562] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1563] In modern administrative procedures, it is extremely important for residents to prepare the appropriate necessary documents in advance. However, it is often unclear which documents should be prepared, which results in wasted time and effort during the procedure. Furthermore, the procedure can become even more difficult if residents experience emotional stress. For this reason, there is a need for residents to carry out administrative procedures efficiently and smoothly.

[1564] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for receiving and analyzing the transmitted application content and basic information, means for identifying appropriate required documents from a database based on the analysis, means for presenting the identified list of required documents to the resident, emotion recognition means for recognizing and analyzing the resident's emotions in real time, and means for adjusting the interface according to the resident's emotions. This allows the resident to clearly understand which documents they need to prepare, reduces emotional stress, and allows the procedure to proceed smoothly.

[1565] "Residents" refers to users who carry out administrative procedures, and are applicants on an individual or household basis.

[1566] "Application details" refers to the specific procedural items that residents enter or select when carrying out administrative procedures.

[1567] "Basic information" refers to the personal information of residents required for the application process, and specifically includes name, address, telephone number, etc.

[1568] "Server" refers to a central computing system for receiving and analyzing data sent from resident devices.

[1569] The "database" is a data storage system that the server references based on the analysis results and manages information on required documents.

[1570] "Emotion recognition means" refers to technology for recognizing and analyzing residents' emotions in real time.

[1571] "Interface" refers to the screen display and operation methods that residents use to interact with the system.

[1572] "Required Document List" refers to a list of documents required for a specified application procedure.

[1573] The system of this invention aims to help residents complete administrative procedures smoothly by presenting the necessary documents in advance according to the application content. This system is mainly composed of a user terminal, a server, and a database. Furthermore, it aims to improve the user experience by utilizing emotion recognition technology to analyze the emotions of residents when completing procedures and adjust the interface accordingly.

[1574] System configuration

[1575] 1. User Device

[1576] A user terminal is a device used by a user to input application details and basic information. It includes smartphones, PCs, tablets, etc.

[1577] The device is equipped with emotion recognition means to recognize and analyze the emotional state of residents in real time when they input information, using facial recognition and voice analysis technologies.

[1578] 2. Server

[1579] The server is a central computing system that receives and analyzes the application and basic information sent from the user terminal. This analysis is used to determine which required documents are needed.

[1580] Examples of specific software used include Python and R for data analysis, and SQL for database integration.

[1581] 3. Database

[1582] The database is a storage system for managing information on required documents. A typical example is a relational database such as PostgreSQL. The server references the database based on the analysis results and identifies the required documents.

[1583] 4. Emotion recognition means

[1584] Emotion recognition is a technology that recognizes and analyzes the user's emotions in real time. Based on the analysis results, it is possible to adjust the user interface and message content.

[1585] Specifically, the emotion recognition algorithm uses a generative AI model to analyze the user's facial expressions and tone of voice.

[1586] Specific examples

[1587] Address change procedures

[1588] Example 1: User A moves to a new address

[1589] User A accesses the system using a smartphone, logs in, and selects "Address change procedure."

[1590] Next, User A inputs his / her name, old address, new address, and phone number. If the emotion recognition means detects stress in User A, the system will display a friendly guide message to support him / her.

[1591] User A's smartphone assembles this information into a data packet and sends it to the server.

[1592] The server identifies the documents required for the address change procedure from the database and notifies User A that a "copy of resident registration" and "identification documents" are required.

[1593] User A obtains a copy of his / her resident registration card from the city hall and prepares his / her driver's license.

[1594] Furthermore, these documents can be uploaded online for pre-checking and the server will verify the documents.

[1595] The verification result is notified to User A, who can then check it and smoothly proceed with the procedure at the counter.

[1596] In this way, the system of the present invention aims not only to enable residents to efficiently prepare for administrative procedures, but also to improve the user experience by combining emotion recognition means, which can reduce residents' stress and make procedures more comfortable.

[1597] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1598] Step 1:

[1599] A user accesses the system. Specifically, the user accesses the system's web page using a smartphone, PC, or tablet, and a login screen appears. Here, the user enters their user ID and password to log in. The entered login information is sent by the device to the server. The server compares the entered user ID and password with a database and performs authentication. If authentication is successful, the user can proceed to the next screen.

[1600] Step 2:

[1601] The user inputs the application details and basic information. The user selects a specific application, such as "address change procedure," and inputs basic information such as name, old address, new address, and phone number. The input data is stored in the device's memory. In addition, an emotion recognition means analyzes the user's facial expressions and voice in real time to determine stress levels, etc. Specifically, the camera and microphone are used to capture the user's emotional data, which is then analyzed by the generative AI model.

[1602] Step 3:

[1603] The device sends the input data to the server. The application details and basic information entered by the user, as well as the emotional data analyzed by the emotion recognition means, are compiled into a single data packet and sent to the server via the Internet. At this time, the data is encrypted using the HTTPS protocol. The structure of the transmitted data is in JSON format, with the necessary information included in each field (e.g., { "Application details": "Change of address", "Name": "Yamada Taro", "Old address": "Tokyo", "New address": "Kanagawa", "Emotion data": { "Stress level": 0.75}}).

[1604] Step 4:

[1605] The server analyzes the received data. The server analyzes the received data packets and extracts the application details, basic information, and emotion data. To perform the analysis, it issues a query to the database and extracts the necessary information. Specifically, it uses an SQL query to obtain the information required for the "change of address procedure" and analyzes it together with the basic information. As a result of the analysis, it identifies which necessary documents are required.

[1606] Step 5:

[1607] The server identifies the required documents. Based on the analyzed application details, the server references the database and identifies the required documents appropriate for the application details. For example, it identifies that a "copy of resident registration" and "identification documents" are required for an address change procedure. This information is compiled into a list and sent to the user's terminal.

[1608] Step 6:

[1609] The server sends a list of required documents to the user's terminal. The server then sends the identified list of required documents in JSON format to the user's terminal. The sent data is received by the terminal and displayed to the user. The user can check which documents they need to prepare.

[1610] Step 7:

[1611] The user device adjusts the interface based on the emotion analysis results. If the emotion recognition means detects that the user's stress level is high, the system displays a gentle guide message. Specifically, the system displays advice for the user to relax and messages that clearly explain the steps of the procedure.

[1612] Step 8:

[1613] The user prepares the necessary documents. Based on the list of required documents provided, the user obtains the necessary documents from city hall or related institutions. For example, the user obtains a copy of their resident registration card from city hall and has their driver's license ready.

[1614] Step 9:

[1615] The user uploads documents online (optional). The user can upload the prepared documents to the system online. The uploaded data is sent from the terminal to the server, and the server verifies the received documents. After verification, the result is notified to the user. This process makes the procedure at the counter go more smoothly.

[1616] (Application example 2)

[1617] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1618] The process of preparing the necessary documents for administrative procedures often increases the amount of work and stress users experience. Furthermore, while the user experience is important for purchasing high-value items on online shopping sites, the process can be complicated and stressful. This can lead to users feeling confused and anxious about the process, ultimately making it difficult for them to complete the procedure.

[1619] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for analyzing the emotional state of the resident using an emotion recognition engine, means for adjusting the interface and presenting a friendly guide message based on the emotional state of the resident, and means for presenting a list of required documents. This allows the user's emotional state to be analyzed in real time and the interface and message content to be adjusted, allowing the user to proceed with the procedure with peace of mind.

[1620] "Residents" are users who use the system to input application details and basic information, identify required documents, and prepare the documents.

[1621] "Application content" refers to the information or content that a user must enter to proceed with an administrative procedure or a specific process.

[1622] "Basic information" refers to personal information such as name, address, and telephone number that is required when a user carries out a specific procedure.

[1623] A "communications network" is a computer network for sending and receiving information, such as the Internet.

[1624] "Server" means a central computing system that receives and analyzes the application and basic information sent by the User, and identifies and presents the required documents.

[1625] An "emotion recognition engine" is a software engine for analyzing a user's emotional state in real time.

[1626] An "interface" is a screen or operating environment that allows interaction between a user and a system.

[1627] The "list of required documents" is a list of documents that the user must prepare in order to proceed with the procedure.

[1628] A "gentle guide message" is a calming guide message that is provided to a user when the user feels stressed while proceeding with a procedure.

[1629] The system of the present invention aims to improve the user experience by using an emotion recognition engine to help residents smoothly complete administrative procedures and purchase procedures for high-value items on online shopping sites. This system is composed of the following main components:

[1630] The entire system includes a user terminal where users can input application details and basic information, a server that receives and analyzes the input data and identifies and presents required documents, a database that manages required document information, and an emotion recognition engine that recognizes the user's emotional state in real time.

[1631] 1. User Device

[1632] The user terminal is a device where the user can input application details and basic information. This includes smartphones and tablets. This terminal is equipped with an emotion recognition engine that analyzes the user's emotional state in real time.

[1633] 2. Server

[1634] The server receives and analyzes the application details and basic information sent from the user terminal via the communication network. Based on the analyzed data, the server identifies the required documents and sends a list of them to the user terminal.

[1635] 3. Database

[1636] The database is a component for managing information on required documents, and the server identifies the required documents by referencing them based on the analysis results.

[1637] 4. Emotion Recognition Engine

[1638] An emotion recognition engine is a software engine that analyzes the user's emotional state (stress, happiness, etc.) when inputting information. Based on the output of this engine, it has the ability to adjust the interface and message content of the user's device.

[1639] In this system, users enter their application details and basic information and send it to the server. The server analyzes the received data, identifies a list of required documents, and displays it on the user's device. If the user's emotional state is stressful, the interface is adjusted based on the output of the emotion recognition engine, and a friendly guidance message is displayed.

[1640] For example, if User A is about to purchase a high-priced item, he or she will use a smartphone to enter the necessary information. At this time, the emotion recognition engine will analyze User A's emotions and, if it determines that User A is under high stress, the interface will display a friendly guide message and briefly explain the procedure.

[1641] Specific examples

[1642] As an example of user input, if the text "I'm trying to purchase an expensive item, but I'm confused about the procedure" is given, the emotion recognition engine will identify the emotional state based on this input.

[1643] Example prompt sentence:

[1644] The EmotionEngine analyzes user input to identify their emotional state. Given the following input text, return an appropriate emotion (e.g., stress, happiness, etc.): Input text: "I'm trying to purchase an expensive item, but I'm having trouble with the process."

[1645] In this way, the system of the present invention recognizes and analyzes the user's emotional state and dynamically adjusts the interface and message content to allow the user to proceed smoothly, improving the user experience and reducing stress during the process.

[1646] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1647] Step 1:

[1648] The user inputs the application details and basic information into the user device (smartphone or tablet). The input details include the application details, such as "purchase a high-priced item," as well as basic information such as name, address, and phone number. The user device is equipped with an emotion recognition engine, which analyzes the user's emotional state in real time.

[1649] input:

[1650] Application details (e.g., purchasing a high-priced item)

[1651] Basic information (name, address, phone number, etc.)

[1652] output:

[1653] Emotional state analysis results (e.g., stress)

[1654] Step 2:

[1655] The user terminal transmits the input application details and basic information to the server via a communication network. The transmitted data includes the application details, basic information, and the analysis results of the emotional state.

[1656] input:

[1657] Application details and basic information

[1658] Emotional state analysis results

[1659] output:

[1660] Data packets sent to the server

[1661] Step 3:

[1662] The server analyzes the received data packet (application details, basic information, and emotional state analysis results). Based on the analyzed data, the server refers to a database to identify the required documents.

[1663] input:

[1664] Received data packet (application details, basic information, emotional state)

[1665] output:

[1666] Required Documents List

[1667] Step 4:

[1668] The server sends the specified list of required documents to the user terminal, which receives the list and presents it to the user.

[1669] input:

[1670] Identified list of required documents

[1671] output:

[1672] Required document list sent to user device

[1673] Step 5:

[1674] The interface of the user's device is adjusted based on the analysis results of the emotion recognition engine. Specifically, if the user is in a stressful state, a gentle guidance message is displayed. If the user's emotional state is relaxed, the normal interface is displayed.

[1675] input:

[1676] Emotional state analysis results

[1677] output:

[1678] Adjusted interface (e.g. friendly guide messages)

[1679] Step 6:

[1680] The user prepares the documents based on the required document list provided, and then uploads them to the server online according to the workflow.

[1681] input:

[1682] Required Documents List

[1683] output:

[1684] Prepared necessary documents

[1685] Step 7:

[1686] The server verifies the uploaded documents and notifies the user of the results, informing them if the documents are accurate or if additional documents are required.

[1687] input:

[1688] Uploaded documents

[1689] output:

[1690] Document verification results (e.g., no errors, additional documents required)

[1691] Through these steps, the system helps users to complete administrative procedures and purchase procedures for high-value items smoothly and without stress.

[1692] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1693] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1694] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1695] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1696] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1697] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1698] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1699] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1700] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1701] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1702] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1703] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1704] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1705] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1706] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1707] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1708] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1709] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1710] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1711] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1712] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1713] The following is further disclosed regarding the above embodiment.

[1714] (Claim 1)

[1715] A means for residents to input their application details;

[1716] A means for residents to enter their basic information;

[1717] means for transmitting the input application details and basic information to a server;

[1718] A means for receiving and analyzing the submitted application and basic information;

[1719] A means for identifying required documents based on the analysis results;

[1720] a means of providing residents with a list of identified required documents;

[1721] A system including:

[1722] (Claim 2)

[1723] 10. The system of claim 1, further comprising means for the resident to prepare documents based on the indicated required documents.

[1724] (Claim 3)

[1725] 10. The system of claim 1, further comprising means for residents to upload documents prepared for pre-confirmation online.

[1726] (Claim 4)

[1727] 4. The system according to claim 3, further comprising means for verifying the document data received by the server and notifying the resident of the result.

[1728] "Example 1"

[1729] (Claim 1)

[1730] A means for residents to input their application details;

[1731] A means for residents to enter their basic information;

[1732] means for transmitting the input application details and basic information to a server;

[1733] A means for receiving and analyzing the submitted application and basic information;

[1734] A means for identifying required documents based on the analysis results;

[1735] a means of providing residents with a list of identified required documents;

[1736] A means to provide a process in which residents can use their own devices to input application details and basic information, and the server identifies and presents the appropriate required documents;

[1737] When applicants enter basic information, a means to display an error message if there are any missing or incorrect information;

[1738] A means for generating logs and sending alerts when the server analyzes the received data;

[1739] The communication between the terminal and the server uses the HTTPS protocol, and data is encrypted when transmitted.

[1740] A means for residents to upload documents based on the list of required documents online and have the documents verified in advance;

[1741] A system including:

[1742] (Claim 2)

[1743] 10. The system of claim 1, further comprising means for the resident to prepare documents based on the required documents indicated.

[1744] (Claim 3)

[1745] 10. The system of claim 1, further comprising means for residents to upload documents prepared for pre-confirmation online.

[1746] "Application Example 1"

[1747] (Claim 1)

[1748] A means for residents to input their application details;

[1749] A means for residents to enter their basic information;

[1750] means for transmitting the input application details and basic information to a server;

[1751] A means for receiving and analyzing the submitted application and basic information;

[1752] A means for identifying required documents based on the analysis results;

[1753] a means of providing residents with a list of identified required documents;

[1754] A means of presenting residents with a list of required documents in real time using smart glasses;

[1755] A system including:

[1756] (Claim 2)

[1757] 10. The system of claim 1, further comprising means for the resident to prepare documents based on the indicated required documents.

[1758] (Claim 3)

[1759] 10. The system of claim 1, further comprising means for residents to upload documents prepared for pre-confirmation online.

[1760] "Example 2: Combining Emotion Engines"

[1761] (Claim 1)

[1762] A means for residents to input their application details;

[1763] A means for residents to enter their basic information;

[1764] means for transmitting the input application details and basic information to a server;

[1765] A means for receiving and analyzing the submitted application and basic information;

[1766] means for identifying appropriate required documents from the database based on the analysis;

[1767] a means of providing residents with a list of identified required documents;

[1768] An emotion recognition means for recognizing and analyzing residents' emotions in real time;

[1769] A means of adjusting the interface according to the residents' emotions;

[1770] A system including:

[1771] (Claim 2)

[1772] 10. The system of claim 1, further comprising means for the resident to prepare documentation based on the identified required documents.

[1773] (Claim 3)

[1774] 10. The system of claim 1, further comprising means for residents to upload online documents prepared for pre-confirmation.

[1775] "Application example 2 when combining emotion engines"

[1776] (Claim 1)

[1777] A means for residents to input their application details;

[1778] A means for residents to enter their basic information;

[1779] means for transmitting the input application details and basic information to a server via a communication network;

[1780] A means for receiving and analyzing the submitted application and basic information;

[1781] A means for identifying required documents based on the analysis results;

[1782] a means of providing residents with a list of identified required documents;

[1783] means for analyzing the emotional state of residents using an emotion recognition engine;

[1784] A means for adjusting the interface and presenting gentle guidance messages based on the residents' emotional state;

[1785] A system including:

[1786] (Claim 2)

[1787] 10. The system of claim 1, further comprising means for the resident to prepare documents based on the indicated required documents.

[1788] (Claim 3)

[1789] 2. The system according to claim 1, further comprising means for uploading documents prepared by residents for advance confirmation to the server online via a communication network. [Explanation of symbols]

[1790] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. A means for residents to input their application details; A means for residents to enter their basic information; means for transmitting the input application details and basic information to a server; A means for receiving and analyzing the submitted application and basic information; A means for identifying required documents based on the analysis results; a means of providing residents with a list of identified required documents; A system including:

2. 10. The system of claim 1, further comprising means for the resident to prepare documents based on the required documents indicated.

3. The system of claim 1 further comprising means for residents to upload online documents prepared for pre-confirmation.

4. 4. The system according to claim 3, further comprising means for verifying the document data received by the server and notifying the resident of the result.

Images