system

Abstract

We provide the system. [Solution] A means of receiving information from users and verifying the format of the input data, A means of collecting information on various procedures and updating the database, Based on the received input data, a means is provided to automatically generate application documents and fill in the appropriate fields. Means for providing the generated documents and related information to the user, A means of notifying users about the set deadline and prompting them to take action, A system that includes this.

Description

Technical Field

[0005] ,

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor and includes steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Conventional application procedures to local governments have different formats and requirements for submissions for each local government, which were cumbersome and burdensome for users. Also, for users unfamiliar with the system, including foreigners, these procedures were even more difficult, and there were problems such as time-consuming deadline management and collection of necessary information. There is a need for an efficient and user-friendly system to solve these problems. <00​​​​​This invention provides a system that receives information from users, verifies the format of input data, and automatically generates application documents based on user input data using a database containing information on various procedures. This simplifies user procedures by providing a consistent process from the automatic generation of necessary application forms to presenting documents to users and guiding them to the next action. Furthermore, it incorporates features to make the process easier for users through information analysis using natural language processing and voice guidance. In addition, it includes a reminder function to notify users of set deadlines and required actions, preventing them from missing any steps.

[0006] "Information from users" refers to data provided by individuals or organizations using the system that is necessary for the application process.

[0007] "Means for verifying the format of input data" refers to a function that checks whether the information received from the user conforms to the correct format and standards, and prompts the user to make corrections if there are any deficiencies.

[0008] "Information on diverse procedures" refers to systematic data on processes such as application methods, formats, and required documents, which vary from one local government to another.

[0009] "Means of updating the database" refers to a function that reflects newly acquired information in the existing database, ensuring that accurate data is always maintained.

[0010] "A means of automatically generating application documents and filling in the appropriate fields" refers to a function that automatically creates application documents in the required format based on data received from the user, and completes them by filling in the designated fields.

[0011] "Means for providing generated documents and related information to users" refers to the function of presenting application forms and information necessary for procedures created by the system to users via screens, printed materials, etc.

[0012] "A means of notifying users about set deadlines and prompting them to take action" refers to a function that manages deadlines for applications and sends reminder notifications to users as the deadline approaches, prompting them to take the necessary action.

[0013] "Natural language processing technology" refers to the technology that enables computers to understand and generate human language, and is used to appropriately analyze input information from users.

[0014] "Means for providing audio guidance" refers to a function that uses speakers or other sound devices to provide audio guidance to users to assist them in progressing through procedures. [Brief explanation of the drawing]

[0015] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Embodiment 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Embodiment 2 when combined with an emotion engine. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when combined with an emotion engine.

Mode for Carrying Out the Invention

[0016] Hereinafter, an example of an embodiment of the system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include CPU (Central Processing Unit), GPU (Graphics Processing Unit), GPGPU (General-Purpose computing on Graphics Processing Units), APU (Accelerated Processing Unit), and the like.

[0019] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0020] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0021] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0023] [First Embodiment]

[0024] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0025] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0028] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0031] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0035] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0036] The system according to the present invention enables users to easily and efficiently carry out application procedures with local governments. This system mainly consists of a server, a terminal, and user interaction.

[0037] Data collection and management

[0038] The server collects procedural information from each local government and stores it in a unified database. This data is regularly updated to ensure it is up-to-date via scraping technology and APIs. It also receives data directly from partner local governments. This allows for the integration of different application formats and required document information from each local government.

[0039] Input data reception and analysis

[0040] The terminal receives the necessary information from the user. The user enters the type of application they wish to submit, personal information, etc. The terminal allows input in multiple languages ​​and also supports voice input. The entered information is checked for correct format and content.

[0041] Generation and provision of application documents

[0042] The server analyzes the received user information using natural language processing technology and generates appropriate application forms. In this process, a generation AI is used to retrieve necessary procedural information from the database and automatically fills in each field based on the user's input data. The generated application form is then sent to the terminal.

[0043] User Support

[0044] The terminal displays the generated application documents on the screen and provides voice guidance explaining the next procedural steps. This allows users to easily confirm all the information necessary for the procedure.

[0045] Reminder function

[0046] The device recognizes the set application deadline in advance and issues a reminder as the deadline approaches. This notification helps users prevent delays in the process.

[0047] Specific example

[0048] For example, when a user needs to submit a change of address notification due to moving to a new address, they search for "moving notification" on the terminal and enter details of their current and new addresses. The server uses this information to create a change of address notification according to the new municipality's format and adds any necessary supporting documents. The terminal then provides voice guidance saying, "Please submit this document to the municipality of your new address," and sends a reminder notification two days before the submission deadline. This entire process allows users to complete their application to the municipality simply and accurately.

[0049] The following describes the processing flow.

[0050] Step 1:

[0051] The server scrapes procedural information from each local government's official website and retrieves data via API to collect application forms and required documents. This data is stored in a unified database and updated regularly.

[0052] Step 2:

[0053] Users enter information for the application process via their terminal. Multilingual and voice input are available to enhance user convenience. Furthermore, the entered information is automatically formatted, and the user is notified if any information is missing.

[0054] Step 3:

[0055] The terminal formats the information received from the user and then sends the data to the server. This information transmission allows the server to perform more precise data processing.

[0056] Step 4:

[0057] The server analyzes the received user information and selects the corresponding application form from the database. Using natural language processing technology, it selects the application form that best suits the user's needs.

[0058] Step 5:

[0059] The server automatically generates application documents using AI based on the selected application format. Required fields are automatically filled in based on the user's information, resulting in the creation of accurate documents.

[0060] Step 6:

[0061] The server sends the generated application documents to the terminal, which then presents them to the user. The user can review the documents on the screen, and an audio guide leads them through the next procedural step.

[0062] Step 7:

[0063] The device sets reminders based on the application deadline. As the deadline approaches, it sends a notification to the user, prompting them to take action to prevent delays in the process.

[0064] This entire process allows users to complete their applications to local governments efficiently and accurately.

[0065] (Example 1)

[0066] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0067] In modern times, the application process for various administrative procedures is complex, and the format and required documents differ from one municipality to another, causing users to spend a great deal of time and effort on these procedures. This problem also requires support for diverse languages ​​and application formats, and managing application deadlines is a burden for users. Therefore, there is a need for a system that allows for more efficient and convenient processing of these procedures.

[0068] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0069] In this invention, the server includes means for receiving information from the user and verifying the format of the input data, means for acquiring information on various procedures from various information sources and updating the information storage device, and means for automatically generating procedural documents based on the received input data and filling in the necessary items. This enables the user to efficiently process complex procedures.

[0070] "Information" refers to various types of data and facts that have been collected and organized for a specific purpose.

[0071] An "information storage device" refers to a physical or virtual device that stores collected data and allows for quick access and updating as needed.

[0072] "User" refers to an individual or organization that uses the system to apply for administrative procedures.

[0073] "Format" refers to the structure and arrangement of data or documents, meaning they are organized according to specific rules and standards.

[0074] "Means" refers to the methods or processes used to achieve a specific objective.

[0075] A "server" refers to a computer system that provides services on a network in response to client requests.

[0076] A "generative AI model" refers to a mathematical model that uses artificial intelligence to automatically analyze data and generate knowledge and information.

[0077] The system according to this invention has a configuration that enables users to efficiently and easily carry out application procedures with local governments. The main components of the system are a server, a terminal, and a user interface.

[0078] The server uses scraping techniques and APIs to retrieve information about various procedures from the internet and stores it in a standardized format on an information storage device. This process uses software scripts to update the information on a regular schedule. Furthermore, the server utilizes a generative AI model to automatically generate the necessary procedural documents based on user input data. Natural language processing techniques are used to fill in each field of the document based on the input data.

[0079] Meanwhile, the terminal receives the necessary information from the user and supports multilingual and voice input. The received data is checked in real time for format and content validity, and the user is prompted to make corrections as needed. The terminal displays the generated application documents and guides the user through the next procedural step with voice and on-screen instructions. Furthermore, the terminal monitors the application deadline and provides reminders to the user as needed.

[0080] As a concrete example, if a user applies for a change of address notification due to moving, the process would be as follows: The user enters "moving notification" into the terminal and enters their current and new addresses according to the voice guidance. The generating AI model uses this data to create a change of address notification for the local government, and the terminal provides voice guidance saying, "Please submit this document to the local government of your new address," and sends a reminder to the computer or smartphone before the deadline.

[0081] An example of a prompt message to be input into the generation AI model would be, "Please enter the information to automatically generate the application form for a change of address due to moving to a new address."

[0082] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0083] Step 1:

[0084] The server collects procedural information from each local government using scraping techniques and APIs. The server converts the collected data into a standardized format and stores it in an information storage device. Specifically, the server executes a script at a fixed time each day to retrieve procedural information from websites and provided APIs. The input is data from external web pages and APIs, and the output is information in a standardized format registered in the database.

[0085] Step 2:

[0086] Users enter the necessary information for their application using a terminal. The terminal accepts multilingual and voice input and checks the format validity of the input data in real time. Users can enter their name and address in the input form or use voice input. The input is user-provided data, and its accuracy is verified through internal processing of the terminal. The output is verified user data.

[0087] Step 3:

[0088] The server uses a generative AI model and natural language processing technology to analyze user input data and automatically generate the necessary application documents. The server receives verified data from the user and uses it as prompts to input into the generative AI model, which then automatically fills in each field of the document. In this step, the input is verified data from the user, and the output is the automatically generated application document.

[0089] Step 4:

[0090] The terminal presents the generated application documents to the user. Furthermore, it guides the user through the next procedural step via voice guidance. The generated documents are displayed on the terminal screen, and voice instructions such as "Please submit this document to XX" are played. The input is the application documents sent from the server, and the output is the provision of visual and auditory information to the user.

[0091] Step 5:

[0092] The device manages application deadlines and provides reminders to the user as needed. The device integrates with the calendar function and notifies the user two days before the deadline via pop-up notifications or email. The input in this step is pre-set deadline information, and the output is a notification message to the user.

[0093] (Application Example 1)

[0094] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0095] The application process to local governments is complex and cumbersome, making it difficult for many users to complete it accurately and quickly. Furthermore, including electronic payment procedures presents an even greater challenge in efficiently managing the entire process.

[0096] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0097] In this invention, the server includes means for receiving information from users and verifying the format of input data, means for collecting information related to various procedures and updating the information database, and means for automatically generating an application medium based on the received input data and filling in the appropriate fields. This enables users to easily and accurately complete application procedures and smoothly complete electronic payments.

[0098] "Information" refers to data received from users and various other data necessary for procedures, which are used to streamline the application process.

[0099] An "information repository" refers to a database that stores collected information and updates procedural information.

[0100] "Medium" refers to application documents and papers generated based on the input data received.

[0101] "Electronic payment" refers to the act of paying application fees online.

[0102] The system that realizes this invention is designed to efficiently handle electronic application procedures and electronic payments. The server collects procedural information from local governments and related organizations via APIs and stores it in an information repository. This information is updated regularly to maintain the latest procedural information.

[0103] The user uses a terminal to input the necessary information for the procedure. The terminal has the capability to accept information via voice input or text input and to verify its format. In this process, the terminal uses natural language processing technology (e.g., Google® Cloud Natural Language API or SpaCy) to analyze the input data and identify the application procedure the user intends to perform.

[0104] The server automatically generates application forms using a generative AI model based on user input data. These forms are provided to the user, including information for electronic payment if necessary. This system enables users to complete procedures quickly and accurately.

[0105] Furthermore, the device provides reminders for set deadlines to prevent users from forgetting procedures. It also utilizes voice guidance tailored to the purpose to help users easily understand the next steps.

[0106] As a concrete example, if a user voice-inputs "I want to pay my local taxes," the system will generate the application form required for tax payment and send a deadline reminder two days in advance. An example of a prompt message to the generating AI model is, "Please generate a tax payment application form. User information is name, address, tax identification number, and deadline is the deadline date."

[0107] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0108] Step 1:

[0109] The user enters the necessary information for the procedure into the terminal. The terminal accepts input via voice or text. The input information is checked for formatting correctness, and if it is voice input, it is converted to text format using the Google Cloud Natural Language API. The input is the procedure content intended by the user, and the output is the parsed procedure information.

[0110] Step 2:

[0111] The terminal sends the analyzed procedure information to the server for database retrieval. The output is a list of necessary information and requested items according to the type of procedure. The server retrieves the relevant procedure information from its database.

[0112] Step 3:

[0113] The server references user input data based on its information repository and automatically generates application materials using a generation AI model (e.g., GPT-3®). During this process, it generates prompt text from the information. The output is a semi-finished application material.

[0114] Step 4:

[0115] The server sends the generated application form to the terminal. The terminal displays the document to the user and provides supplementary information necessary for the procedure (e.g., submission destination and deadline). The output is an application form awaiting user confirmation.

[0116] Step 5:

[0117] The user reviews the application form on their terminal and makes any necessary corrections. If any corrections are made, they are sent back to the server from the terminal. This process ensures that the user's procedure information is updated before output.

[0118] Step 6:

[0119] The device will issue reminder notifications based on the set application deadline. Users will receive information about the deadline via voice guidance or pop-up notifications. The output of this step serves as a notification to help users ensure that the procedure is completed on time.

[0120] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0121] The system according to the present invention incorporates an emotion engine to efficiently and effectively support application procedures to local governments. This system provides a function that takes into account the user's emotional state when automatically generating application documents based on user input information.

[0122] Data collection and management

[0123] The server continues to collect relevant information from each local government and update the database as before. Data such as application forms and required documents, which differ from one local government to another, are integrated into this database.

[0124] Input data reception and analysis

[0125] Users input the necessary data for the application process through a terminal. The terminal verifies the accuracy and completeness of the input information and also supports voice input and multilingual input. The system is designed to enhance user convenience.

[0126] Utilizing the Emotion Engine

[0127] The server integrates an emotion engine that analyzes the user's emotional state based on user input and voice data. This information is used to adapt the interface tone and responses to improve the user experience. It also provides the necessary interactions to alleviate the stress and anxiety the user is experiencing.

[0128] Generation and provision of application documents

[0129] The server uses natural language processing technology to automatically generate appropriate application documents based on the information received. The generation AI automatically fills in each field and provides the requested document to the user via the terminal.

[0130] User support and reminder features

[0131] The terminal displays the generated application documents to the user and provides detailed instructions on the next steps via voice guidance. Furthermore, it automatically sets reminders according to the application deadline, notifying the user to take necessary actions in a timely manner.

[0132] Specific example

[0133] For example, when a user is going through the procedures required for moving, they enter the necessary information along with their new address into the terminal. If the emotion engine detects that the user is experiencing stress based on their tone of voice and typing speed, the server will use a calm voice guide to reassure the user. Application documents are automatically generated by the server and presented through the terminal. The user can confirm the necessary information and ensure that they complete all necessary actions by the deadline through the reminder function. Through this entire process, the user can complete the application while receiving emotional support.

[0134] The following describes the processing flow.

[0135] Step 1:

[0136] The server collects the latest procedural information issued by each local government using web scraping and APIs, and stores this data in a unified database. This data includes application form formats and required document information.

[0137] Step 2:

[0138] The user enters information through the terminal's interface to begin the application process. Voice input is also available, and the terminal checks the accuracy and completeness of the entered information.

[0139] Step 3:

[0140] The device sends input information obtained from the user to the server. At the same time, it also generates a profile that reflects the user's language settings and emotional state.

[0141] Step 4:

[0142] The server uses an emotion engine to analyze the user's emotional state from their input data and voice. Based on this analysis, the interface tone is adjusted.

[0143] Step 5:

[0144] The server uses natural language processing technology to analyze user information and select the appropriate application documents. It then uses generative AI to automatically generate the application form and fill in the necessary information. This document is sent to the user's terminal for their use.

[0145] Step 6:

[0146] The terminal displays the generated application form to the user and guides them through the next procedural steps via voice guidance. This voice guidance is tailored to the user's emotional state.

[0147] Step 7:

[0148] The device sets reminders based on application deadline information and notifies the user of this information. Users can use the reminders from the device to take the necessary actions before the deadline.

[0149] This entire process allows users to complete their applications to local governments efficiently and with emotional support.

[0150] (Example 2)

[0151] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0152] In modern society, the application process to local governments is a complicated and time-consuming task. Accurately gathering the information users need and creating the required documents accurately and quickly is difficult. Furthermore, services often fail to consider the emotional state of users, making it difficult to alleviate the stress and anxiety that arises during the process. There is a need to solve these problems and build a user-friendly application support system.

[0153] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0154] In this invention, the server includes means for receiving information from the user and verifying the format of the input data, means for collecting information on various procedures and updating the information set, and means for analyzing the user's emotional state and adjusting the tone of the interface. This enables the user to easily create application documents and perform stress-free procedures while receiving emotional support.

[0155] A "user" refers to an individual or organization that uses the system to carry out application procedures with a local government.

[0156] "Input data" refers to the information that users provide to the system for the application process.

[0157] "Means of verifying format" refers to the process of checking the format and presence of necessary items in order to guarantee the accuracy and completeness of the input data.

[0158] An "information aggregate" is a database in which procedural information for each local government is collected, organized, and stored.

[0159] "Emotional state" refers to the user's psychological state, and is the emotion analyzed from factors such as voice and input speed.

[0160] An "interface" refers to the user environment, such as screens and audio guides, that allows users to interact with a system.

[0161] "Methods for adjusting tone" refer to the process of changing the design of responses and interfaces to match the user's emotions.

[0162] "Application documents" refer to the documents or digital documents that users are required to submit to the local government.

[0163] "Stress-free" refers to a state in which the stress and anxiety that users experience during the application process are reduced.

[0164] The system according to the present invention is designed to facilitate application procedures to local governments for users. This section describes the main components of the system and the technologies for implementing them.

[0165] The server plays a central role, collecting necessary application documents and procedural information from official sources of each local government via the internet, and updating the database as a collection of information. Because the consistency and timeliness of the information are important, the server is equipped with an automatic crawling function.

[0166] The terminal is a device that the user directly operates and is responsible for receiving the entered data. The terminal's software has a voice recognition function, enabling voice input. It also checks the format of the entered data and corrects errors as needed.

[0167] Furthermore, the server is equipped with an emotion engine. It analyzes the user's voice tone and input speed to understand the user's emotional state. Based on this information, it adjusts the interface tone and content to ensure the user can continue using it comfortably.

[0168] The server uses a generation AI model to automatically generate application documents based on the received data, fills in the appropriate fields, and provides them to the user's device. Users can view these documents on their device and make corrections if necessary.

[0169] As a concrete example, when a user is changing their address due to moving, they enter their new address and related information into the terminal. If the emotion engine detects the user's stress during this process, the server adjusts its response tone to provide reassurance. An example of a prompt message would be: "I will now enter the information required for the moving process. Please tell me my new address and the necessary documents. Also, please provide support that takes into account my stressful situation."

[0170] In this way, users can complete the application process smoothly and securely through the server and their terminal.

[0171] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0172] Step 1:

[0173] The user enters the necessary data for the application process through the terminal. Input can be in text or voice format, and the terminal uses speech recognition to convert voice to text. At this stage, the terminal checks whether the input data includes all required fields and verifies its format. If there are errors in the data, the terminal displays a message prompting the user to correct them.

[0174] Step 2:

[0175] The server analyzes the input data received from the terminal. Natural language processing techniques are used for the analysis, particularly to evaluate the consistency and accuracy of data related to address changes and personal information. This process allows the server to obtain an acceptable dataset that encompasses all necessary information.

[0176] Step 3:

[0177] Based on the user's voice and input, an emotion engine installed on the server analyzes the user's emotional state. It extracts indicators of stress and anxiety from factors such as voice tone and input speed, and determines whether the interface tone and response methods should be adjusted accordingly. This result is used to improve the user experience, for example, by selecting voice guides designed to promote relaxation.

[0178] Step 4:

[0179] The server utilizes a generative AI model to automatically generate application documents based on the analyzed dataset. To ensure that each field is accurately filled in, it uses corresponding templates. The generated documents are sent to the user's terminal in a format that allows for viewing and editing. The output documents can be reviewed immediately.

[0180] Step 5:

[0181] The terminal displays the generated application documents to the user and guides them through the next steps using voice guidance. This guidance includes information on where to submit the application documents and what items to bring. In addition, it can provide additional information to reassure users by addressing points that they may be unsure about as they proceed with the procedure.

[0182] Step 6:

[0183] The server tracks the deadline for the application process and sends that data to the device. Based on this information, the device sets up alarms and pop-up notifications to encourage users to take the necessary actions within the deadline. These reminders are pre-configured and notify users at the appropriate time.

[0184] Through these steps, users will be able to complete the application process to the local government smoothly while receiving emotional support.

[0185] (Application Example 2)

[0186] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0187] Traditional electronic payment services often resulted in an unpleasant user experience because they proceeded with transactions without considering the user's emotions or stress levels. Furthermore, limited means of mitigating user confusion and anxiety during the payment process meant that smooth transactions could not be guaranteed.

[0188] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0189] In this invention, the server includes means for verifying the format of user input data, means for collecting information on various procedures and updating a database, and means for analyzing the user's emotional state and adjusting the payment flow. This makes it possible to provide a comfortable and smooth electronic payment process that takes emotional state into consideration.

[0190] "Information from users" refers to personal data and transaction-related information entered by users through electronic systems.

[0191] "Means of checking format" refers to a function that checks whether the input data conforms to a predetermined standard or format.

[0192] "Information regarding various procedures" refers to the data and information necessary for various applications, contracts, and payments related to administrative and commercial transactions.

[0193] "Means of updating a database" refers to the process of collecting new information and reflecting additions or changes to existing datasets.

[0194] "A means of automatically generating application documents and filling in the appropriate fields" refers to a function that creates administrative documents based on received data and automatically inserts the necessary information.

[0195] "Means for providing generated documents and related information to users" refers to methods of displaying or transmitting automatically generated documents and their associated data to users in a format that is viewable and usable.

[0196] "Means of notifying users about deadlines and prompting them to take action" refers to a system that informs users of the necessary actions by a specified date and encourages them to take action.

[0197] "Means of analyzing the user's emotional state and adjusting the payment flow" refers to a function that analyzes the user's emotions and dynamically changes the payment procedure and interface in order to reduce the user's psychological burden and anxiety.

[0198] "Natural language processing technologies and machine learning models" are artificial intelligence technologies used to interpret human language and perform data processing and predictive analysis.

[0199] "Voice guidance and visual interfaces" refer to features that support users in performing operations and navigation through voice instructions and on-screen displays.

[0200] An embodiment of this invention is a system that enables users to perform payment procedures securely using electronic devices. The system mainly consists of a server and a user terminal.

[0201] The server performs multiple roles. First, it receives information provided by users and verifies that the format is correct. At this stage, it performs real-time data verification to prevent input errors and inaccurate data.

[0202] Next, the server continuously collects information related to various procedures and stores and updates this data in a database. This allows the server to maintain up-to-date procedure information and guide users to the appropriate procedures.

[0203] Furthermore, by using natural language processing technology and machine learning models, the server analyzes the user's emotional state. Based on this analysis, if the user is experiencing stress, adjustments are made to optimize the payment flow. Specifically, the interface design and voice guidance are adjusted to improve the user experience.

[0204] The user's device displays the generated application documents. After the user reviews the information, voice guidance and a visual interface are provided to facilitate the payment process. The device also notifies the user of any deadlines and prompts them to take necessary action.

[0205] For example, when a user purchases an expensive item online, if sentiment analysis detects anxiety, the server will guide them through the payment process with calming voice prompts. As a result, the user can complete the transaction with peace of mind.

[0206] An example of a prompt to input into the generation AI model might be: "The user has recently been purchasing expensive items and may be experiencing stress, so please generate an appropriate support message on the payment screen."

[0207] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0208] Step 1:

[0209] The server checks the format of the input information received from the user's terminal. This input may include user data such as address and payment information. The server uses regular expressions to validate the data format, and if the format is correct, it proceeds to the next step. If it is incorrect, it returns an error message to the terminal.

[0210] Step 2:

[0211] The server performs sentiment analysis based on user input data. Input includes user voice data and input speed, and a machine learning model is used to analyze this data. The output is defined as the emotional state resulting from the analysis, and this is used to adjust the interface.

[0212] Step 3:

[0213] The server automatically generates application documents using natural language processing technology. The input is normalized data provided by the user, which is combined with a document template to fill in the necessary fields. The output is the generated document, which is then sent to the terminal.

[0214] Step 4:

[0215] The terminal provides the user with a visual interface and audio guidance based on the generated document and sentiment analysis results. Inputs include data sent from the server and sentiment analysis results, while output displays a customized guide for the user.

[0216] Step 5:

[0217] The server sends reminder notifications to users based on the set deadlines. Inputs include the procedure deadline and the user's schedule; based on this information, a notification is sent to the user's device. The output is a notification message sent to the device.

[0218] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0219] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0220] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0221] [Second Embodiment]

[0222] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0223] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0224] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0225] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0226] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0227] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0228] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0229] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0230] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0231] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0232] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0233] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0234] The system according to the present invention enables users to easily and efficiently carry out application procedures with local governments. This system mainly consists of a server, a terminal, and user interaction.

[0235] Data collection and management

[0236] The server collects procedural information from each local government and stores it in a unified database. This data is regularly updated to ensure it is up-to-date via scraping technology and APIs. It also receives data directly from partner local governments. This allows for the integration of different application formats and required document information from each local government.

[0237] Input data reception and analysis

[0238] The terminal receives the necessary information from the user. The user enters the type of application they wish to submit, personal information, etc. The terminal allows input in multiple languages ​​and also supports voice input. The entered information is checked for correct format and content.

[0239] Generation and provision of application documents

[0240] The server analyzes the received user information using natural language processing technology and generates appropriate application forms. In this process, a generation AI is used to retrieve necessary procedural information from the database and automatically fills in each field based on the user's input data. The generated application form is then sent to the terminal.

[0241] User Support

[0242] The terminal displays the generated application documents on the screen and provides voice guidance explaining the next steps in the procedure. This allows users to easily confirm all the information necessary for the procedure.

[0243] Reminder function

[0244] The device recognizes the set application deadline in advance and issues a reminder as the deadline approaches. This notification helps users prevent delays in the process.

[0245] Specific example

[0246] For example, when a user needs to submit a change of address notification due to moving to a new address, they search for "moving notification" on the terminal and enter details of their current and new addresses. The server uses this information to create a change of address notification according to the new municipality's format and adds any necessary supporting documents. The terminal then provides voice guidance saying, "Please submit this document to the municipality of your new address," and sends a reminder notification two days before the submission deadline. This entire process allows users to complete their application to the municipality simply and accurately.

[0247] The following describes the processing flow.

[0248] Step 1:

[0249] The server scrapes procedural information from each local government's official website and retrieves data via API to collect application forms and required documents. This data is stored in a unified database and updated regularly.

[0250] Step 2:

[0251] Users enter information for the application process via their terminal. Multilingual and voice input are available to enhance user convenience. Furthermore, the entered information is automatically formatted, and the user is notified if any information is missing.

[0252] Step 3:

[0253] The terminal formats the information received from the user and then sends the data to the server. This information transmission allows the server to perform more precise data processing.

[0254] Step 4:

[0255] The server analyzes the received user information and selects the corresponding application form from the database. Using natural language processing technology, it selects the application form that best suits the user's needs.

[0256] Step 5:

[0257] The server automatically generates application documents using AI based on the selected application format. Required fields are automatically filled in based on the user's information, resulting in the creation of accurate documents.

[0258] Step 6:

[0259] The server sends the generated application documents to the terminal, which then presents them to the user. The user can review the documents on the screen, and an audio guide leads them through the next procedural step.

[0260] Step 7:

[0261] The device sets reminders based on the application deadline. As the deadline approaches, it sends a notification to the user, prompting them to take action to prevent delays in the process.

[0262] This entire process allows users to complete their applications to local governments efficiently and accurately.

[0263] (Example 1)

[0264] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0265] In modern times, application processes for various administrative procedures are complex, and the format and required documents differ from one municipality to another, causing users to spend a great deal of time and effort on these procedures. This problem also requires support for diverse languages ​​and application formats, and managing application deadlines is a burden for users. Therefore, there is a need for a system that allows for more efficient and convenient processing of these procedures.

[0266] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0267] In this invention, the server includes means for receiving information from the user and verifying the format of the input data, means for acquiring information on various procedures from various information sources and updating the information storage device, and means for automatically generating procedural documents based on the received input data and filling in the necessary items. This enables the user to efficiently process complex procedures.

[0268] "Information" refers to various types of data and facts that have been collected and organized for a specific purpose.

[0269] An "information storage device" refers to a physical or virtual device that stores collected data and allows for quick access and updating as needed.

[0270] "User" refers to an individual or organization that uses the system to apply for administrative procedures.

[0271] "Format" refers to the structure and arrangement of data or documents, meaning they are organized according to specific rules and standards.

[0272] "Means" refers to the methods or processes used to achieve a specific objective.

[0273] A "server" refers to a computer system that provides services on a network in response to client requests.

[0274] A "generative AI model" refers to a mathematical model that uses artificial intelligence to automatically analyze data and generate knowledge and information.

[0275] The system according to this invention has a configuration that enables users to efficiently and easily carry out application procedures with local governments. The main components of the system are a server, a terminal, and a user interface.

[0276] The server uses scraping techniques and APIs to retrieve information about various procedures from the internet and stores it in a standardized format on an information storage device. This process uses software scripts to update the information on a regular schedule. Furthermore, the server utilizes a generative AI model to automatically generate the necessary procedural documents based on user input data. Natural language processing techniques are used to fill in each field of the document based on the input data.

[0277] Meanwhile, the terminal receives the necessary information from the user and supports multilingual and voice input. The received data is checked in real time for format and content validity, and the user is prompted to make corrections as needed. The terminal displays the generated application documents and guides the user through the next procedural step with voice and on-screen instructions. Furthermore, the terminal monitors the application deadline and provides reminders to the user as needed.

[0278] As a concrete example, if a user applies for a change of address notification due to moving, the process would be as follows: The user enters "moving notification" into the terminal and enters their current and new addresses according to the voice guidance. The generating AI model uses this data to create a change of address notification for the local government, and the terminal provides voice guidance saying, "Please submit this document to the local government of your new address," and sends a reminder to the computer or smartphone before the deadline.

[0279] An example of a prompt message to be input into the generation AI model would be, "Please enter the information to automatically generate the application form for a change of address due to moving to a new address."

[0280] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0281] Step 1:

[0282] The server collects the procedure information of each local government using scraping technology and APIs. The server converts the collected data into a unified format and stores it in the information storage device. As a specific operation, the server executes a script at a fixed time every day to obtain procedure information from websites and provided APIs. The input is data from external web pages or APIs, and the output is information in a unified format registered in the database.

[0283] Step 2:

[0284] The user inputs the information required for the application using the terminal. The terminal accepts multilingual and voice inputs and checks the validity of the input data in real time. The input form can be filled with a name and address, or voice input can be used. The input is the data provided by the user, and the accuracy of this data is confirmed in the internal processing of the terminal. The output is the verified user data.

[0285] Step 3:

[0286] The server analyzes the user's input data using a generative AI model and natural language processing technology and automatically generates the documents required for the application. The server receives the verified data from the user, inputs it into the generative AI model as a prompt, and automatically fills in each field of the document. In this step, the input is the verified data of the user, and the output is the automatically generated application documents.

[0287] Step 4:

[0288] The terminal presents the generated application documents to the user. Furthermore, it guides the user through the next procedure steps via voice guidance. The generated documents are displayed on the terminal screen, and instructions such as "Please submit this document to ○○" are played by voice. The input is the application documents sent from the server, and the output is the visual and auditory information provided to the user.

[0289] Step 5:

[0290] The device manages application deadlines and provides reminders to the user as needed. The device integrates with the calendar function and notifies the user two days before the deadline via pop-up notifications or email. The input in this step is pre-set deadline information, and the output is a notification message to the user.

[0291] (Application Example 1)

[0292] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0293] The application process to local governments is complex and cumbersome, making it difficult for many users to complete it accurately and quickly. Furthermore, including electronic payment procedures presents an even greater challenge in efficiently managing the entire process.

[0294] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0295] In this invention, the server includes means for receiving information from users and verifying the format of input data, means for collecting information related to various procedures and updating the information database, and means for automatically generating an application medium based on the received input data and filling in the appropriate fields. This enables users to easily and accurately complete application procedures and smoothly complete electronic payments.

[0296] "Information" refers to data received from users and various other data necessary for procedures, which are used to streamline the application process.

[0297] An "information repository" refers to a database that stores collected information and updates procedural information.

[0298] "Medium" refers to application documents and papers generated based on the input data received.

[0299] "Electronic payment" refers to the act of paying application fees online.

[0300] The system that realizes this invention is designed to efficiently handle electronic application procedures and electronic payments. The server collects procedural information from local governments and related organizations via APIs and stores it in an information repository. This information is updated regularly to maintain the latest procedural information.

[0301] The user uses a terminal to input the necessary information for the procedure. The terminal has the capability to accept information via voice input or text input and to verify its format. In this process, the terminal uses natural language processing technology (e.g., Google Cloud Natural Language API or SpaCy) to analyze the input data and identify the application procedure the user intends to perform.

[0302] The server automatically generates application forms using a generative AI model based on user input data. These forms are provided to the user, including information for electronic payment if necessary. This system enables users to complete procedures quickly and accurately.

[0303] Furthermore, the device provides reminders for set deadlines to prevent users from forgetting procedures. It also utilizes voice guidance tailored to the purpose to help users easily understand the next steps.

[0304] As a concrete example, if a user voice-inputs "I want to pay my local taxes," the system will generate the application form required for tax payment and send a deadline reminder two days in advance. An example of a prompt message to the generating AI model is, "Please generate a tax payment application form. User information is name, address, tax identification number, and deadline is the deadline date."

[0305] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0306] Step 1:

[0307] The user inputs the information necessary for the procedure into the terminal. The terminal accepts input in voice or text. The input information is checked for correct format, and in the case of voice input, it is converted into text format using the Google Cloud Natural Language API. The content of the procedure intended by the user is obtained as input, and the analyzed procedure information is generated as output.

[0308] Step 2:

[0309] The terminal sends the analyzed procedure information to the server for database search. What is output here is a list of the necessary information and required items according to the type of procedure. The server retrieves the corresponding procedure information from the information database.

[0310] Step 3:

[0311] The server refers to the user's input data based on the information database and automatically generates the application medium using a generative AI model (e.g., GPT-3). At this time, a prompt sentence is generated from the information. As output, a semi-finished application medium is obtained.

[0312] Step 4:

[0313] The server sends the generated application medium to the terminal. The terminal displays the document to the user and provides supplementary information necessary for the procedure (e.g., submission destination and deadline). As output, an application medium waiting for the user's confirmation is obtained.

[0314] Step 5:

[0315] [[ID=*]]The user checks the application medium on the terminal and makes necessary corrections. If there are correction contents, they are sent to the server again from the terminal. In this process, the user's procedure information is output in an updated state.

[0316] Step 6:

[0317] The device will issue reminder notifications based on the set application deadline. Users will receive information about the deadline via voice guidance or pop-up notifications. The output of this step is a notification to help users ensure that they complete the procedure on time.

[0318] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0319] The system according to the present invention incorporates an emotion engine to efficiently and effectively support application procedures to local governments. This system provides a function that takes into account the user's emotional state when automatically generating application documents based on user input information.

[0320] Data collection and management

[0321] The server continues to collect relevant information from each local government and update the database as before. Data such as application forms and required documents, which differ from one local government to another, are integrated into this database.

[0322] Input data reception and analysis

[0323] Users input the necessary data for the application process through a terminal. The terminal verifies the accuracy and completeness of the input information and also supports voice input and multilingual input. The system is designed to enhance user convenience.

[0324] Utilizing the Emotion Engine

[0325] The server integrates an emotion engine that analyzes the user's emotional state based on user input and voice data. This information is used to adapt the interface tone and responses to improve the user experience. It also provides the necessary interactions to alleviate the stress and anxiety the user is experiencing.

[0326] Generation and provision of application documents

[0327] The server uses natural language processing technology to automatically generate appropriate application documents based on the information received. The generation AI automatically fills in each field and provides the requested document to the user via the terminal.

[0328] User support and reminder features

[0329] The terminal displays the generated application documents to the user and provides detailed instructions on the next steps via voice guidance. Furthermore, it automatically sets reminders according to the application deadline, notifying the user to take necessary actions in a timely manner.

[0330] Specific example

[0331] For example, when a user is going through the procedures required for moving, they enter the necessary information along with their new address into the terminal. If the emotion engine detects that the user is experiencing stress based on their tone of voice and typing speed, the server will use a calm voice guide to reassure the user. Application documents are automatically generated by the server and presented through the terminal. The user can confirm the necessary information and ensure that they complete all necessary actions by the deadline through the reminder function. Through this entire process, the user can complete the application while receiving emotional support.

[0332] The following describes the processing flow.

[0333] Step 1:

[0334] The server collects the latest procedural information issued by each local government using web scraping and APIs, and stores this data in a unified database. This data includes application form formats and required document information.

[0335] Step 2:

[0336] The user enters information through the terminal's interface to begin the application process. Voice input is also available, and the terminal checks the accuracy and completeness of the entered information.

[0337] Step 3:

[0338] The device sends input information obtained from the user to the server. At the same time, it also generates a profile that reflects the user's language settings and emotional state.

[0339] Step 4:

[0340] The server uses an emotion engine to analyze the user's emotional state from their input data and voice. Based on this analysis, the interface tone is adjusted.

[0341] Step 5:

[0342] The server uses natural language processing technology to analyze user information and select the appropriate application documents. It then uses generative AI to automatically generate the application form and fill in the necessary information. This document is then sent to the user's terminal for their use.

[0343] Step 6:

[0344] The terminal displays the generated application form to the user and guides them through the next procedural step via voice guidance. This voice guidance is tailored to the user's emotional state.

[0345] Step 7:

[0346] The device sets reminders based on application deadline information and notifies the user of this information. Users can use the reminders from the device to take the necessary actions before the deadline.

[0347] This entire process allows users to complete their applications to local governments efficiently and with emotional support.

[0348] (Example 2)

[0349] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0350] In modern society, the application process to local governments is a complicated and time-consuming task. Accurately gathering the information users need and creating the required documents accurately and quickly is difficult. Furthermore, services often fail to consider the emotional state of users, making it difficult to alleviate the stress and anxiety that arises during the process. There is a need to solve these problems and build a user-friendly application support system.

[0351] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0352] In this invention, the server includes means for receiving information from the user and verifying the format of the input data, means for collecting information on various procedures and updating the information set, and means for analyzing the user's emotional state and adjusting the tone of the interface. This enables the user to easily create application documents and perform stress-free procedures while receiving emotional support.

[0353] A "user" refers to an individual or organization that uses the system to carry out application procedures with a local government.

[0354] "Input data" refers to the information that users provide to the system for the application process.

[0355] "Means of verifying format" refers to the process of checking the format and presence of necessary items in order to guarantee the accuracy and completeness of the input data.

[0356] An "information aggregate" is a database in which procedural information for each local government is collected, organized, and stored.

[0357] "Emotional state" refers to the user's psychological state, and is the emotion analyzed from factors such as voice and input speed.

[0358] An "interface" refers to the user environment, such as screens and audio guides, that allows users to interact with a system.

[0359] "Methods for adjusting tone" refer to the process of changing the design of responses and interfaces to match the user's emotions.

[0360] "Application documents" refer to the documents or digital documents that users are required to submit to the local government.

[0361] "Stress-free" refers to a state in which the stress and anxiety that users experience during the application process are reduced.

[0362] The system according to the present invention is designed to facilitate application procedures to local governments for users. This section describes the main components of the system and the technologies for implementing them.

[0363] The server plays a central role, collecting necessary application documents and procedural information from official sources of each local government via the internet, and updating the database as a collection of information. Because the consistency and timeliness of the information are important, the server is equipped with an automatic crawling function.

[0364] The terminal is a device that the user directly operates and is responsible for receiving the entered data. The terminal's software has a voice recognition function, enabling voice input. It also checks the format of the entered data and corrects errors as needed.

[0365] Furthermore, the server is equipped with an emotion engine. It analyzes the user's voice tone and input speed to understand the user's emotional state. Based on this information, it adjusts the interface tone and content to ensure the user can continue using it comfortably.

[0366] The server uses a generation AI model to automatically generate application documents based on the received data, fills in the appropriate fields, and provides them to the user's terminal. Users can view these documents on their terminal and make corrections if necessary.

[0367] As a concrete example, when a user is changing their address due to moving, they enter their new address and related information into the terminal. If the emotion engine detects the user's stress during this process, the server adjusts its response tone to provide reassurance. An example of a prompt message would be: "I will now enter the information required for the moving process. Please tell me my new address and the necessary documents. Also, please provide support that takes into account my stressful situation."

[0368] In this way, users can complete the application process smoothly and securely through the server and their terminal.

[0369] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0370] Step 1:

[0371] The user enters the necessary data for the application process through the terminal. Input can be in text or voice format, and the terminal uses speech recognition to convert voice to text. At this stage, the terminal checks whether the input data includes all required fields and verifies its format. If there are errors in the data, the terminal displays a message prompting the user to correct them.

[0372] Step 2:

[0373] The server analyzes the input data received from the terminal. Natural language processing techniques are used for the analysis, particularly to evaluate the consistency and accuracy of data related to address changes and personal information. This process allows the server to obtain an acceptable dataset that encompasses all necessary information.

[0374] Step 3:

[0375] Based on the user's voice and input, an emotion engine installed on the server analyzes the user's emotional state. It extracts indicators of stress and anxiety from factors such as voice tone and input speed, and determines whether the interface tone and response methods should be adjusted accordingly. This result is used to improve the user experience, for example, by selecting voice guides designed to promote relaxation.

[0376] Step 4:

[0377] The server utilizes a generative AI model to automatically generate application documents based on the analyzed dataset. To ensure that each field is accurately filled in, it uses corresponding templates. The generated documents are sent to the user's terminal in a format that allows for viewing and editing. The output documents can be reviewed immediately.

[0378] Step 5:

[0379] The terminal displays the generated application documents to the user and guides them through the next steps using voice guidance. This guidance includes information on where to submit the application documents and what items to bring. In addition, it can provide additional information to reassure users by addressing points that they may be unsure about as they proceed with the procedure.

[0380] Step 6:

[0381] The server tracks the deadline for the application process and sends that data to the device. Based on this information, the device sets up alarms and pop-up notifications to encourage users to take the necessary actions within the deadline. These reminders are pre-configured and notify users at the appropriate time.

[0382] Through these steps, users will be able to complete the application process to the local government smoothly while receiving emotional support.

[0383] (Application Example 2)

[0384] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0385] Traditional electronic payment services often resulted in an unpleasant user experience because they proceeded with transactions without considering the user's emotions or stress levels. Furthermore, limited means of mitigating user confusion and anxiety during the payment process meant that smooth transactions could not be guaranteed.

[0386] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0387] In this invention, the server includes means for verifying the format of user input data, means for collecting information on various procedures and updating a database, and means for analyzing the user's emotional state and adjusting the payment flow. This makes it possible to provide a comfortable and smooth electronic payment process that takes emotional state into consideration.

[0388] "Information from users" refers to personal data and transaction-related information entered by users through electronic systems.

[0389] "Means of checking format" refers to a function that checks whether the input data conforms to a predetermined standard or format.

[0390] "Information regarding various procedures" refers to the data and information necessary for various applications, contracts, and payments related to administrative and commercial transactions.

[0391] "Means of updating a database" refers to the process of collecting new information and reflecting additions or changes to existing datasets.

[0392] "A means of automatically generating application documents and filling in the appropriate fields" refers to a function that creates administrative documents based on received data and automatically inserts the necessary information.

[0393] "Means for providing generated documents and related information to users" refers to methods of displaying or transmitting automatically generated documents and their associated data to users in a format that can be viewed and used.

[0394] "Means of notifying users about deadlines and prompting them to take action" refers to a system that informs users of the necessary actions by a specified date and encourages them to take action.

[0395] "Means of analyzing the user's emotional state and adjusting the payment flow" refers to a function that analyzes the user's emotions and dynamically changes the payment procedure and interface in order to reduce the user's psychological burden and anxiety.

[0396] "Natural language processing technologies and machine learning models" are artificial intelligence technologies used to interpret human language and perform data processing and predictive analysis.

[0397] "Voice guidance and visual interfaces" refer to features that support users in performing operations and navigation through voice instructions and on-screen displays.

[0398] An embodiment of this invention is a system that enables users to perform payment procedures securely using electronic devices. The system mainly consists of a server and a user terminal.

[0399] The server performs multiple roles. First, it receives information provided by users and verifies that the format is correct. At this stage, it performs real-time data verification to prevent input errors and inaccurate data.

[0400] Next, the server continuously collects information related to various procedures and stores and updates this data in a database. This allows the server to maintain up-to-date procedure information and guide users to the appropriate procedures.

[0401] Furthermore, by using natural language processing technology and machine learning models, the server analyzes the user's emotional state. Based on this analysis, if the user is experiencing stress, adjustments are made to optimize the payment flow. Specifically, the interface design and voice guidance are adjusted to improve the user experience.

[0402] The user's device displays the generated application documents. After the user reviews the information, voice guidance and a visual interface are provided to facilitate the payment process. The device also notifies the user of the set deadline and prompts them to take the necessary action.

[0403] For example, when a user purchases an expensive item online, if sentiment analysis detects anxiety, the server will guide them through the payment process with calming voice prompts. As a result, the user can complete the transaction with peace of mind.

[0404] An example of a prompt to input into the generation AI model might be: "The user has recently been purchasing expensive items and may be experiencing stress, so please generate an appropriate support message on the payment screen."

[0405] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0406] Step 1:

[0407] The server checks the format of the input information received from the user's terminal. This input may include user data such as address and payment information. The server uses regular expressions to validate the data format, and if the format is correct, it proceeds to the next step. If it is incorrect, it returns an error message to the terminal.

[0408] Step 2:

[0409] The server performs sentiment analysis based on user input data. Input includes user voice data and input speed, and a machine learning model is used to analyze this data. The output is defined as the emotional state resulting from the analysis, and this is used to adjust the interface.

[0410] Step 3:

[0411] The server automatically generates application documents using natural language processing technology. The input is normalized data provided by the user, which is combined with a document template to fill in the necessary fields. The output is the generated document, which is then sent to the terminal.

[0412] Step 4:

[0413] The terminal provides the user with a visual interface and audio guidance based on the generated document and the results of sentiment analysis. Inputs include data sent from the server and sentiment analysis results, while output displays a customized guide for the user.

[0414] Step 5:

[0415] The server sends reminder notifications to users based on the set deadlines. Inputs include the procedure deadline and the user's schedule; based on this information, a notification is sent to the user's device. The output is a notification message sent to the device.

[0416] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0417] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0418] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0419] [Third Embodiment]

[0420] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0421] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0422] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0423] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0424] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0425] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0426] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0427] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0428] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0429] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0430] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0431] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0432] The system according to the present invention enables users to easily and efficiently carry out application procedures with local governments. This system mainly consists of a server, a terminal, and user interaction.

[0433] Data collection and management

[0434] The server collects procedural information from each local government and stores it in a unified database. This data is regularly updated to ensure it is up-to-date via scraping technology and APIs. It also receives data directly from partner local governments. This allows for the integration of different application formats and required document information from each local government.

[0435] Input data reception and analysis

[0436] The terminal receives the necessary information from the user. The user enters the type of application they wish to submit, personal information, etc. The terminal allows input in multiple languages ​​and also supports voice input. The entered information is checked for correct format and content.

[0437] Generation and provision of application documents

[0438] The server analyzes the received user information using natural language processing technology and generates appropriate application forms. In this process, a generation AI is used to retrieve necessary procedural information from the database and automatically fills in each field based on the user's input data. The generated application form is then sent to the terminal.

[0439] User Support

[0440] The terminal displays the generated application documents on the screen and provides voice guidance explaining the next steps in the procedure. This allows users to easily confirm all the information necessary for the procedure.

[0441] Reminder function

[0442] The device recognizes the set application deadline in advance and issues a reminder as the deadline approaches. This notification helps users prevent delays in the process.

[0443] Specific example

[0444] For example, when a user needs to submit a change of address notification due to moving to a new address, they search for "moving notification" on the terminal and enter details of their current and new addresses. The server uses this information to create a change of address notification according to the new municipality's format and adds any necessary supporting documents. The terminal then provides voice guidance saying, "Please submit this document to the municipality of your new address," and sends a reminder notification two days before the submission deadline. This entire process allows users to complete their application to the municipality simply and accurately.

[0445] The following describes the processing flow.

[0446] Step 1:

[0447] The server scrapes procedural information from each local government's official website and retrieves data via API to collect application forms and required documents. This data is stored in a unified database and updated regularly.

[0448] Step 2:

[0449] Users enter information for the application process via their terminal. Multilingual and voice input are available to enhance user convenience. Furthermore, the entered information is automatically formatted, and the user is notified if any information is missing.

[0450] Step 3:

[0451] The terminal formats the information received from the user and then sends the data to the server. This information transmission allows the server to perform more precise data processing.

[0452] Step 4:

[0453] The server analyzes the received user information and selects the corresponding application form from the database. Using natural language processing technology, it selects the application form that best suits the user's needs.

[0454] Step 5:

[0455] The server automatically generates application documents using AI based on the selected application format. Required fields are automatically filled in based on the user's information, resulting in the creation of accurate documents.

[0456] Step 6:

[0457] The server sends the generated application documents to the terminal, which then presents them to the user. The user can review the documents on the screen, and an audio guide leads them through the next procedural step.

[0458] Step 7:

[0459] The device sets reminders based on the application deadline. As the deadline approaches, it sends a notification to the user, prompting them to take action to prevent delays in the process.

[0460] This entire process allows users to complete their applications to local governments efficiently and accurately.

[0461] (Example 1)

[0462] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0463] In modern times, application processes for various administrative procedures are complex, and the format and required documents differ from one municipality to another, causing users to spend a great deal of time and effort on these procedures. This problem also requires support for diverse languages ​​and application formats, and managing application deadlines is a burden for users. Therefore, there is a need for a system that allows for more efficient and convenient processing of these procedures.

[0464] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0465] In this invention, the server includes means for receiving information from the user and verifying the format of the input data, means for acquiring information on various procedures from various information sources and updating the information storage device, and means for automatically generating procedural documents based on the received input data and filling in the necessary items. This enables the user to efficiently process complex procedures.

[0466] "Information" refers to various types of data and facts that have been collected and organized for a specific purpose.

[0467] An "information storage device" refers to a physical or virtual device that stores collected data and allows for quick access and updating as needed.

[0468] "User" refers to an individual or organization that uses the system to apply for administrative procedures.

[0469] "Format" refers to the structure and arrangement of data or documents, meaning they are organized according to specific rules and standards.

[0470] "Means" refers to the methods or processes used to achieve a specific objective.

[0471] A "server" refers to a computer system that provides services on a network in response to client requests.

[0472] A "generative AI model" refers to a mathematical model that uses artificial intelligence to automatically analyze data and generate knowledge and information.

[0473] The system according to this invention has a configuration that enables users to efficiently and easily carry out application procedures with local governments. The main components of the system are a server, a terminal, and a user interface.

[0474] The server uses scraping techniques and APIs to retrieve information about various procedures from the internet and stores it in a standardized format on an information storage device. This process uses software scripts to update the information on a regular schedule. Furthermore, the server utilizes a generative AI model to automatically generate the necessary procedural documents based on user input data. Natural language processing techniques are used to fill in each field of the document based on the input data.

[0475] Meanwhile, the terminal receives the necessary information from the user and supports multilingual and voice input. The received data is checked in real time for format and content validity, and the user is prompted to make corrections as needed. The terminal displays the generated application documents and guides the user through the next procedural step with voice and on-screen instructions. Furthermore, the terminal monitors the application deadline and provides reminders to the user as needed.

[0476] As a concrete example, if a user applies for a change of address notification due to moving, the process would be as follows: The user enters "moving notification" into the terminal and enters their current and new addresses according to the voice guidance. The generating AI model uses this data to create a change of address notification for the local government, and the terminal provides voice guidance saying, "Please submit this document to the local government of your new address," and sends a reminder to the computer or smartphone before the deadline.

[0477] An example of a prompt message to be input into the generation AI model would be, "Please enter the information to automatically generate the application form for a change of address due to moving to a new address."

[0478] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0479] Step 1:

[0480] The server collects procedural information from each local government using scraping techniques and APIs. The server converts the collected data into a standardized format and stores it in an information storage device. Specifically, the server executes a script at a fixed time each day to retrieve procedural information from websites and provided APIs. The input is data from external web pages and APIs, and the output is information in a standardized format registered in the database.

[0481] Step 2:

[0482] Users enter the necessary information for their application using a terminal. The terminal accepts multilingual and voice input and checks the format validity of the input data in real time. Users can enter their name and address in the input form or use voice input. The input is user-provided data, and its accuracy is verified through internal processing of the terminal. The output is verified user data.

[0483] Step 3:

[0484] The server uses a generative AI model and natural language processing technology to analyze user input data and automatically generate the necessary application documents. The server receives verified data from the user and uses it as prompts to input into the generative AI model, which then automatically fills in each field of the document. In this step, the input is verified data from the user, and the output is the automatically generated application document.

[0485] Step 4:

[0486] The terminal presents the generated application documents to the user. Furthermore, it guides the user through the next procedural step via voice guidance. The generated documents are displayed on the terminal screen, and voice instructions such as "Please submit this document to XX" are played. The input is the application documents sent from the server, and the output is the provision of visual and auditory information to the user.

[0487] Step 5:

[0488] The device manages application deadlines and provides reminders to the user as needed. The device integrates with the calendar function and notifies the user two days before the deadline via pop-up notifications or email. The input in this step is pre-set deadline information, and the output is a notification message to the user.

[0489] (Application Example 1)

[0490] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0491] The application process to local governments is complex and cumbersome, making it difficult for many users to complete it accurately and quickly. Furthermore, including electronic payment procedures presents an even greater challenge in efficiently managing the entire process.

[0492] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0493] In this invention, the server includes means for receiving information from users and verifying the format of input data, means for collecting information related to various procedures and updating the information database, and means for automatically generating an application medium based on the received input data and filling in the appropriate fields. This enables users to easily and accurately complete application procedures and smoothly complete electronic payments.

[0494] "Information" refers to data received from users and various other data necessary for procedures, which are used to streamline the application process.

[0495] An "information repository" refers to a database that stores collected information and updates procedural information.

[0496] "Medium" refers to application documents and papers generated based on the input data received.

[0497] "Electronic payment" refers to the act of paying application fees online.

[0498] The system that realizes this invention is designed to efficiently handle electronic application procedures and electronic payments. The server collects procedural information from local governments and related organizations via APIs and stores it in an information repository. This information is updated regularly to maintain the latest procedural information.

[0499] The user uses a terminal to input the necessary information for the procedure. The terminal has the capability to accept information via voice input or text input and to verify its format. In this process, the terminal uses natural language processing technology (e.g., Google Cloud Natural Language API or SpaCy) to analyze the input data and identify the application procedure the user intends to perform.

[0500] The server automatically generates application forms using a generative AI model based on user input data. These forms are provided to the user, including information for electronic payment if necessary. This system enables users to complete procedures quickly and accurately.

[0501] Furthermore, the device provides reminders for set deadlines to prevent users from forgetting procedures. It also utilizes voice guidance tailored to the purpose to help users easily understand the next steps.

[0502] As a concrete example, if a user voice-inputs "I want to pay my local taxes," the system will generate the application form required for tax payment and send a deadline reminder two days in advance. An example of a prompt message to the generating AI model is, "Please generate a tax payment application form. User information is name, address, tax identification number, and deadline is the deadline date."

[0503] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0504] Step 1:

[0505] The user enters the necessary information for the procedure into the terminal. The terminal accepts input via voice or text. The input information is checked for formatting correctness, and if it is voice input, it is converted to text format using the Google Cloud Natural Language API. The input is the procedure content intended by the user, and the output is the parsed procedure information.

[0506] Step 2:

[0507] The terminal sends the analyzed procedure information to the server for database retrieval. The output is a list of necessary information and requested items according to the type of procedure. The server retrieves the relevant procedure information from its database.

[0508] Step 3:

[0509] The server references user input data based on its information repository and automatically generates application materials using a generation AI model (e.g., GPT-3). During this process, it generates prompt text from the information. The output is a partially completed application material.

[0510] Step 4:

[0511] The server sends the generated application form to the terminal. The terminal displays the document to the user and provides supplementary information necessary for the procedure (e.g., submission destination and deadline). The output is an application form awaiting user confirmation.

[0512] Step 5:

[0513] The user reviews the application form on their terminal and makes any necessary corrections. If any corrections are made, the form is sent back to the server from the terminal. This process ensures that the user's procedure information is updated before output.

[0514] Step 6:

[0515] The device will issue reminder notifications based on the set application deadline. Users will receive information about the deadline via voice guidance or pop-up notifications. The output of this step is a notification to help users ensure that they complete the procedure on time.

[0516] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0517] The system according to the present invention incorporates an emotion engine to efficiently and effectively support application procedures to local governments. This system provides a function that takes into account the user's emotional state when automatically generating application documents based on user input information.

[0518] Data collection and management

[0519] The server continues to collect relevant information from each local government and update the database as before. Data such as application forms and required documents, which differ from one local government to another, are integrated into this database.

[0520] Input data reception and analysis

[0521] Users input the necessary data for the application process through a terminal. The terminal verifies the accuracy and completeness of the input information and also supports voice input and multilingual input. The system is designed to enhance user convenience.

[0522] Utilizing the Emotion Engine

[0523] The server integrates an emotion engine that analyzes the user's emotional state based on user input and voice data. This information is used to adapt the interface tone and responses to improve the user experience. It also provides the necessary interactions to alleviate the stress and anxiety the user is experiencing.

[0524] Generation and provision of application documents

[0525] The server uses natural language processing technology to automatically generate appropriate application documents based on the information received. The generation AI automatically fills in each field and provides the requested document to the user via the terminal.

[0526] User support and reminder features

[0527] The terminal displays the generated application documents to the user and provides detailed instructions on the next steps via voice guidance. Furthermore, it automatically sets reminders according to the application deadline, notifying the user to take necessary actions in a timely manner.

[0528] Specific example

[0529] For example, when a user is going through the procedures required for moving, they enter the necessary information along with their new address into the terminal. If the emotion engine detects that the user is experiencing stress based on their tone of voice and typing speed, the server will use a calm voice guide to reassure the user. Application documents are automatically generated by the server and presented through the terminal. The user can confirm the necessary information and ensure that they complete all necessary actions by the deadline through the reminder function. Through this entire process, the user can complete the application while receiving emotional support.

[0530] The following describes the processing flow.

[0531] Step 1:

[0532] The server collects the latest procedural information issued by each local government using web scraping and APIs, and stores this data in a unified database. This data includes application form formats and required document information.

[0533] Step 2:

[0534] The user enters information through the terminal's interface to begin the application process. Voice input is also available, and the terminal checks the accuracy and completeness of the entered information.

[0535] Step 3:

[0536] The device sends input information obtained from the user to the server. At the same time, it also generates a profile that reflects the user's language settings and emotional state.

[0537] Step 4:

[0538] The server uses an emotion engine to analyze the user's emotional state from their input data and voice. Based on this analysis, the interface tone is adjusted.

[0539] Step 5:

[0540] The server uses natural language processing technology to analyze user information and select the appropriate application documents. It then uses generative AI to automatically generate the application form and fill in the necessary information. This document is then sent to the user's terminal for their use.

[0541] Step 6:

[0542] The terminal displays the generated application form to the user and guides them through the next procedural step via voice guidance. This voice guidance is tailored to the user's emotional state.

[0543] Step 7:

[0544] The device sets reminders based on application deadline information and notifies the user of this information. Users can use the reminders from the device to take the necessary actions before the deadline.

[0545] This entire process allows users to complete their applications to local governments efficiently and with emotional support.

[0546] (Example 2)

[0547] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0548] In modern society, the application process to local governments is a complicated and time-consuming task. Accurately gathering the information users need and creating the required documents accurately and quickly is difficult. Furthermore, services often fail to consider the emotional state of users, making it difficult to alleviate the stress and anxiety that arises during the process. There is a need to solve these problems and build a user-friendly application support system.

[0549] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0550] In this invention, the server includes means for receiving information from the user and verifying the format of the input data, means for collecting information on various procedures and updating the information set, and means for analyzing the user's emotional state and adjusting the tone of the interface. This enables the user to easily create application documents and perform stress-free procedures while receiving emotional support.

[0551] A "user" refers to an individual or organization that uses the system to carry out application procedures with a local government.

[0552] "Input data" refers to the information that users provide to the system for the application process.

[0553] "Means of verifying format" refers to the process of checking the format and presence of necessary items in order to guarantee the accuracy and completeness of the input data.

[0554] An "information aggregate" is a database in which procedural information for each local government is collected, organized, and stored.

[0555] "Emotional state" refers to the user's psychological state, and is the emotion analyzed from factors such as voice and input speed.

[0556] An "interface" refers to the user environment, such as screens and audio guides, that allows users to interact with a system.

[0557] "Methods for adjusting tone" refer to the process of changing the design of responses and interfaces to match the user's emotions.

[0558] "Application documents" refer to the documents or digital documents that users are required to submit to the local government.

[0559] "Stress-free" refers to a state in which the stress and anxiety that users experience during the application process are reduced.

[0560] The system according to the present invention is designed to facilitate application procedures to local governments for users. This section describes the main components of the system and the technologies for implementing them.

[0561] The server plays a central role, collecting necessary application documents and procedural information from official sources of each local government via the internet, and updating the database as a collection of information. Because the consistency and timeliness of the information are important, the server is equipped with an automatic crawling function.

[0562] The terminal is a device that the user directly operates and is responsible for receiving the entered data. The terminal's software has a voice recognition function, enabling voice input. It also checks the format of the entered data and corrects errors as needed.

[0563] Furthermore, the server is equipped with an emotion engine. It analyzes the user's voice tone and input speed to understand the user's emotional state. Based on this information, it adjusts the interface tone and content to ensure the user can continue using it comfortably.

[0564] The server uses a generation AI model to automatically generate application documents based on the received data, fills in the appropriate fields, and provides them to the user's terminal. Users can view these documents on their terminal and make corrections if necessary.

[0565] As a concrete example, when a user is changing their address due to moving, they enter their new address and related information into the terminal. If the emotion engine detects the user's stress during this process, the server adjusts its response tone to provide reassurance. An example of a prompt message would be: "I will now enter the information required for the moving process. Please tell me my new address and the necessary documents. Also, please provide support that takes into account my stressful situation."

[0566] In this way, users can complete the application process smoothly and securely through the server and their terminal.

[0567] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0568] Step 1:

[0569] The user enters the necessary data for the application process through the terminal. Input can be in text or voice format, and the terminal uses speech recognition to convert voice to text. At this stage, the terminal checks whether the input data includes all required fields and verifies its format. If there are errors in the data, the terminal displays a message prompting the user to correct them.

[0570] Step 2:

[0571] The server analyzes the input data received from the terminal. Natural language processing techniques are used for the analysis, particularly to evaluate the consistency and accuracy of data related to address changes and personal information. This process allows the server to obtain an acceptable dataset that encompasses all necessary information.

[0572] Step 3:

[0573] Based on the user's voice and input, an emotion engine installed on the server analyzes the user's emotional state. It extracts indicators of stress and anxiety from factors such as voice tone and input speed, and determines whether the interface tone and response methods should be adjusted accordingly. This result is used to improve the user experience, for example, by selecting voice guides designed to promote relaxation.

[0574] Step 4:

[0575] The server utilizes a generative AI model to automatically generate application documents based on the analyzed dataset. To ensure that each field is accurately filled in, it uses corresponding templates. The generated documents are sent to the user's terminal in a format that allows for viewing and editing. The output documents can be reviewed immediately.

[0576] Step 5:

[0577] The terminal displays the generated application documents to the user and guides them through the next steps using voice guidance. This guidance includes information on where to submit the application documents and what items to bring. In addition, it can provide additional information to reassure users by addressing points that they may be unsure about as they proceed with the procedure.

[0578] Step 6:

[0579] The server tracks the deadline for the application process and sends that data to the device. Based on this information, the device sets up alarms and pop-up notifications to encourage users to take the necessary actions within the deadline. These reminders are pre-configured and notify users at the appropriate time.

[0580] Through these steps, users will be able to complete the application process to the local government smoothly while receiving emotional support.

[0581] (Application Example 2)

[0582] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0583] Traditional electronic payment services often resulted in an unpleasant user experience because they proceeded with transactions without considering the user's emotions or stress levels. Furthermore, limited means of mitigating user confusion and anxiety during the payment process meant that smooth transactions could not be guaranteed.

[0584] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0585] In this invention, the server includes means for verifying the format of user input data, means for collecting information on various procedures and updating a database, and means for analyzing the user's emotional state and adjusting the payment flow. This makes it possible to provide a comfortable and smooth electronic payment process that takes emotional state into consideration.

[0586] "Information from users" refers to personal data and transaction-related information entered by users through electronic systems.

[0587] "Means of checking format" refers to a function that checks whether the input data conforms to a predetermined standard or format.

[0588] "Information regarding various procedures" refers to the data and information necessary for various applications, contracts, and payments related to administrative and commercial transactions.

[0589] "Means of updating a database" refers to the process of collecting new information and reflecting additions or changes to existing datasets.

[0590] "A means of automatically generating application documents and filling in the appropriate fields" refers to a function that creates administrative documents based on received data and automatically inserts the necessary information.

[0591] "Means for providing generated documents and related information to users" refers to methods of displaying or transmitting automatically generated documents and their associated data to users in a format that can be viewed and used.

[0592] "Means of notifying users about deadlines and prompting them to take action" refers to a system that informs users of the necessary actions by a specified date and encourages them to take action.

[0593] "Means of analyzing the user's emotional state and adjusting the payment flow" refers to a function that analyzes the user's emotions and dynamically changes the payment procedure and interface in order to reduce the user's psychological burden and anxiety.

[0594] "Natural language processing technologies and machine learning models" are artificial intelligence technologies used to interpret human language and perform data processing and predictive analysis.

[0595] "Voice guidance and visual interfaces" refer to features that support users in performing operations and navigation through voice instructions and on-screen displays.

[0596] An embodiment of this invention is a system that enables users to perform payment procedures securely using electronic devices. The system mainly consists of a server and a user terminal.

[0597] The server performs multiple roles. First, it receives information provided by users and verifies that the format is correct. At this stage, it performs real-time data verification to prevent input errors and inaccurate data.

[0598] Next, the server continuously collects information related to various procedures and stores and updates this data in a database. This allows the server to maintain up-to-date procedure information and guide users to the appropriate procedures.

[0599] Furthermore, by using natural language processing technology and machine learning models, the server analyzes the user's emotional state. Based on this analysis, if the user is experiencing stress, adjustments are made to optimize the payment flow. Specifically, the interface design and voice guidance are adjusted to improve the user experience.

[0600] The user's device displays the generated application documents. After the user reviews the information, voice guidance and a visual interface are provided to facilitate the payment process. The device also notifies the user of the set deadline and prompts them to take the necessary action.

[0601] For example, when a user purchases an expensive item online, if sentiment analysis detects anxiety, the server will guide them through the payment process with calming voice prompts. As a result, the user can complete the transaction with peace of mind.

[0602] An example of a prompt to input into the generation AI model might be: "The user has recently been purchasing expensive items and may be experiencing stress, so please generate an appropriate support message on the payment screen."

[0603] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0604] Step 1:

[0605] The server checks the format of the input information received from the user's terminal. This input may include user data such as address and payment information. The server uses regular expressions to validate the data format, and if the format is correct, it proceeds to the next step. If it is incorrect, it returns an error message to the terminal.

[0606] Step 2:

[0607] The server performs sentiment analysis based on user input data. Input includes user voice data and input speed, and a machine learning model is used to analyze this data. The output is defined as the emotional state resulting from the analysis, and this is used to adjust the interface.

[0608] Step 3:

[0609] The server automatically generates application documents using natural language processing technology. The input is normalized data provided by the user, which is combined with a document template to fill in the necessary fields. The output is the generated document, which is then sent to the terminal.

[0610] Step 4:

[0611] The terminal provides the user with a visual interface and audio guidance based on the generated document and the results of sentiment analysis. Inputs include data sent from the server and sentiment analysis results, while output displays a customized guide for the user.

[0612] Step 5:

[0613] The server sends reminder notifications to users based on the set deadlines. Inputs include the procedure deadline and the user's schedule; based on this information, a notification is sent to the user's device. The output is a notification message sent to the device.

[0614] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0615] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0616] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0617] [Fourth Embodiment]

[0618] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0619] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0620] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0621] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0622] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0623] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0624] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0625] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0626] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0627] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0628] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0629] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0630] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0631] The system according to the present invention enables users to easily and efficiently carry out application procedures with local governments. This system mainly consists of a server, a terminal, and user interaction.

[0632] Data collection and management

[0633] The server collects procedural information from each local government and stores it in a unified database. This data is regularly updated to ensure it is up-to-date via scraping technology and APIs. It also receives data directly from partner local governments. This allows for the integration of different application formats and required document information from each local government.

[0634] Input data reception and analysis

[0635] The terminal receives the necessary information from the user. The user enters the type of application they wish to submit, personal information, etc. The terminal allows input in multiple languages ​​and also supports voice input. The entered information is checked for correct format and content.

[0636] Generation and provision of application documents

[0637] The server analyzes the received user information using natural language processing technology and generates appropriate application forms. In this process, a generation AI is used to retrieve necessary procedural information from the database and automatically fills in each field based on the user's input data. The generated application form is then sent to the terminal.

[0638] User Support

[0639] The terminal displays the generated application documents on the screen and provides voice guidance explaining the next steps in the procedure. This allows users to easily confirm all the information necessary for the procedure.

[0640] Reminder function

[0641] The device recognizes the set application deadline in advance and issues a reminder as the deadline approaches. This notification helps users prevent delays in the process.

[0642] Specific example

[0643] For example, when a user needs to submit a change of address notification due to moving to a new address, they search for "moving notification" on the terminal and enter details of their current and new addresses. The server uses this information to create a change of address notification according to the new municipality's format and adds any necessary supporting documents. The terminal then provides voice guidance saying, "Please submit this document to the municipality of your new address," and sends a reminder notification two days before the submission deadline. This entire process allows users to complete their application to the municipality simply and accurately.

[0644] The following describes the processing flow.

[0645] Step 1:

[0646] The server scrapes procedural information from each local government's official website and retrieves data via API to collect application forms and required documents. This data is stored in a unified database and updated regularly.

[0647] Step 2:

[0648] Users enter information for the application process via their terminal. Multilingual and voice input are available to enhance user convenience. Furthermore, the entered information is automatically formatted, and the user is notified if any information is missing.

[0649] Step 3:

[0650] The terminal formats the information received from the user and then sends the data to the server. This information transmission allows the server to perform more precise data processing.

[0651] Step 4:

[0652] The server analyzes the received user information and selects the corresponding application form from the database. Using natural language processing technology, it selects the application form that best suits the user's needs.

[0653] Step 5:

[0654] The server automatically generates application documents using AI based on the selected application format. Required fields are automatically filled in based on the user's information, resulting in the creation of accurate documents.

[0655] Step 6:

[0656] The server sends the generated application documents to the terminal, which then presents them to the user. The user can review the documents on the screen, and an audio guide leads them through the next procedural step.

[0657] Step 7:

[0658] The device sets reminders based on the application deadline. As the deadline approaches, it sends a notification to the user, prompting them to take action to prevent delays in the process.

[0659] This entire process allows users to complete their applications to local governments efficiently and accurately.

[0660] (Example 1)

[0661] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0662] In modern times, application processes for various administrative procedures are complex, and the format and required documents differ from one municipality to another, causing users to spend a great deal of time and effort on these procedures. This problem also requires support for diverse languages ​​and application formats, and managing application deadlines is a burden for users. Therefore, there is a need for a system that allows for more efficient and convenient processing of these procedures.

[0663] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0664] In this invention, the server includes means for receiving information from the user and verifying the format of the input data, means for acquiring information on various procedures from various information sources and updating the information storage device, and means for automatically generating procedural documents based on the received input data and filling in the necessary items. This enables the user to efficiently process complex procedures.

[0665] "Information" refers to various types of data and facts that have been collected and organized for a specific purpose.

[0666] An "information storage device" refers to a physical or virtual device that stores collected data and allows for quick access and updating as needed.

[0667] "User" refers to an individual or organization that uses the system to apply for administrative procedures.

[0668] "Format" refers to the structure and arrangement of data or documents, meaning they are organized according to specific rules and standards.

[0669] "Means" refers to the methods or processes used to achieve a specific objective.

[0670] A "server" refers to a computer system that provides services on a network in response to client requests.

[0671] A "generative AI model" refers to a mathematical model that uses artificial intelligence to automatically analyze data and generate knowledge and information.

[0672] The system according to this invention has a configuration that enables users to efficiently and easily carry out application procedures with local governments. The main components of the system are a server, a terminal, and a user interface.

[0673] The server uses scraping techniques and APIs to retrieve information about various procedures from the internet and stores it in a standardized format on an information storage device. This process uses software scripts to update the information on a regular schedule. Furthermore, the server utilizes a generative AI model to automatically generate the necessary procedural documents based on user input data. Natural language processing techniques are used to fill in each field of the document based on the input data.

[0674] Meanwhile, the terminal receives the necessary information from the user and supports multilingual and voice input. The received data is checked in real time for format and content validity, and the user is prompted to make corrections as needed. The terminal displays the generated application documents and guides the user through the next procedural step with voice and on-screen instructions. Furthermore, the terminal monitors the application deadline and provides reminders to the user as needed.

[0675] As a concrete example, if a user applies for a change of address notification due to moving, the process would be as follows: The user enters "moving notification" into the terminal and enters their current and new addresses according to the voice guidance. The generating AI model uses this data to create a change of address notification for the local government, and the terminal provides voice guidance saying, "Please submit this document to the local government of your new address," and sends a reminder to the computer or smartphone before the deadline.

[0676] An example of a prompt message to be input into the generation AI model would be, "Please enter the information to automatically generate the application form for a change of address due to moving to a new address."

[0677] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0678] Step 1:

[0679] The server collects procedural information from each local government using scraping techniques and APIs. The server converts the collected data into a standardized format and stores it in an information storage device. Specifically, the server executes a script at a fixed time each day to retrieve procedural information from websites and provided APIs. The input is data from external web pages and APIs, and the output is information in a standardized format registered in the database.

[0680] Step 2:

[0681] Users enter the necessary information for their application using a terminal. The terminal accepts multilingual and voice input and checks the format validity of the input data in real time. Users can enter their name and address in the input form or use voice input. The input is user-provided data, and its accuracy is verified through internal processing of the terminal. The output is verified user data.

[0682] Step 3:

[0683] The server uses a generative AI model and natural language processing technology to analyze user input data and automatically generate the necessary application documents. The server receives verified data from the user and uses it as prompts to input into the generative AI model, which then automatically fills in each field of the document. In this step, the input is verified data from the user, and the output is the automatically generated application document.

[0684] Step 4:

[0685] The terminal presents the generated application documents to the user. Furthermore, it guides the user through the next procedural step via voice guidance. The generated documents are displayed on the terminal screen, and voice instructions such as "Please submit this document to XX" are played. The input is the application documents sent from the server, and the output is the provision of visual and auditory information to the user.

[0686] Step 5:

[0687] The device manages application deadlines and provides reminders to the user as needed. The device integrates with the calendar function and notifies the user two days before the deadline via pop-up notifications or email. The input in this step is pre-set deadline information, and the output is a notification message to the user.

[0688] (Application Example 1)

[0689] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0690] The application process to local governments is complex and cumbersome, making it difficult for many users to complete it accurately and quickly. Furthermore, including electronic payment procedures presents an even greater challenge in efficiently managing the entire process.

[0691] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0692] In this invention, the server includes means for receiving information from users and verifying the format of input data, means for collecting information related to various procedures and updating the information database, and means for automatically generating an application medium based on the received input data and filling in the appropriate fields. This enables users to easily and accurately complete application procedures and smoothly complete electronic payments.

[0693] "Information" refers to data received from users and various other data necessary for procedures, which are used to streamline the application process.

[0694] An "information repository" refers to a database that stores collected information and updates procedural information.

[0695] "Medium" refers to application documents and papers generated based on the input data received.

[0696] "Electronic payment" refers to the act of paying application fees online.

[0697] The system that realizes this invention is designed to efficiently handle electronic application procedures and electronic payments. The server collects procedural information from local governments and related organizations via APIs and stores it in an information repository. This information is updated regularly to maintain the latest procedural information.

[0698] The user uses a terminal to input the necessary information for the procedure. The terminal has the capability to accept information via voice input or text input and to verify its format. In this process, the terminal uses natural language processing technology (e.g., Google Cloud Natural Language API or SpaCy) to analyze the input data and identify the application procedure the user intends to perform.

[0699] The server automatically generates application forms using a generative AI model based on user input data. These forms are provided to the user, including information for electronic payment if necessary. This system enables users to complete procedures quickly and accurately.

[0700] Furthermore, the device provides reminders for set deadlines to prevent users from forgetting procedures. It also utilizes voice guidance tailored to the purpose to help users easily understand the next steps.

[0701] As a concrete example, if a user voice-inputs "I want to pay my local taxes," the system will generate the application form required for tax payment and send a deadline reminder two days in advance. An example of a prompt message to the generating AI model is, "Please generate a tax payment application form. User information is name, address, tax identification number, and deadline is the deadline date."

[0702] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0703] Step 1:

[0704] The user enters the necessary information for the procedure into the terminal. The terminal accepts input via voice or text. The input information is checked for formatting correctness, and if it is voice input, it is converted to text format using the Google Cloud Natural Language API. The input is the procedure content intended by the user, and the output is the parsed procedure information.

[0705] Step 2:

[0706] The terminal sends the analyzed procedure information to the server for database retrieval. The output is a list of necessary information and requested items according to the type of procedure. The server retrieves the relevant procedure information from its database.

[0707] Step 3:

[0708] The server references user input data based on its information repository and automatically generates application materials using a generation AI model (e.g., GPT-3). During this process, it generates prompt text from the information. The output is a partially completed application material.

[0709] Step 4:

[0710] The server sends the generated application form to the terminal. The terminal displays the document to the user and provides supplementary information necessary for the procedure (e.g., submission destination and deadline). The output is an application form awaiting user confirmation.

[0711] Step 5:

[0712] The user reviews the application form on their terminal and makes any necessary corrections. If any corrections are made, the form is sent back to the server from the terminal. This process ensures that the user's procedure information is updated before output.

[0713] Step 6:

[0714] The device will issue reminder notifications based on the set application deadline. Users will receive information about the deadline via voice guidance or pop-up notifications. The output of this step is a notification to help users ensure that they complete the procedure on time.

[0715] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0716] The system according to the present invention incorporates an emotion engine to efficiently and effectively support application procedures to local governments. This system provides a function that takes into account the user's emotional state when automatically generating application documents based on user input information.

[0717] Data collection and management

[0718] The server continues to collect relevant information from each local government and update the database as before. Data such as application forms and required documents, which differ from one local government to another, are integrated into this database.

[0719] Input data reception and analysis

[0720] Users input the necessary data for the application process through a terminal. The terminal verifies the accuracy and completeness of the input information and also supports voice input and multilingual input. The system is designed to enhance user convenience.

[0721] Utilizing the Emotion Engine

[0722] The server integrates an emotion engine that analyzes the user's emotional state based on user input and voice data. This information is used to adapt the interface tone and responses to improve the user experience. It also provides the necessary interactions to alleviate the stress and anxiety the user is experiencing.

[0723] Generation and provision of application documents

[0724] The server uses natural language processing technology to automatically generate appropriate application documents based on the information received. The generation AI automatically fills in each field and provides the requested document to the user via the terminal.

[0725] User support and reminder features

[0726] The terminal displays the generated application documents to the user and provides detailed instructions on the next steps via voice guidance. Furthermore, it automatically sets reminders according to the application deadline, notifying the user to take necessary actions in a timely manner.

[0727] Specific example

[0728] For example, when a user is going through the procedures required for moving, they enter the necessary information along with their new address into the terminal. If the emotion engine detects that the user is experiencing stress based on their tone of voice and typing speed, the server will use a calm voice guide to reassure the user. Application documents are automatically generated by the server and presented through the terminal. The user can confirm the necessary information and ensure that they complete all necessary actions by the deadline through the reminder function. Through this entire process, the user can complete the application while receiving emotional support.

[0729] The following describes the processing flow.

[0730] Step 1:

[0731] The server collects the latest procedural information issued by each local government using web scraping and APIs, and stores this data in a unified database. This data includes application form formats and required document information.

[0732] Step 2:

[0733] The user enters information through the terminal's interface to begin the application process. Voice input is also available, and the terminal checks the accuracy and completeness of the entered information.

[0734] Step 3:

[0735] The device sends input information obtained from the user to the server. At the same time, it also generates a profile that reflects the user's language settings and emotional state.

[0736] Step 4:

[0737] The server uses an emotion engine to analyze the user's emotional state from their input data and voice. Based on this analysis, the interface tone is adjusted.

[0738] Step 5:

[0739] The server uses natural language processing technology to analyze user information and select the appropriate application documents. It then uses generative AI to automatically generate the application form and fill in the necessary information. This document is then sent to the user's terminal for their use.

[0740] Step 6:

[0741] The terminal displays the generated application form to the user and guides them through the next procedural step via voice guidance. This voice guidance is tailored to the user's emotional state.

[0742] Step 7:

[0743] The device sets reminders based on application deadline information and notifies the user of this information. Users can use the reminders from the device to take the necessary actions before the deadline.

[0744] This entire process allows users to complete their applications to local governments efficiently and with emotional support.

[0745] (Example 2)

[0746] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0747] In modern society, the application process to local governments is a complicated and time-consuming task. Accurately gathering the information users need and creating the required documents accurately and quickly is difficult. Furthermore, services often fail to consider the emotional state of users, making it difficult to alleviate the stress and anxiety that arises during the process. There is a need to solve these problems and build a user-friendly application support system.

[0748] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0749] In this invention, the server includes means for receiving information from the user and verifying the format of the input data, means for collecting information on various procedures and updating the information set, and means for analyzing the user's emotional state and adjusting the tone of the interface. This enables the user to easily create application documents and perform stress-free procedures while receiving emotional support.

[0750] A "user" refers to an individual or organization that uses the system to carry out application procedures with a local government.

[0751] "Input data" refers to the information that users provide to the system for the application process.

[0752] "Means of verifying format" refers to the process of checking the format and presence of necessary items in order to guarantee the accuracy and completeness of the input data.

[0753] An "information aggregate" is a database in which procedural information for each local government is collected, organized, and stored.

[0754] "Emotional state" refers to the user's psychological state, and is the emotion analyzed from factors such as voice and input speed.

[0755] An "interface" refers to the user environment, such as screens and audio guides, that allows users to interact with a system.

[0756] "Methods for adjusting tone" refer to the process of changing the design of responses and interfaces to match the user's emotions.

[0757] "Application documents" refer to the documents or digital documents that users are required to submit to the local government.

[0758] "Stress-free" refers to a state in which the stress and anxiety that users experience during the application process are reduced.

[0759] The system according to the present invention is designed to facilitate application procedures to local governments for users. This section describes the main components of the system and the technologies for implementing them.

[0760] The server plays a central role, collecting necessary application documents and procedural information from official sources of each local government via the internet, and updating the database as a collection of information. Because the consistency and timeliness of the information are important, the server is equipped with an automatic crawling function.

[0761] The terminal is a device that the user directly operates and is responsible for receiving the entered data. The terminal's software has a voice recognition function, enabling voice input. It also checks the format of the entered data and corrects errors as needed.

[0762] Furthermore, the server is equipped with an emotion engine. It analyzes the user's voice tone and input speed to understand the user's emotional state. Based on this information, it adjusts the interface tone and content to ensure the user can continue using it comfortably.

[0763] The server uses a generation AI model to automatically generate application documents based on the received data, fills in the appropriate fields, and provides them to the user's terminal. Users can view these documents on their terminal and make corrections if necessary.

[0764] As a concrete example, when a user is changing their address due to moving, they enter their new address and related information into the terminal. If the emotion engine detects the user's stress during this process, the server adjusts its response tone to provide reassurance. An example of a prompt message would be: "I will now enter the information required for the moving process. Please tell me my new address and the necessary documents. Also, please provide support that takes into account my stressful situation."

[0765] In this way, users can complete the application process smoothly and securely through the server and their terminal.

[0766] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0767] Step 1:

[0768] The user enters the necessary data for the application process through the terminal. Input can be in text or voice format, and the terminal uses speech recognition to convert voice to text. At this stage, the terminal checks whether the input data includes all required fields and verifies its format. If there are errors in the data, the terminal displays a message prompting the user to correct them.

[0769] Step 2:

[0770] The server analyzes the input data received from the terminal. Natural language processing techniques are used for the analysis, particularly to evaluate the consistency and accuracy of data related to address changes and personal information. This process allows the server to obtain an acceptable dataset that encompasses all necessary information.

[0771] Step 3:

[0772] Based on the user's voice and input, an emotion engine installed on the server analyzes the user's emotional state. It extracts indicators of stress and anxiety from factors such as voice tone and input speed, and determines whether the interface tone and response methods should be adjusted accordingly. This result is used to improve the user experience, for example, by selecting voice guides designed to promote relaxation.

[0773] Step 4:

[0774] The server utilizes a generative AI model to automatically generate application documents based on the analyzed dataset. To ensure that each field is accurately filled in, it uses corresponding templates. The generated documents are sent to the user's terminal in a format that allows for viewing and editing. The output documents can be reviewed immediately.

[0775] Step 5:

[0776] The terminal displays the generated application documents to the user and guides them through the next steps using voice guidance. This guidance includes information on where to submit the application documents and what items to bring. In addition, it can provide additional information to reassure users by addressing points that they may be unsure about as they proceed with the procedure.

[0777] Step 6:

[0778] The server tracks the deadline for the application process and sends that data to the device. Based on this information, the device sets up alarms and pop-up notifications to encourage users to take the necessary actions within the deadline. These reminders are pre-configured and notify users at the appropriate time.

[0779] Through these steps, users will be able to complete the application process to the local government smoothly while receiving emotional support.

[0780] (Application Example 2)

[0781] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0782] Traditional electronic payment services often resulted in an unpleasant user experience because they proceeded with transactions without considering the user's emotions or stress levels. Furthermore, limited means of mitigating user confusion and anxiety during the payment process meant that smooth transactions could not be guaranteed.

[0783] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0784] In this invention, the server includes means for verifying the format of user input data, means for collecting information on various procedures and updating a database, and means for analyzing the user's emotional state and adjusting the payment flow. This makes it possible to provide a comfortable and smooth electronic payment process that takes emotional state into consideration.

[0785] "Information from users" refers to personal data and transaction-related information entered by users through electronic systems.

[0786] "Means of checking format" refers to a function that checks whether the input data conforms to a predetermined standard or format.

[0787] "Information regarding various procedures" refers to the data and information necessary for various applications, contracts, and payments related to administrative and commercial transactions.

[0788] "Means of updating a database" refers to the process of collecting new information and reflecting additions or changes to existing datasets.

[0789] "A means of automatically generating application documents and filling in the appropriate fields" refers to a function that creates administrative documents based on received data and automatically inserts the necessary information.

[0790] "Means for providing generated documents and related information to users" refers to methods of displaying or transmitting automatically generated documents and their associated data to users in a format that can be viewed and used.

[0791] "Means of notifying users about deadlines and prompting them to take action" refers to a system that informs users of the necessary actions by a specified date and encourages them to take action.

[0792] "Means of analyzing the user's emotional state and adjusting the payment flow" refers to a function that analyzes the user's emotions and dynamically changes the payment procedure and interface in order to reduce the user's psychological burden and anxiety.

[0793] "Natural language processing technologies and machine learning models" are artificial intelligence technologies used to interpret human language and perform data processing and predictive analysis.

[0794] "Voice guidance and visual interfaces" refer to features that support users in performing operations and navigation through voice instructions and on-screen displays.

[0795] An embodiment of this invention is a system that enables users to perform payment procedures securely using electronic devices. The system mainly consists of a server and a user terminal.

[0796] The server performs multiple roles. First, it receives information provided by users and verifies that the format is correct. At this stage, it performs real-time data verification to prevent input errors and inaccurate data.

[0797] Next, the server continuously collects information related to various procedures and stores and updates this data in a database. This allows the server to maintain up-to-date procedure information and guide users to the appropriate procedures.

[0798] Furthermore, by using natural language processing technology and machine learning models, the server analyzes the user's emotional state. Based on this analysis, if the user is experiencing stress, adjustments are made to optimize the payment flow. Specifically, the interface design and voice guidance are adjusted to improve the user experience.

[0799] The user's device displays the generated application documents. After the user reviews the information, voice guidance and a visual interface are provided to facilitate the payment process. The device also notifies the user of the set deadline and prompts them to take the necessary action.

[0800] For example, when a user purchases an expensive item online, if sentiment analysis detects anxiety, the server will guide them through the payment process with calming voice prompts. As a result, the user can complete the transaction with peace of mind.

[0801] An example of a prompt to input into the generation AI model might be: "The user has recently been purchasing expensive items and may be experiencing stress, so please generate an appropriate support message on the payment screen."

[0802] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0803] Step 1:

[0804] The server checks the format of the input information received from the user's terminal. This input may include user data such as address and payment information. The server uses regular expressions to validate the data format, and if the format is correct, it proceeds to the next step. If it is incorrect, it returns an error message to the terminal.

[0805] Step 2:

[0806] The server performs sentiment analysis based on user input data. Input includes user voice data and input speed, and a machine learning model is used to analyze this data. The output is defined as the emotional state resulting from the analysis, and this is used to adjust the interface.

[0807] Step 3:

[0808] The server automatically generates application documents using natural language processing technology. The input is normalized data provided by the user, which is combined with a document template to fill in the necessary fields. The output is the generated document, which is then sent to the terminal.

[0809] Step 4:

[0810] The terminal provides the user with a visual interface and audio guidance based on the generated document and the results of sentiment analysis. Inputs include data sent from the server and sentiment analysis results, while output displays a customized guide for the user.

[0811] Step 5:

[0812] The server sends reminder notifications to users based on the set deadlines. Inputs include the procedure deadline and the user's schedule; based on this information, a notification is sent to the user's device. The output is a notification message sent to the device.

[0813] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0814] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0815] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0816] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0817] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0818] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0819] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0820] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0821] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0822] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0823] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0824] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0825] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0826] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0827] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0828] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0829] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0830] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0831] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0832] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0833] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0834] The following is further disclosed regarding the embodiments described above.

[0835] (Claim 1)

[0836] A means of receiving information from users and verifying the format of the input data,

[0837] A means of collecting information on various procedures and updating the database,

[0838] Based on the received input data, a means is provided to automatically generate application documents and fill in the appropriate fields.

[0839] Means for providing the generated documents and related information to the user,

[0840] A means of notifying users about the set deadline and prompting them to take action,

[0841] A system that includes this.

[0842] (Claim 2)

[0843] The system according to claim 1, comprising means for analyzing user input data using natural language processing technology.

[0844] (Claim 3)

[0845] The system according to claim 1, comprising means for providing audio guidance to a user.

[0846] "Example 1"

[0847] (Claim 1)

[0848] A means of receiving information from users and verifying the format of the input data,

[0849] A means for obtaining information on various procedures from various sources and updating the information storage device,

[0850] Based on the received input data, a means of automatically generating procedural documents and filling in the necessary fields,

[0851] Means for providing the generated documents and related information to the user visually and aurally,

[0852] A function that notifies users and prompts them to complete tasks based on a set deadline,

[0853] A system that includes this.

[0854] (Claim 2)

[0855] The system according to claim 1, comprising means for analyzing user input data using natural language processing technology and utilizing a generated AI model.

[0856] (Claim 3)

[0857] The system according to claim 1, comprising a function for providing voice instructions to a user.

[0858] "Application Example 1"

[0859] (Claim 1)

[0860] A means of receiving information from users and verifying the format of the input data,

[0861] A means of collecting information related to various procedures and updating the information repository,

[0862] Based on the received input data, the system automatically generates an application form and fills in the appropriate fields.

[0863] Means for providing the generated media and related information to the user,

[0864] A means of notifying users about the set deadline and prompting them to take action,

[0865] A means to support the application process for making electronic payments,

[0866] A system that includes this.

[0867] (Claim 2)

[0868] The system according to claim 1, comprising means for analyzing user input data using natural language processing.

[0869] (Claim 3)

[0870] The system according to claim 1, comprising means for providing voice guidance to a user.

[0871] "Example 2 of combining an emotion engine"

[0872] (Claim 1)

[0873] A means of receiving information from users and verifying the format of the input data,

[0874] A means of collecting information on various procedures and updating the information collection,

[0875] Based on the received input data, a means is provided to automatically generate application documents and fill in the appropriate elements.

[0876] Means for providing the generated documents and related information to the user,

[0877] A means of notifying users about the set deadline and prompting them to take action,

[0878] A means of analyzing the user's emotional state and adjusting the tone of the interface,

[0879] A system that includes this.

[0880] (Claim 2)

[0881] The system according to claim 1, comprising means for analyzing user input data using natural language processing technology.

[0882] (Claim 3)

[0883] The system according to claim 1, comprising means for providing audio guidance to the user and adapting the interaction according to the user's emotional state.

[0884] "Application example 2 when combining with an emotional engine"

[0885] (Claim 1)

[0886] A means of receiving information from users and verifying the format of the input data,

[0887] A means of collecting information on various procedures and updating the database,

[0888] Based on the received input data, a means is provided to automatically generate application documents and fill in the appropriate fields.

[0889] Means for providing the generated documents and related information to the user,

[0890] A means of notifying users about the set deadline and prompting them to take action,

[0891] A means of analyzing the emotional state of users and adjusting the payment flow,

[0892] A system that includes this.

[0893] (Claim 2)

[0894] The system according to claim 1, comprising means for analyzing user input data and emotional state using natural language processing technology and machine learning models.

[0895] (Claim 3)

[0896] The system according to claim 1, comprising means for providing users with audio guidance and visual interfaces to assist in the payment process. [Explanation of symbols]

[0897] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means of receiving information from users and verifying the format of the input data, A means of collecting information on various procedures and updating the database, Based on the received input data, a means is provided to automatically generate application documents and fill in the appropriate fields. Means for providing the generated documents and related information to the user, A means of notifying users about the set deadline and prompting them to take action, A system that includes this.

2. The system according to claim 1, comprising means for analyzing user input data using natural language processing technology.

3. The system according to claim 1, comprising means for providing audio guidance to a user.

Images