system

Abstract

We provide the system. [Solution] A means for the user to select the application agency and specify the application details, A means for automatically generating a list of necessary documents based on the applicant agency and application content using generative artificial intelligence, A means for automatically transferring the entered common information to the necessary documents, A means to automatically adjust the format and layout of each document, A means for generating the aforementioned document as an electronic medium and assigning electronic authentication, A means of transmitting the aforementioned documents to the aforementioned application agency, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003] [[ID=2I]]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Application procedures to government offices associated with special events such as weddings, funerals, and commemorative ceremonies require the same information to be described multiple times in multiple documents, which imposes a significant time and mental burden on individuals. In particular, in a society with a declining birthrate and aging population, the situations where one person needs to efficiently perform these procedures are increasing. However, in the current system, complicated manual work is required from the creation to the submission of application documents, resulting in low processing efficiency. Furthermore, input errors and inconsistencies in information are likely to occur, and the accuracy of the procedures may be impaired. It is required to solve these problems.

Means for Solving the Problems

[0005] This invention provides a system that automatically generates a list of necessary documents using generative artificial intelligence, based on the user's selection of the institution and content of the application. Furthermore, this system can automatically transfer the entered information to all necessary documents and adjust the document format and layout according to the local government's standards. The generated documents are produced as electronic media and, with electronic authentication, enable online application. The user can also review and modify the generated document list, and the system supports the secure management of authentication information. In this way, the system significantly improves the user's work efficiency, ensures the accuracy of procedures, and reduces the time and mental burden.

[0006] A "user" is an individual or organization that uses the system to complete the application process.

[0007] "Application agency" refers to the government office or administrative agency to which a user must submit an application.

[0008] "Generative artificial intelligence" refers to programs and algorithms that generate necessary information based on input data and use it for a specific purpose.

[0009] The "list of required documents" refers to a list of documents that are required to be submitted during the application process.

[0010] "Automatic data entry" is a function that automatically copies entered information to other documents or data.

[0011] "Format" refers to the way documents and data are represented and structured.

[0012] "Electronic media" refers to a means of storing and transmitting information in digital format.

[0013] "Electronic authentication" is a process for guaranteeing the legitimacy of digital information and recognizing it as official.

[0014] "Online application" refers to the procedure of electronically submitting an application using the Internet.

[0015] "Authentication information" refers to the information used to verify the identity and authority of a user.

Brief Description of Drawings

[0016] [Figure 1] It is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] It is a conceptual diagram showing an example of the main functions of a data processing device and a smart device according to the first embodiment. [Figure 3] It is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] It is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] It is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which multiple emotions are mapped. [Figure 10] It shows an emotion map to which multiple emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when the emotion engine is combined.

Mode for Carrying Out the Invention

[0017] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be described.

[0019] In the following embodiments, a processor with a reference numeral (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of a plurality of arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of a plurality of types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0020] In the following embodiments, a RAM (Random Access Memory) with a reference numeral is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0021] In the following embodiments, a storage with a reference numeral is one or more non-volatile storage devices that store various programs and various parameters and the like. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.

[0022] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0024] [First Embodiment]

[0025] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0026] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0029] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0032] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] As shown in Figure 2, in the data processing device 12, specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0036] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0037] This invention is a system for users to efficiently carry out various application procedures with government offices. The specific form of implementing this system is described below.

[0038] overview

[0039] This system was developed to reduce the complexity of the application process for users and to improve efficiency. It consists of a terminal operated by the user, a server that performs the processing, and an interface that the user accesses.

[0040] Processing flow

[0041] 1. User actions

[0042] Users access a dedicated application or website using their device and select the municipality and procedure they wish to apply for. After user authentication, an individual user screen is displayed.

[0043] 2. Document generation

[0044] The server uses generative artificial intelligence based on the user's selection to automatically generate a list of documents required for the relevant application procedure. The selected documents include several documents typically required for an application.

[0045] 3. Input and transcription of information

[0046] Users enter the necessary common information for their application into a terminal, requiring only a one-time input. The server receives this information and automatically transfers it to each generated document. This eliminates the need for manual, duplicate data entry.

[0047] 4. Adjusting the document format

[0048] The server automatically adjusts the format and layout of the generated documents to conform to the standards of each local government. This ensures that the documents are ready for accurate acceptance.

[0049] 5. Preparing for electronic application

[0050] The server generates the document as an electronic medium and assigns electronic authentication. The user performs a final check on their terminal and authenticates using their My Number (social security number) or electronic seal.

[0051] 6. Online submission

[0052] The completed documents are sent online from the server to the relevant local government's electronic application system. After the application process is complete, a notification of submission completion is displayed on the user's device.

[0053] Specific example

[0054] For example, consider a specific case where a user is handling the death procedures for a parent. The user enters basic information such as the deceased's name, address, and date of birth into their terminal. The server receives the information and automatically transfers it to the "death certificate," "cremation permit," and "inheritance documents." The layout of all documents is automatically adjusted, allowing the user to complete the procedure in just a few steps.

[0055] In this way, the present invention can significantly simplify cumbersome procedural tasks and reduce the user's time and effort.

[0056] The following describes the processing flow.

[0057] Step 1:

[0058] The user logs into the system using their device. Upon successful user authentication, an interface for starting the application process is displayed.

[0059] Step 2:

[0060] The user selects the municipality and type of procedure to apply to. This selection is sent to the server, and processing begins.

[0061] Step 3:

[0062] The server uses generative artificial intelligence to generate a list of required documents based on the selected municipality and procedure. This automatically selects the appropriate documents.

[0063] Step 4:

[0064] Users enter personal information and application details required for all documents into their terminals. This information is sent to and stored on the server.

[0065] Step 5:

[0066] The server automatically transfers the entered information to the necessary documents. This process ensures data consistency across documents.

[0067] Step 6:

[0068] The server automatically adjusts the format and layout of the generated documents to match the standards of each local government. The optimized documents are then provided to the user for review.

[0069] Step 7:

[0070] Users review documents on their devices and make corrections if necessary. These corrections are then reflected on the server.

[0071] Step 8:

[0072] The server applies electronic authentication to the completed documents and prepares them for electronic application. If necessary, the My Number (Social Security Number) is also entered.

[0073] Step 9:

[0074] Based on the user's submission instructions, the server securely transmits the documents online to the local government's submission system. Once the submission is complete, a confirmation notice is sent to the user's device.

[0075] (Example 1)

[0076] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0077] Traditionally, the application process to processing agencies was cumbersome, requiring users to individually create and submit numerous documents. This necessitated multiple data entry and verification steps, and particularly when applying to different agencies, document formats had to be adapted to each agency's specifications. As a result, the overall application process was extremely inefficient, posing a significant challenge for users in terms of time and effort.

[0078] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0079] In this invention, the server includes means for the user to select a processing institution and identify the processing content, means for automatically generating a document list using generative artificial intelligence, means for automatically transferring information to each document, means for automatically adjusting the format and layout, means for the user to perform a final check on the terminal, and means for sending a notification after the application is completed. This enables the user to proceed with the application process efficiently in a consistent flow.

[0080] A "user" refers to an individual or organization that uses the system to submit an application to a processing agency.

[0081] A "processing agency" refers to a public or private institution designated by the user for carrying out the application process.

[0082] "Generative artificial intelligence" refers to artificial intelligence technology that automatically creates a list of necessary documents based on user selections and optimizes the content of each document.

[0083] A "document list" refers to a list of documents required for an application, generated based on the designated processing agency and content.

[0084] "Automatic data entry" refers to a function that accurately reflects common information entered by users into each generated document.

[0085] "Format and layout" refers to the appearance and style of each document in accordance with the requirements of the processing agency.

[0086] "Final confirmation" refers to the process where the user reviews the completed document displayed on their device and makes corrections or approvals as needed.

[0087] "Notification" refers to information that informs the user of the progress or completion of the application process.

[0088] This invention is a system for users to efficiently carry out application procedures to processing agencies. The system consists of a terminal operated by the user, a server that performs data processing, and an interface that the user accesses.

[0089] Users access a dedicated application or website using their device and select the processing agency and procedure. During this process, users undergo authentication and are shown an individual user screen where they enter the necessary common information for the application once.

[0090] The server uses generative artificial intelligence to automatically generate a list of necessary documents based on the selected processing content. The server then automatically transfers user input information to these generated documents and adjusts the format and layout according to the local government's standards. Finally, the server generates the documents as electronic media and adds the necessary electronic authentication.

[0091] Users review documents on their devices and authenticate them using their My Number (social security number) or electronic seal. The authenticated documents are then sent by the server to the appropriate processing authority, and a completion notification is sent to the user's device. This process allows users to complete the application process quickly and accurately.

[0092] As a concrete example, consider a case where a user is handling the inheritance procedures for their parent. The user enters the deceased's basic information into the terminal, and the server automatically transfers this information to "inheritance-related documents," etc. The document layout is adjusted, and the procedure is completed in a few steps.

[0093] An example of a prompt message is, "Please tell me the steps to efficiently carry out the inheritance procedures for my parents." In this way, this invention significantly reduces the user's time and effort.

[0094] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0095] Step 1:

[0096] The user accesses a dedicated application or website using their device. The user enters their login information and is requested to authenticate. The entered authentication information is sent from the device to the server, which compares it with the user database and displays an individual user screen.

[0097] Step 2:

[0098] The user selects the processing authority and procedure type requested from the user interface. The selected information is sent from the terminal to the server, which then begins generating a list of documents necessary for processing. Using a generation AI model, the server outputs a list of necessary documents based on the selected items and returns it to the terminal.

[0099] Step 3:

[0100] The user checks the document list on their terminal and enters the common information required for the application. This entered information is sent from the terminal to the server. The server receives this information, automatically processes the data to transfer it to each document, and outputs an updated document list.

[0101] Step 4:

[0102] The server automatically adjusts the format and layout of each document according to local government standards based on the document list. These adjusted documents are then generated in electronic format and output to the terminal.

[0103] Step 5:

[0104] The user performs a final review of the generated document using the terminal. Upon reviewing the document, the user enters their My Number (Social Security Number) and electronic seal, and adds authentication information. The terminal then sends the authentication data to the server, which completes the electronic authentication.

[0105] Step 6:

[0106] The server sends the authenticated document to the electronic application system of the selected processing agency online. Once the transmission is complete, the server prints a notification of application completion on the terminal. The user receives this notification and confirms that the procedure has been successfully completed.

[0107] (Application Example 1)

[0108] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0109] In various store procedures, there is a need to streamline processes by reducing the time and effort required for users to individually fill out and verify multiple documents. Specifically, it is necessary to eliminate the inefficiency of users repeatedly entering the same information for each procedure, and to complete procedures efficiently and quickly.

[0110] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0111] In this invention, the server includes means for the user to select a procedural agency and specify the procedural content, means for automatically generating a list of necessary documents using generative artificial intelligence, and means for automatically transferring the input common information to multiple documents. This allows the user to reflect information in multiple procedural documents with a single information input, thereby improving the efficiency of procedures in stores.

[0112] "User" refers to a person who uses a system or service, and is the entity that carries out procedures or applications.

[0113] A "procedural agency" refers to an organization or facility that receives and processes procedures and applications submitted by users.

[0114] "Generative artificial intelligence" is a machine learning system that automatically generates documents and information based on specified conditions and inputs.

[0115] A "document list" refers to a list of multiple documents required for the procedure selected by the user.

[0116] "Electronic media" refers to a form of information that is stored and transmitted in digital format, and is a format for managing data electronically.

[0117] "Electronic authentication" refers to authentication information assigned to guarantee the security of documents and data.

[0118] A "terminal" refers to a device that a user uses to access and operate a system.

[0119] To implement this invention, the user first selects the institution to which the procedure is to be performed and identifies the procedure details via a terminal. Typically, a smartphone or tablet is used as the terminal. The terminal accesses the server via a web browser or dedicated application and inputs the information necessary for the procedure.

[0120] The server uses generative artificial intelligence to automatically generate a list of necessary documents based on the entered procedural body and procedural details. This generation utilizes advanced generative AI models such as OpenAI's GPT-3 and Google's BERT. This ensures that the most suitable documents for a variety of procedures are provided.

[0121] Next, the server automatically transfers the common information entered by the user into multiple documents. This process frees the user from having to repeatedly enter the same information for each procedure. Furthermore, the server automatically adjusts the format and layout of each document according to the standards of the procedural body, generating documents in the correct format.

[0122] The server also stores the generated documents as electronic media and assigns electronic authentication. This electronic authentication uses specific protocols and technologies to ensure security. The user reviews the document on their terminal and performs final confirmation of the procedure as needed.

[0123] A concrete example is the application for a new membership at a store. In this case, the user simply enters the necessary basic information once using a terminal, and the information is automatically reflected in documents such as contracts and membership information forms. The generated documents are electronically authenticated and formatted in a way that is easy for store staff to review.

[0124] An example of a prompt message might be, "Generate the documents required for a new membership application and automatically fill in all fields using the provided information." This prompt enables accurate and efficient document generation.

[0125] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0126] Step 1:

[0127] The user accesses the application using a terminal and selects the procedural agency and the procedure. The system requires the user's requested procedural information as input. Based on this, the system outputs the user's selected procedural status.

[0128] Step 2:

[0129] The server uses generative artificial intelligence to automatically generate a list of necessary documents based on the information of the procedural body and procedure details received from the user. This process requires data on the procedural body and procedure details as input. The AI ​​model generates the appropriate documents based on prompts and outputs the results.

[0130] Step 3:

[0131] Users enter common information (such as name and address) once via a terminal. This information is reflected in all documents required for the procedure. Common information is required as input, and the output is the information reflected in a unified format in each document.

[0132] Step 4:

[0133] The server uses the received common information to automatically transfer that information to each document. The inputs are the common information and the generated documents, and the output is a document with the information correctly transferred.

[0134] Step 5:

[0135] The server automatically adjusts the format and layout of each document according to the procedural authority's standards. The input is the transcribed document, and the output is a document in a format that conforms to the procedural standards.

[0136] Step 6:

[0137] The server stores the prepared document as an electronic medium and assigns electronic authentication to it. The input is the prepared document, and the output is an authenticated electronic document.

[0138] Step 7:

[0139] The user reviews the document generated on their device, confirms that it is complete, and then submits it. The input is an authenticated electronic document, and the output is the status of the document sent to the procedural authority.

[0140] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0141] This invention is a system that enables users to efficiently and comfortably perform various application procedures with government offices. This system consists of a terminal operated by the user, a server for processing, and a user interface equipped with an emotion engine. The specific implementation of this system is described below.

[0142] overview

[0143] This system, which incorporates an emotion engine, is designed to alleviate the complexity and stress users face when applying to government offices. The emotion engine analyzes the user's emotions from their facial expressions and voice, and helps optimize the process.

[0144] Processing flow

[0145] 1. User actions

[0146] The user logs into the system via their device and selects the municipality and procedure they wish to apply to.

[0147] 2. Recognition of emotions

[0148] The server uses the device's camera and microphone to recognize the user's emotions through an emotion engine and understand the user's emotional state.

[0149] 3. Document generation and emotional feedback

[0150] The server utilizes generative artificial intelligence to create a list of necessary documents and provides appropriate feedback and support based on the user's emotions. For example, if the user is feeling stressed, it will suggest a simplified mode.

[0151] 4. Input and transcription of information

[0152] The user enters personal information into the terminal, and the server automatically transfers this information to the necessary documents. An emotion engine monitors the user's emotions during input and displays support messages if the user appears confused.

[0153] 5. Dynamic adjustment of the interface

[0154] The server dynamically adjusts the user interface based on sentiment analysis. For example, if the user is calm, it continues the process in normal mode, providing an elegant design.

[0155] 6. Electronic application and tracking

[0156] Completed documents are sent to the electronic application system after electronic authentication. Based on this, the server monitors the application status and provides real-time feedback to the user.

[0157] Specific example

[0158] For example, when a user is going through the process of registering the death of a parent, if the user's emotions are frequently perceived as anxiety or sadness, the emotion engine is activated. The server analyzes this and displays concise guides and encouraging messages on the screen. It also provides simple and easy-to-understand explanations for complex parts of the process, minimizing the user's burden.

[0159] Thus, the present invention provides a comfortable procedural experience for users, enabling smoother and more efficient applications through stress reduction.

[0160] The following describes the processing flow.

[0161] Step 1:

[0162] The user accesses the system's login screen using their device, enters their credentials, and is authenticated. Upon successful login, a dedicated interface for starting the application process is displayed.

[0163] Step 2:

[0164] The user selects the municipality and type of procedure they wish to apply to from the interface. This selection information is sent to the server, which then initiates the next step in processing.

[0165] Step 3:

[0166] Based on the received application, the server automatically generates a list of necessary documents using generative artificial intelligence. The document list is displayed on the user's device, allowing them to review and make corrections.

[0167] Step 4:

[0168] The server uses the terminal's camera and microphone to send data on the user's facial expressions and voice to the emotion engine. The emotion engine analyzes the user's emotions and returns the results to the server.

[0169] Step 5:

[0170] The server dynamically adjusts the user interface based on the results of sentiment analysis. For example, if the user is feeling stressed, it simplifies the screen display and shows comforting messages.

[0171] Step 6:

[0172] The user enters common information into the terminal. Once the input is complete, the server automatically transfers this information to the necessary documents, adjusts the document format, and prepares them for printing or electronic submission.

[0173] Step 7:

[0174] The server automatically assigns electronic authentication to the documents and generates them as electronic media with the authentication. The documents are prepared for the applying agency and await user instructions.

[0175] Step 8:

[0176] Once the user instructs the server to complete the process, the server sends the documents to the application agency's online system and verifies whether the transmission was successful. The user is then notified of the result.

[0177] Step 9:

[0178] Users can check the submission status on their devices and track the real-time application status provided by the server. Users are periodically provided with information on the review progress.

[0179] (Example 2)

[0180] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0181] Application procedures at government offices and institutions can be complex and cause significant stress for users. This stress is amplified by numerous steps, including document preparation, information entry, formatting adjustments, and authentication processes. Furthermore, the lack of interface adjustments tailored to the emotional state of individual users results in inefficient and uncomfortable procedures.

[0182] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0183] In this invention, the server includes means for making suggestions to simplify the process when the user feels stressed, based on emotion recognition using the user's facial expressions and voice; means for automatically generating a list of necessary documents using generative artificial intelligence; and means for dynamically adjusting the user interface according to the user's emotional state. This enables an efficient and comfortable application process that takes into account the emotions of individual users.

[0184] A "user" is an individual or organization that completes the application process through the system.

[0185] "Submitting agency" refers to the government office or related organization to which the user submits the application.

[0186] "Submission details" refer to the specific procedures and types of applications that users select when submitting an application.

[0187] "Generative artificial intelligence" is an AI technology that automatically generates appropriate output based on the information presented.

[0188] The "list of required documents" refers to a list of documents necessary for the application process.

[0189] "Emotion recognition" is a technology that analyzes a user's facial expressions and voice to determine their emotional state.

[0190] "User interface" refers to the screens and input methods that users use to interact with the system.

[0191] This invention is a system that allows users to efficiently and comfortably perform various application procedures to government offices and other submission agencies. The system consists of a terminal operated by the user, a server that handles processing, and a user interface that includes an emotion engine.

[0192] The server processes input from the terminal and uses generative artificial intelligence to automatically generate a list of necessary documents based on the submitting institution and the content of the submission. The generative AI model lists appropriate document templates and required information according to the user's prompts. For example, this process begins when the user enters, "Please generate the documents required for the death of my parent."

[0193] The user's emotional state is analyzed by an emotion engine using the camera and microphone connected to the device. If the emotion is recognized as stress or anxiety, the server suggests to the user how to simplify the process. At this time, the user interface is also dynamically adjusted to provide a visually comfortable interface according to the user's emotions.

[0194] Specifically, as the user logs in and proceeds with the application process, the sentiment engine constantly monitors the user's state and displays support messages as needed. The server is equipped with a high-performance database and sentiment analysis software, enabling real-time process optimization. The completed document is generated as an electronic medium and electronically authenticated as needed. Finally, the document is automatically sent to the submitting institution, and the server continues to monitor its progress.

[0195] Through this system, users can complete complex procedures quickly and easily, and receive flexible responses that are tailored to their emotions.

[0196] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0197] Step 1:

[0198] The terminal receives login information from the user. The user enters their ID and password, and the terminal sends this information to the server. The server performs authentication, and if successful, retrieves the user's information and establishes the login status. As output, the terminal displays a user-specific dashboard.

[0199] Step 2:

[0200] The user selects the submitting institution and procedure items on the terminal. The terminal sends the user's selection information to the server. The server verifies the database information related to the submitting institution and procedure items and sends prompts for the necessary document templates to the AI ​​model. The AI ​​model outputs a list of necessary documents and displays them on the terminal via the server.

[0201] Step 3:

[0202] The server uses the terminal's camera and microphone to send the user's facial expressions and voice data to the emotion engine. The emotion engine analyzes the data and recognizes the user's emotional state. The server receives this analysis result and generates feedback and process optimization suggestions tailored to the user's emotions. As output, specific support messages and operational instructions are displayed on the terminal's screen.

[0203] Step 4:

[0204] The user enters the necessary personal information into the terminal, and once completed, the terminal sends the information to the server. The server automatically transfers the received information into a document template. After data processing, it generates a completed application document and displays a confirmation screen on the terminal. After the user reviews it, they make final adjustments to the content.

[0205] Step 5:

[0206] The server dynamically adjusts the user interface design and element layout based on information from the emotion engine. The user interface automatically changes colors and displayed content according to the emotional state, providing an optimized user interface for the device.

[0207] Step 6:

[0208] The completed documents are authenticated by the server using an electronic signature system and sent to the submitting institution's electronic application port. The server monitors the submission progress in real time and outputs information on the application's success or failure and the next steps to the terminal. This allows the user to understand the progress of their application.

[0209] (Application Example 2)

[0210] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0211] Application procedures at government offices are generally complex and stressful. Users are prone to feeling anxious and confused during the process, which reduces the efficiency of the procedures. Therefore, there is a need for a system that supports the procedures based on emotions.

[0212] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0213] In this invention, the server includes means for analyzing the user's psychological state from their facial expressions and voice and presenting information based on the user's psychological state, means for dynamically adjusting the user interface according to the psychological state, and means for automatically generating a list of necessary documents using generative artificial intelligence. This enables the user to proceed with procedures at government offices efficiently and comfortably.

[0214] An "application agency" is a public institution that accepts and manages administrative procedures and related processes.

[0215] "Generative artificial intelligence" refers to artificial intelligence that automatically generates documents and information according to the user's needs.

[0216] The "document list" is a list of all the documents required for the application.

[0217] "Common information" refers to the general personal information and document information of the user that is required for the application process.

[0218] "Electronic media" refers to digital data stored in a format that can be read by computers and digital devices.

[0219] "Electronic authentication" is a procedure for guaranteeing the legitimacy and authenticity of digital data.

[0220] "Psychological state analysis from facial expressions and voice" is a technology that automatically determines a user's psychological state by analyzing their facial expressions and voice tone.

[0221] "Dynamic user interface adjustment" refers to changing the design and operation methods of the display screen in real time according to the user's emotions and state.

[0222] One embodiment of the present invention is a system designed to streamline application procedures at government offices and support users in making decisions comfortably. This system is equipped with an emotion engine and aims to optimize the application process by analyzing the user's facial expressions and voice in real time.

[0223] The server uses the user's camera and microphone to acquire facial expressions and voice data. During this process, it analyzes the user's emotions using the "Emotion API" from "Microsoft® Azure® Cognitive Services." Furthermore, it utilizes the "OpenAI GPT-4® API" to generate appropriate advice and feedback messages based on the user's psychological state.

[0224] The server also uses generative artificial intelligence to automatically create and provide the user with a list of necessary documents based on the application agency and application content selected by the user. Depending on the user's state of mind, the system dynamically adjusts the user interface, presenting a visually easy-to-understand layout and operation guide. For example, if the user feels unsure about the application process, a concise and easy-to-understand explanation will be displayed on the smart glasses' screen, supporting the entire process to proceed smoothly.

[0225] One specific use case is when a user is going to change their address at the city hall and encounters difficulties during the process. In such cases, the glasses can display a message saying, "The process is going smoothly. We will guide you through the next steps," which can help alleviate anxiety.

[0226] Examples of prompt statements to input into the generative AI model are as follows:

[0227] "While the user was going through a procedure at the city hall, emotional data indicating confusion and anxiety was received. Please provide appropriate next steps and advice in gentle language that reflects their state of mind."

[0228] In this way, we provide an environment where users can intuitively understand complex administrative procedures and proceed with confidence.

[0229] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0230] Step 1:

[0231] The user logs into the system via their terminal and selects the relevant application agency and application details. The information entered here includes the user's authentication information and application selection data. Based on this information, the server prepares the application process.

[0232] Step 2:

[0233] The server uses the terminal's camera and microphone to acquire the user's facial expressions and voice data in real time. Based on the acquired data, it uses the "Emotion API" of "Microsoft Azure Cognitive Services" to analyze the user's psychological state. The input is data from the camera and microphone, and the output is an evaluation of the user's emotions.

[0234] Step 3:

[0235] The server utilizes generative artificial intelligence to automatically generate a list of necessary documents based on the application agency and content selected by the user. This process takes the selected application content as input and outputs the generated document list. In this process, it is crucial that the AI ​​provides a fast and accurate list of documents.

[0236] Step 4:

[0237] The server generates appropriate advice and feedback messages for the user based on emotional data analyzed by the Emotion API. To do this, it uses the "OpenAI GPT-4 API" to obtain advice text by inputting emotion-based prompts. The output text is adapted according to the user's psychological state.

[0238] Step 5:

[0239] The server dynamically adjusts the user interface according to the user's psychological state. For example, if the user is feeling anxious, the UI is changed to a simpler, more visually user-friendly one. In this step, emotional data is used as input to adjust UI parameters and output the new interface.

[0240] Step 6:

[0241] The user reviews the document generated on the terminal, performs electronic authentication on the electronically generated document, and sends it to the application agency. The input data consists of the user's review results and document list, and the output is authenticated electronic application data.

[0242] Through this series of processes, users can comfortably proceed with the application process.

[0243] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0244] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0245] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0246] [Second Embodiment]

[0247] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0248] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0249] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0250] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0251] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0252] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0253] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0254] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0255] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0256] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0257] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0258] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0259] This invention is a system for users to efficiently carry out various application procedures with government offices. The specific form of implementing this system is described below.

[0260] overview

[0261] This system was developed to reduce the complexity of the application process for users and to improve efficiency. It consists of a terminal operated by the user, a server that performs the processing, and an interface that the user accesses.

[0262] Processing flow

[0263] 1. User actions

[0264] Users access a dedicated application or website using their device and select the municipality and procedure they wish to apply for. After user authentication, an individual user screen is displayed.

[0265] 2. Document generation

[0266] The server uses generative artificial intelligence based on the user's selection to automatically generate a list of documents required for the relevant application procedure. The selected documents include several documents typically required for an application.

[0267] 3. Input and transcription of information

[0268] Users enter the necessary common information for their application into a terminal, requiring only a one-time input. The server receives this information and automatically transfers it to each generated document. This eliminates the need for manual, duplicate data entry.

[0269] 4. Adjusting the document format

[0270] The server automatically adjusts the format and layout of the generated documents to conform to the standards of each local government. This ensures that the documents are ready for accurate acceptance.

[0271] 5. Preparing for electronic application

[0272] The server generates the document as an electronic medium and assigns electronic authentication. The user performs a final check on their terminal and authenticates using their My Number (social security number) or electronic seal.

[0273] 6. Online submission

[0274] The completed documents are sent online from the server to the relevant local government's electronic application system. After the application process is complete, a notification of submission completion is displayed on the user's device.

[0275] Specific example

[0276] For example, a specific example is given when a certain user conducts the death procedure of a parent. The user inputs basic information such as the name, address, and date of birth of the deceased on the terminal. The server receives the information and executes the batch transfer of the information to the "Death Certificate", "Cremation Permit", and "Documents Related to Inheritance". The layout of all documents is automatically adjusted, and the user can complete the procedure in a few steps.

[0277] In this way, the present invention can greatly simplify the cumbersome procedure work and reduce the time and labor of the user.

[0278] The following describes the processing flow.

[0279] Step 1:

[0280] The user logs in to the system using the terminal. When the user authentication is successful, an interface for starting the application procedure is displayed.

[0281] Step 2:

[0282] The user selects the local government to apply to and the type of procedure. The selection result is sent to the server, and the processing is started.

[0283] Step 3:

[0284] The server uses generative artificial intelligence to generate a list of necessary documents based on the selected local government and procedure. Thereby, the corresponding documents are automatically selected.

[0285] Step 4:

[0286] The user inputs personal information and application information that are commonly required for the documents on the terminal. This information is sent to the server and saved.

[0287] Step 5:

[0288] The server automatically transfers the entered information to the necessary documents. This process ensures data consistency across documents.

[0289] Step 6:

[0290] The server automatically adjusts the format and layout of the generated documents to match the standards of each local government. The optimized documents are then provided to the user for review.

[0291] Step 7:

[0292] Users review documents on their devices and make corrections if necessary. These corrections are then reflected on the server.

[0293] Step 8:

[0294] The server applies electronic authentication to the completed documents and prepares them for electronic application. If necessary, the My Number (Social Security Number) is also entered.

[0295] Step 9:

[0296] Based on the user's submission instructions, the server securely transmits the documents online to the local government's submission system. Once the submission is complete, a confirmation notice is sent to the user's device.

[0297] (Example 1)

[0298] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0299] Traditionally, the application process to processing agencies was cumbersome, requiring users to individually create and submit numerous documents. This necessitated multiple data entry and verification steps, and particularly when applying to different agencies, document formats had to be adapted to each agency's specifications. As a result, the overall application process was extremely inefficient, posing a significant challenge for users in terms of time and effort.

[0300] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0301] In this invention, the server includes means for the user to select a processing institution and identify the processing content, means for automatically generating a document list using generative artificial intelligence, means for automatically transferring information to each document, means for automatically adjusting the format and layout, means for the user to perform a final check on the terminal, and means for sending a notification after the application is completed. This enables the user to proceed with the application process efficiently in a consistent flow.

[0302] A "user" refers to an individual or organization that uses the system to submit an application to a processing agency.

[0303] A "processing agency" refers to a public or private institution designated by the user for carrying out the application process.

[0304] "Generative artificial intelligence" refers to artificial intelligence technology that automatically creates a list of necessary documents based on user selections and optimizes the content of each document.

[0305] A "document list" refers to a list of documents required for an application, generated based on the designated processing agency and content.

[0306] "Automatic data entry" refers to a function that accurately reflects common information entered by users into each generated document.

[0307] "Format and layout" refers to the appearance and style of each document in accordance with the requirements of the processing agency.

[0308] "Final confirmation" refers to the operation where the user checks the completed document displayed on the terminal and makes corrections and approvals as necessary.

[0309] "Notification" refers to information that notifies the user of the progress and completion of the application procedure.

[0310] This invention is a system for the user to efficiently conduct an application procedure with a processing agency. The system consists of a terminal operated by the user, a server for data processing, and an interface accessed by the user.

[0311] The user uses the terminal to access a dedicated application or website, selects the processing agency and the procedure. At this time, the user goes through authentication, a personalized user screen is displayed, and the common information required for the application is input once.

[0312] The server utilizes generative artificial intelligence to automatically generate a list of necessary documents based on the selected processing content. The server automatically transcribes the input information from the user into the generated documents and adjusts the format and layout based on the standards of the local government. Finally, the server generates the documents as an electronic medium and assigns the necessary electronic authentication.

[0313] The user checks the documents on the terminal and conducts authentication using the My Number and electronic seal. The authenticated documents are sent by the server to the corresponding processing agency, and a completion notice is sent to the user's terminal. Through this process, the user can complete the application procedure quickly and accurately.

[0314] As a specific example, consider the case where the user conducts the inheritance procedure of a parent. The user inputs the basic information of the deceased into the terminal, and the server automatically transcribes this into documents such as "Documents related to inheritance". The layout of the documents is adjusted, and the procedure is completed in a few steps.

[0315] An example of a prompt message is, "Please tell me the steps to efficiently carry out the inheritance procedures for my parents." In this way, this invention significantly reduces the user's time and effort.

[0316] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0317] Step 1:

[0318] The user accesses a dedicated application or website using their device. The user enters their login information and is requested to authenticate. The entered authentication information is sent from the device to the server, which compares it with the user database and displays an individual user screen.

[0319] Step 2:

[0320] The user selects the processing authority and procedure type requested from the user interface. The selected information is sent from the terminal to the server, which then begins generating a list of documents necessary for processing. Using a generation AI model, the server outputs a list of necessary documents based on the selected items and returns it to the terminal.

[0321] Step 3:

[0322] The user checks the document list on their terminal and enters the common information required for the application. This entered information is sent from the terminal to the server. The server receives this information, automatically processes the data to transfer it to each document, and outputs an updated document list.

[0323] Step 4:

[0324] The server automatically adjusts the format and layout of each document according to local government standards based on the document list. These adjusted documents are then generated in electronic format and output to the terminal.

[0325] Step 5:

[0326] The user performs a final review of the generated document using the terminal. Upon reviewing the document, the user enters their My Number (Social Security Number) and electronic seal, and adds authentication information. The terminal then sends the authentication data to the server, which completes the electronic authentication.

[0327] Step 6:

[0328] The server sends the authenticated document to the electronic application system of the selected processing agency online. Once the transmission is complete, the server prints a notification of application completion on the terminal. The user receives this notification and confirms that the procedure has been successfully completed.

[0329] (Application Example 1)

[0330] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0331] In various store procedures, there is a need to streamline processes by reducing the time and effort required for users to individually fill out and verify multiple documents. Specifically, it is necessary to eliminate the inefficiency of users repeatedly entering the same information for each procedure, and to complete procedures efficiently and quickly.

[0332] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0333] In this invention, the server includes means for the user to select a procedural agency and specify the procedural content, means for automatically generating a list of necessary documents using generative artificial intelligence, and means for automatically transferring the input common information to multiple documents. This allows the user to reflect information in multiple procedural documents with a single information input, thereby improving the efficiency of procedures in stores.

[0334] "User" refers to a person who uses a system or service, and is the entity that carries out procedures or applications.

[0335] A "procedural agency" refers to an organization or facility that receives and processes procedures and applications submitted by users.

[0336] "Generative artificial intelligence" is a machine learning system that automatically generates documents and information based on specified conditions and inputs.

[0337] A "document list" refers to a list of multiple documents required for the procedure selected by the user.

[0338] "Electronic media" refers to a form of information that is stored and transmitted in digital format, and is a format for managing data electronically.

[0339] "Electronic authentication" refers to authentication information assigned to guarantee the security of documents and data.

[0340] A "terminal" refers to a device that a user uses to access and operate a system.

[0341] To implement this invention, the user first selects the institution to which the procedure is to be performed and identifies the procedure details via a terminal. Typically, a smartphone or tablet is used as the terminal. The terminal accesses the server via a web browser or dedicated application and inputs the information necessary for the procedure.

[0342] The server uses generative artificial intelligence to automatically generate a list of necessary documents based on the input procedural body and procedural details. Advanced generative AI models such as OpenAI's GPT-3 and Google's BERT are used for this generation. This ensures that the most suitable documents are provided for a variety of procedures.

[0343] Next, the server automatically transfers the common information entered by the user into multiple documents. This process frees the user from having to repeatedly enter the same information for each procedure. Furthermore, the server automatically adjusts the format and layout of each document according to the standards of the procedural body, generating documents in the correct format.

[0344] The server also stores the generated documents as electronic media and assigns electronic authentication. This electronic authentication uses specific protocols and technologies to ensure security. The user reviews the document on their terminal and performs final confirmation of the procedure as needed.

[0345] A concrete example is the application for a new membership at a store. In this case, the user simply enters the necessary basic information once using a terminal, and the information is automatically reflected in documents such as contracts and membership information forms. The generated documents are electronically authenticated and formatted in a way that is easy for store staff to review.

[0346] An example of a prompt message might be, "Generate the documents required for a new membership application and automatically fill in all fields using the provided information." This prompt enables accurate and efficient document generation.

[0347] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0348] Step 1:

[0349] The user accesses the application using a terminal and selects the procedural agency and the procedure. The system requires the user's requested procedural information as input. Based on this, the system outputs the user's selected procedural status.

[0350] Step 2:

[0351] The server uses generative artificial intelligence to automatically generate a list of necessary documents based on the information of the procedural body and procedure details received from the user. This process requires data on the procedural body and procedure details as input. The AI ​​model generates the appropriate documents based on prompts and outputs the results.

[0352] Step 3:

[0353] Users enter common information (such as name and address) once via a terminal. This information is reflected in all documents required for the procedure. Common information is required as input, and the output is the information reflected in a unified format in each document.

[0354] Step 4:

[0355] The server uses the received common information to automatically transfer that information to each document. The inputs are the common information and the generated documents, and the output is a document with the information correctly transferred.

[0356] Step 5:

[0357] The server automatically adjusts the format and layout of each document according to the procedural authority's standards. The input is the transcribed document, and the output is a document in a format that conforms to the procedural standards.

[0358] Step 6:

[0359] The server stores the prepared document as an electronic medium and assigns electronic authentication to it. The input is the prepared document, and the output is an authenticated electronic document.

[0360] Step 7:

[0361] The user reviews the document generated on their device, confirms that it is complete, and then submits it. The input is an authenticated electronic document, and the output is the status of the document sent to the procedural authority.

[0362] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0363] This invention is a system that enables users to efficiently and comfortably perform various application procedures with government offices. This system consists of a terminal operated by the user, a server for processing, and a user interface equipped with an emotion engine. The specific implementation of this system is described below.

[0364] overview

[0365] This system, which incorporates an emotion engine, is designed to alleviate the complexity and stress users face when applying to government offices. The emotion engine analyzes the user's emotions from their facial expressions and voice, and helps optimize the process.

[0366] Processing flow

[0367] 1. User actions

[0368] The user logs into the system via their device and selects the municipality and procedure they wish to apply to.

[0369] 2. Recognition of emotions

[0370] The server uses the device's camera and microphone to recognize the user's emotions through an emotion engine and understand the user's emotional state.

[0371] 3. Document generation and emotional feedback

[0372] The server utilizes generative artificial intelligence to create a list of necessary documents and provides appropriate feedback and support based on the user's emotions. For example, if the user is feeling stressed, it will suggest a simplified mode.

[0373] 4. Input and transcription of information

[0374] The user enters personal information into the terminal, and the server automatically transfers this information to the necessary documents. An emotion engine monitors the user's emotions during input and displays support messages if the user appears confused.

[0375] 5. Dynamic adjustment of the interface

[0376] The server dynamically adjusts the user interface based on sentiment analysis. For example, if the user is calm, it continues the process in normal mode, providing an elegant design.

[0377] 6. Electronic application and tracking

[0378] Completed documents are sent to the electronic application system after electronic authentication. Based on this, the server monitors the application status and provides real-time feedback to the user.

[0379] Specific example

[0380] For example, when a user is going through the process of registering the death of a parent, if the user's emotions are frequently perceived as anxiety or sadness, the emotion engine is activated. The server analyzes this and displays concise guides and encouraging messages on the screen. It also provides simple and easy-to-understand explanations for complex parts of the process, minimizing the user's burden.

[0381] Thus, the present invention provides a comfortable procedural experience for users, enabling smoother and more efficient applications through stress reduction.

[0382] The following describes the processing flow.

[0383] Step 1:

[0384] The user accesses the system's login screen using their device, enters their credentials, and is authenticated. Upon successful login, a dedicated interface for starting the application process is displayed.

[0385] Step 2:

[0386] The user selects the municipality and type of procedure they wish to apply to from the interface. This selection information is sent to the server, which then initiates the next step in processing.

[0387] Step 3:

[0388] Based on the received application, the server automatically generates a list of necessary documents using generative artificial intelligence. The document list is displayed on the user's device, allowing them to review and make corrections.

[0389] Step 4:

[0390] The server uses the terminal's camera and microphone to send data on the user's facial expressions and voice to the emotion engine. The emotion engine analyzes the user's emotions and returns the results to the server.

[0391] Step 5:

[0392] The server dynamically adjusts the user interface based on the results of sentiment analysis. For example, if the user is feeling stressed, it simplifies the screen display and shows comforting messages.

[0393] Step 6:

[0394] The user enters common information into the terminal. Once the input is complete, the server automatically transfers this information to the necessary documents, adjusts the document format, and prepares them for printing or electronic submission.

[0395] Step 7:

[0396] The server automatically assigns electronic authentication to the documents and generates them as electronic media with the authentication. The documents are prepared for the applying agency and await user instructions.

[0397] Step 8:

[0398] Once the user instructs the server to complete the process, the server sends the documents to the application agency's online system and verifies whether the transmission was successful. The user is then notified of the result.

[0399] Step 9:

[0400] Users can check the submission status on their devices and track the real-time application status provided by the server. Users are periodically provided with information on the review progress.

[0401] (Example 2)

[0402] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0403] Application procedures at government offices and institutions can be complex and cause significant stress for users. This stress is amplified by numerous steps, including document preparation, information entry, formatting adjustments, and authentication processes. Furthermore, the lack of interface adjustments tailored to the emotional state of individual users results in inefficient and uncomfortable procedures.

[0404] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0405] In this invention, the server includes means for making suggestions to simplify the process when the user feels stressed, based on emotion recognition using the user's facial expressions and voice; means for automatically generating a list of necessary documents using generative artificial intelligence; and means for dynamically adjusting the user interface according to the user's emotional state. This enables an efficient and comfortable application process that takes into account the emotions of individual users.

[0406] A "user" is an individual or organization that completes the application process through the system.

[0407] "Submitting agency" refers to the government office or related organization to which the user submits the application.

[0408] "Submission details" refer to the specific procedures and types of applications that users select when submitting an application.

[0409] "Generative artificial intelligence" is an AI technology that automatically generates appropriate output based on the information presented.

[0410] The "list of required documents" refers to a list of documents necessary for the application process.

[0411] "Emotion recognition" is a technology that analyzes a user's facial expressions and voice to determine their emotional state.

[0412] "User interface" refers to the screens and input methods that users use to interact with the system.

[0413] This invention is a system that allows users to efficiently and comfortably perform various application procedures to government offices and other submission agencies. The system consists of a terminal operated by the user, a server that handles processing, and a user interface that includes an emotion engine.

[0414] The server processes input from the terminal and uses generative artificial intelligence to automatically generate a list of necessary documents based on the submitting institution and the content of the submission. The generative AI model lists appropriate document templates and required information according to the user's prompts. For example, this process begins when the user enters, "Please generate the documents required for the death of my parent."

[0415] The user's emotional state is analyzed by an emotion engine using the camera and microphone connected to the device. If the emotion is recognized as stress or anxiety, the server suggests to the user how to simplify the process. At this time, the user interface is also dynamically adjusted to provide a visually comfortable interface according to the user's emotions.

[0416] Specifically, as the user logs in and proceeds with the application process, the sentiment engine constantly monitors the user's state and displays support messages as needed. The server is equipped with a high-performance database and sentiment analysis software, enabling real-time process optimization. The completed document is generated as an electronic medium and electronically authenticated as needed. Finally, the document is automatically sent to the submitting institution, and the server continues to monitor its progress.

[0417] Through this system, users can complete complex procedures quickly and easily, and receive flexible responses that are tailored to their emotions.

[0418] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0419] Step 1:

[0420] The terminal receives login information from the user. The user enters their ID and password, and the terminal sends this information to the server. The server performs authentication, and if successful, retrieves the user's information and establishes the login status. As output, the terminal displays a user-specific dashboard.

[0421] Step 2:

[0422] The user selects the submitting institution and procedure items on the terminal. The terminal sends the user's selection information to the server. The server verifies the database information related to the submitting institution and procedure items and sends prompts for the necessary document templates to the AI ​​model. The AI ​​model outputs a list of necessary documents and displays them on the terminal via the server.

[0423] Step 3:

[0424] The server uses the terminal's camera and microphone to send the user's facial expressions and voice data to the emotion engine. The emotion engine analyzes the data and recognizes the user's emotional state. The server receives this analysis result and generates feedback and process optimization suggestions tailored to the user's emotions. As output, specific support messages and operational instructions are displayed on the terminal's screen.

[0425] Step 4:

[0426] The user enters the necessary personal information into the terminal, and once completed, the terminal sends the information to the server. The server automatically transfers the received information into a document template. After data processing, it generates a completed application document and displays a confirmation screen on the terminal. After the user reviews it, they make final adjustments to the content.

[0427] Step 5:

[0428] The server dynamically adjusts the user interface design and element layout based on information from the emotion engine. The user interface automatically changes colors and displayed content according to the emotional state, providing an optimized user interface for the device.

[0429] Step 6:

[0430] The completed documents are authenticated by the server using an electronic signature system and sent to the submitting institution's electronic application port. The server monitors the submission progress in real time and outputs information on the application's success or failure and the next steps to the terminal. This allows the user to understand the progress of their application.

[0431] (Application Example 2)

[0432] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0433] Application procedures at government offices are generally complex and stressful. Users are prone to feeling anxious and confused during the process, which reduces the efficiency of the procedures. Therefore, there is a need for a system that supports the procedures based on emotions.

[0434] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0435] In this invention, the server includes means for analyzing the user's psychological state from their facial expressions and voice and presenting information based on the user's psychological state, means for dynamically adjusting the user interface according to the psychological state, and means for automatically generating a list of necessary documents using generative artificial intelligence. This enables the user to proceed with procedures at government offices efficiently and comfortably.

[0436] An "application agency" is a public institution that accepts and manages administrative procedures and related processes.

[0437] "Generative artificial intelligence" refers to artificial intelligence that automatically generates documents and information according to the user's needs.

[0438] The "document list" is a list of all the documents required for the application.

[0439] "Common information" refers to the general personal information and document information of the user that is required for the application process.

[0440] "Electronic media" refers to digital data stored in a format that can be read by computers and digital devices.

[0441] "Electronic authentication" is a procedure for guaranteeing the legitimacy and authenticity of digital data.

[0442] "Psychological state analysis from facial expressions and voice" is a technology that automatically determines a user's psychological state by analyzing their facial expressions and voice tone.

[0443] "Dynamic user interface adjustment" refers to changing the design and operation methods of the display screen in real time according to the user's emotions and state.

[0444] One embodiment of the present invention is a system designed to streamline application procedures at government offices and support users in making decisions comfortably. This system is equipped with an emotion engine and aims to optimize the application process by analyzing the user's facial expressions and voice in real time.

[0445] The server uses the user's camera and microphone to acquire facial expressions and voice data. During this process, it utilizes the "Emotion API" of "Microsoft Azure Cognitive Services" to analyze the user's emotions. Furthermore, it uses the "OpenAI GPT-4 API" to generate appropriate advice and feedback messages based on the user's psychological state.

[0446] The server also uses generative artificial intelligence to automatically create and provide the user with a list of necessary documents based on the application agency and application content selected by the user. Depending on the user's state of mind, the system dynamically adjusts the user interface, presenting a visually easy-to-understand layout and operation guide. For example, if the user feels unsure about the application process, a concise and easy-to-understand explanation will be displayed on the smart glasses' screen, supporting the entire process to proceed smoothly.

[0447] One specific use case is when a user is going to change their address at the city hall and encounters difficulties during the process. In such cases, the glasses can display a message saying, "The process is going smoothly. We will guide you through the next steps," which can help alleviate anxiety.

[0448] Examples of prompt statements to input into the generative AI model are as follows:

[0449] "While the user was going through a procedure at the city hall, emotional data indicating confusion and anxiety was received. Please provide appropriate next steps and advice in gentle language that reflects their state of mind."

[0450] In this way, we provide an environment where users can intuitively understand complex administrative procedures and proceed with confidence.

[0451] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0452] Step 1:

[0453] The user logs into the system via their terminal and selects the relevant application agency and application details. The information entered here includes the user's authentication information and application selection data. Based on this information, the server prepares the application process.

[0454] Step 2:

[0455] The server uses the terminal's camera and microphone to acquire the user's facial expressions and voice data in real time. Based on the acquired data, it uses the "Emotion API" of "Microsoft Azure Cognitive Services" to analyze the user's psychological state. The input is data from the camera and microphone, and the output is an evaluation of the user's emotions.

[0456] Step 3:

[0457] The server utilizes generative artificial intelligence to automatically generate a list of necessary documents based on the application agency and content selected by the user. This process takes the selected application content as input and outputs the generated document list. In this process, it is crucial that the AI ​​provides a fast and accurate list of documents.

[0458] Step 4:

[0459] The server generates appropriate advice and feedback messages for the user based on emotional data analyzed by the Emotion API. To do this, it uses the "OpenAI GPT-4 API" to obtain advice text by inputting emotion-based prompts. The output text is adapted according to the user's psychological state.

[0460] Step 5:

[0461] The server dynamically adjusts the user interface according to the user's psychological state. For example, if the user is feeling anxious, the UI is changed to a simpler, more visually user-friendly one. In this step, emotional data is used as input to adjust UI parameters and output the new interface.

[0462] Step 6:

[0463] The user reviews the document generated on the terminal, performs electronic authentication on the electronically generated document, and sends it to the application agency. The input data consists of the user's review results and document list, and the output is authenticated electronic application data.

[0464] Through this series of processes, users can comfortably proceed with the application process.

[0465] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0466] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0467] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0468] [Third Embodiment]

[0469] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0470] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0471] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0472] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0473] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0474] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0475] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0476] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0477] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0478] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0479] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0480] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0481] This invention is a system for users to efficiently carry out various application procedures with government offices. The specific form of implementing this system is described below.

[0482] overview

[0483] This system was developed to reduce the complexity of the application process for users and to improve efficiency. It consists of a terminal operated by the user, a server that performs the processing, and an interface that the user accesses.

[0484] Processing flow

[0485] 1. User actions

[0486] Users access a dedicated application or website using their device and select the municipality and procedure they wish to apply for. After user authentication, an individual user screen is displayed.

[0487] 2. Document generation

[0488] The server uses generative artificial intelligence based on the user's selection to automatically generate a list of documents required for the relevant application procedure. The selected documents include several documents typically required for an application.

[0489] 3. Input and transcription of information

[0490] Users enter the necessary common information for their application into a terminal, requiring only a one-time input. The server receives this information and automatically transfers it to each generated document. This eliminates the need for manual, duplicate data entry.

[0491] 4. Adjusting the document format

[0492] The server automatically adjusts the format and layout of the generated documents to conform to the standards of each local government. This ensures that the documents are ready for accurate acceptance.

[0493] 5. Preparing for electronic application

[0494] The server generates the document as an electronic medium and assigns electronic authentication. The user performs a final check on their terminal and authenticates using their My Number (social security number) or electronic seal.

[0495] 6. Online submission

[0496] The completed documents are sent online from the server to the relevant local government's electronic application system. After the application process is complete, a notification of submission completion is displayed on the user's device.

[0497] Specific example

[0498] For example, consider a specific case where a user is handling the death procedures for a parent. The user enters basic information such as the deceased's name, address, and date of birth into their terminal. The server receives the information and automatically transfers it to the "death certificate," "cremation permit," and "inheritance documents." The layout of all documents is automatically adjusted, allowing the user to complete the procedure in just a few steps.

[0499] In this way, the present invention can significantly simplify cumbersome procedural tasks and reduce the user's time and effort.

[0500] The following describes the processing flow.

[0501] Step 1:

[0502] The user logs into the system using their device. Upon successful user authentication, an interface for starting the application process is displayed.

[0503] Step 2:

[0504] The user selects the municipality and type of procedure to apply to. This selection is sent to the server, and processing begins.

[0505] Step 3:

[0506] The server uses generative artificial intelligence to generate a list of required documents based on the selected municipality and procedure. This automatically selects the appropriate documents.

[0507] Step 4:

[0508] Users enter personal information and application details required for all documents into their terminals. This information is sent to and stored on the server.

[0509] Step 5:

[0510] The server automatically transfers the entered information to the necessary documents. This process ensures data consistency across documents.

[0511] Step 6:

[0512] The server automatically adjusts the format and layout of the generated documents to match the standards of each local government. The optimized documents are then provided to the user for review.

[0513] Step 7:

[0514] Users review documents on their devices and make corrections if necessary. These corrections are then reflected on the server.

[0515] Step 8:

[0516] The server applies electronic authentication to the completed documents and prepares them for electronic application. If necessary, the My Number (Social Security Number) is also entered.

[0517] Step 9:

[0518] Based on the user's submission instructions, the server securely transmits the documents online to the local government's submission system. Once the submission is complete, a confirmation notice is sent to the user's device.

[0519] (Example 1)

[0520] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0521] Traditionally, the application process to processing agencies was cumbersome, requiring users to individually create and submit numerous documents. This necessitated multiple data entry and verification steps, and particularly when applying to different agencies, document formats had to be adapted to each agency's specifications. As a result, the overall application process was extremely inefficient, posing a significant challenge for users in terms of time and effort.

[0522] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0523] In this invention, the server includes means for the user to select a processing institution and identify the processing content, means for automatically generating a document list using generative artificial intelligence, means for automatically transferring information to each document, means for automatically adjusting the format and layout, means for the user to perform a final check on the terminal, and means for sending a notification after the application is completed. This enables the user to proceed with the application process efficiently in a consistent flow.

[0524] A "user" refers to an individual or organization that uses the system to submit an application to a processing agency.

[0525] A "processing agency" refers to a public or private institution designated by the user for carrying out the application process.

[0526] "Generative artificial intelligence" refers to artificial intelligence technology that automatically creates a list of necessary documents based on user selections and optimizes the content of each document.

[0527] A "document list" refers to a list of documents required for an application, generated based on the designated processing agency and content.

[0528] "Automatic data entry" refers to a function that accurately reflects common information entered by users into each generated document.

[0529] "Format and layout" refers to the appearance and style of each document in accordance with the requirements of the processing agency.

[0530] "Final confirmation" refers to the process where the user reviews the completed document displayed on their device and makes corrections or approvals as needed.

[0531] "Notification" refers to information that informs the user of the progress or completion of the application process.

[0532] This invention is a system for users to efficiently carry out application procedures to processing agencies. The system consists of a terminal operated by the user, a server that performs data processing, and an interface that the user accesses.

[0533] Users access a dedicated application or website using their device and select the processing agency and procedure. During this process, users undergo authentication and are shown an individual user screen where they enter the necessary common information for the application once.

[0534] The server uses generative artificial intelligence to automatically generate a list of necessary documents based on the selected processing content. The server then automatically transfers user input information to these generated documents and adjusts the format and layout according to the local government's standards. Finally, the server generates the documents as electronic media and adds the necessary electronic authentication.

[0535] Users review documents on their devices and authenticate them using their My Number (social security number) or electronic seal. The authenticated documents are then sent by the server to the appropriate processing authority, and a completion notification is sent to the user's device. This process allows users to complete the application process quickly and accurately.

[0536] As a concrete example, consider a case where a user is handling the inheritance procedures for their parent. The user enters the deceased's basic information into the terminal, and the server automatically transfers this information to "inheritance-related documents," etc. The document layout is adjusted, and the procedure is completed in a few steps.

[0537] An example of a prompt message is, "Please tell me the steps to efficiently carry out the inheritance procedures for my parents." In this way, this invention significantly reduces the user's time and effort.

[0538] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0539] Step 1:

[0540] The user accesses a dedicated application or website using their device. The user enters their login information and is requested to authenticate. The entered authentication information is sent from the device to the server, which compares it with the user database and displays an individual user screen.

[0541] Step 2:

[0542] The user selects the processing authority and procedure type requested from the user interface. The selected information is sent from the terminal to the server, which then begins generating a list of documents necessary for processing. Using a generation AI model, the server outputs a list of necessary documents based on the selected items and returns it to the terminal.

[0543] Step 3:

[0544] The user checks the document list on their terminal and enters the common information required for the application. This entered information is sent from the terminal to the server. The server receives this information, automatically processes the data to transfer it to each document, and outputs an updated document list.

[0545] Step 4:

[0546] The server automatically adjusts the format and layout of each document according to local government standards based on the document list. These adjusted documents are then generated in electronic format and output to the terminal.

[0547] Step 5:

[0548] The user performs a final review of the generated document using the terminal. Upon reviewing the document, the user enters their My Number (Social Security Number) and electronic seal, and adds authentication information. The terminal then sends the authentication data to the server, which completes the electronic authentication.

[0549] Step 6:

[0550] The server sends the authenticated document to the electronic application system of the selected processing agency online. Once the transmission is complete, the server prints a notification of application completion on the terminal. The user receives this notification and confirms that the procedure has been successfully completed.

[0551] (Application Example 1)

[0552] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0553] In various store procedures, there is a need to streamline processes by reducing the time and effort required for users to individually fill out and verify multiple documents. Specifically, it is necessary to eliminate the inefficiency of users repeatedly entering the same information for each procedure, and to complete procedures efficiently and quickly.

[0554] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0555] In this invention, the server includes means for the user to select a procedural agency and specify the procedural content, means for automatically generating a list of necessary documents using generative artificial intelligence, and means for automatically transferring the input common information to multiple documents. This allows the user to reflect information in multiple procedural documents with a single information input, thereby improving the efficiency of procedures in stores.

[0556] "User" refers to a person who uses a system or service, and is the entity that carries out procedures or applications.

[0557] A "procedural agency" refers to an organization or facility that receives and processes procedures and applications submitted by users.

[0558] "Generative artificial intelligence" is a machine learning system that automatically generates documents and information based on specified conditions and inputs.

[0559] A "document list" refers to a list of multiple documents required for the procedure selected by the user.

[0560] "Electronic media" refers to a form of information that is stored and transmitted in digital format, and is a format for managing data electronically.

[0561] "Electronic authentication" refers to authentication information assigned to guarantee the security of documents and data.

[0562] A "terminal" refers to a device that a user uses to access and operate a system.

[0563] To implement this invention, the user first selects the institution to which the procedure is to be performed and identifies the procedure details via a terminal. Typically, a smartphone or tablet is used as the terminal. The terminal accesses the server via a web browser or dedicated application and inputs the information necessary for the procedure.

[0564] The server uses generative artificial intelligence to automatically generate a list of necessary documents based on the input procedural body and procedural details. Advanced generative AI models such as OpenAI's GPT-3 and Google's BERT are used for this generation. This ensures that the most suitable documents are provided for a variety of procedures.

[0565] Next, the server automatically transfers the common information entered by the user into multiple documents. This process frees the user from having to repeatedly enter the same information for each procedure. Furthermore, the server automatically adjusts the format and layout of each document according to the standards of the procedural body, generating documents in the correct format.

[0566] The server also stores the generated documents as electronic media and assigns electronic authentication. This electronic authentication uses specific protocols and technologies to ensure security. The user reviews the document on their terminal and performs final confirmation of the procedure as needed.

[0567] A concrete example is the application for a new membership at a store. In this case, the user simply enters the necessary basic information once using a terminal, and the information is automatically reflected in documents such as contracts and membership information forms. The generated documents are electronically authenticated and formatted in a way that is easy for store staff to review.

[0568] An example of a prompt message might be, "Generate the documents required for a new membership application and automatically fill in all fields using the provided information." This prompt enables accurate and efficient document generation.

[0569] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0570] Step 1:

[0571] The user accesses the application using a terminal and selects the procedural agency and the procedure. The system requires the user's requested procedural information as input. Based on this, the system outputs the user's selected procedural status.

[0572] Step 2:

[0573] The server uses generative artificial intelligence to automatically generate a list of necessary documents based on the information of the procedural body and procedure details received from the user. This process requires data on the procedural body and procedure details as input. The AI ​​model generates the appropriate documents based on prompts and outputs the results.

[0574] Step 3:

[0575] Users enter common information (such as name and address) once via a terminal. This information is reflected in all documents required for the procedure. Common information is required as input, and the output is the information reflected in a unified format in each document.

[0576] Step 4:

[0577] The server uses the received common information to automatically transfer that information to each document. The inputs are the common information and the generated documents, and the output is a document with the information correctly transferred.

[0578] Step 5:

[0579] The server automatically adjusts the format and layout of each document according to the procedural authority's standards. The input is the transcribed document, and the output is a document in a format that conforms to the procedural standards.

[0580] Step 6:

[0581] The server stores the prepared document as an electronic medium and assigns electronic authentication to it. The input is the prepared document, and the output is an authenticated electronic document.

[0582] Step 7:

[0583] The user reviews the document generated on their device, confirms that it is complete, and then submits it. The input is an authenticated electronic document, and the output is the status of the document sent to the procedural authority.

[0584] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0585] This invention is a system that enables users to efficiently and comfortably perform various application procedures with government offices. This system consists of a terminal operated by the user, a server for processing, and a user interface equipped with an emotion engine. The specific implementation of this system is described below.

[0586] overview

[0587] This system, which incorporates an emotion engine, is designed to alleviate the complexity and stress users face when applying to government offices. The emotion engine analyzes the user's emotions from their facial expressions and voice, and helps optimize the process.

[0588] Processing flow

[0589] 1. User actions

[0590] The user logs into the system via their device and selects the municipality and procedure they wish to apply to.

[0591] 2. Recognition of emotions

[0592] The server uses the device's camera and microphone to recognize the user's emotions through an emotion engine and understand the user's emotional state.

[0593] 3. Document generation and emotional feedback

[0594] The server utilizes generative artificial intelligence to create a list of necessary documents and provides appropriate feedback and support based on the user's emotions. For example, if the user is feeling stressed, it will suggest a simplified mode.

[0595] 4. Input and transcription of information

[0596] The user enters personal information into the terminal, and the server automatically transfers this information to the necessary documents. An emotion engine monitors the user's emotions during input and displays support messages if the user appears confused.

[0597] 5. Dynamic adjustment of the interface

[0598] The server dynamically adjusts the user interface based on sentiment analysis. For example, if the user is calm, it continues the process in normal mode, providing an elegant design.

[0599] 6. Electronic application and tracking

[0600] Completed documents are sent to the electronic application system after electronic authentication. Based on this, the server monitors the application status and provides real-time feedback to the user.

[0601] Specific example

[0602] For example, when a user is going through the process of registering the death of a parent, if the user's emotions are frequently perceived as anxiety or sadness, the emotion engine is activated. The server analyzes this and displays concise guides and encouraging messages on the screen. It also provides simple and easy-to-understand explanations for complex parts of the process, minimizing the user's burden.

[0603] Thus, the present invention provides a comfortable procedural experience for users, enabling smoother and more efficient applications through stress reduction.

[0604] The following describes the processing flow.

[0605] Step 1:

[0606] The user accesses the system's login screen using their device, enters their credentials, and is authenticated. Upon successful login, a dedicated interface for starting the application process is displayed.

[0607] Step 2:

[0608] The user selects the municipality and type of procedure they wish to apply to from the interface. This selection information is sent to the server, which then initiates the next step in processing.

[0609] Step 3:

[0610] Based on the received application, the server automatically generates a list of necessary documents using generative artificial intelligence. The document list is displayed on the user's device, allowing them to review and make corrections.

[0611] Step 4:

[0612] The server uses the terminal's camera and microphone to send data on the user's facial expressions and voice to the emotion engine. The emotion engine analyzes the user's emotions and returns the results to the server.

[0613] Step 5:

[0614] The server dynamically adjusts the user interface based on the results of sentiment analysis. For example, if the user is feeling stressed, it simplifies the screen display and shows comforting messages.

[0615] Step 6:

[0616] The user enters common information into the terminal. Once the input is complete, the server automatically transfers this information to the necessary documents, adjusts the document format, and prepares them for printing or electronic submission.

[0617] Step 7:

[0618] The server automatically assigns electronic authentication to the documents and generates them as electronic media with the authentication. The documents are prepared for the applying agency and await user instructions.

[0619] Step 8:

[0620] Once the user instructs the server to complete the process, the server sends the documents to the application agency's online system and verifies whether the transmission was successful. The user is then notified of the result.

[0621] Step 9:

[0622] Users can check the submission status on their devices and track the real-time application status provided by the server. Users are periodically provided with information on the review progress.

[0623] (Example 2)

[0624] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0625] Application procedures at government offices and institutions can be complex and cause significant stress for users. This stress is amplified by numerous steps, including document preparation, information entry, formatting adjustments, and authentication processes. Furthermore, the lack of interface adjustments tailored to the emotional state of individual users results in inefficient and uncomfortable procedures.

[0626] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0627] In this invention, the server includes means for making suggestions to simplify the process when the user feels stressed, based on emotion recognition using the user's facial expressions and voice; means for automatically generating a list of necessary documents using generative artificial intelligence; and means for dynamically adjusting the user interface according to the user's emotional state. This enables an efficient and comfortable application process that takes into account the emotions of individual users.

[0628] A "user" is an individual or organization that completes the application process through the system.

[0629] "Submitting agency" refers to the government office or related organization to which the user submits the application.

[0630] "Submission details" refer to the specific procedures and types of applications that users select when submitting an application.

[0631] "Generative artificial intelligence" is an AI technology that automatically generates appropriate output based on the information presented.

[0632] The "list of required documents" refers to a list of documents necessary for the application process.

[0633] "Emotion recognition" is a technology that analyzes a user's facial expressions and voice to determine their emotional state.

[0634] "User interface" refers to the screens and input methods that users use to interact with the system.

[0635] This invention is a system that allows users to efficiently and comfortably perform various application procedures to government offices and other submission agencies. The system consists of a terminal operated by the user, a server that handles processing, and a user interface that includes an emotion engine.

[0636] The server processes input from the terminal and uses generative artificial intelligence to automatically generate a list of necessary documents based on the submitting institution and the content of the submission. The generative AI model lists appropriate document templates and required information according to the user's prompts. For example, this process begins when the user enters, "Please generate the documents required for the death of my parent."

[0637] The user's emotional state is analyzed by an emotion engine using the camera and microphone connected to the device. If the emotion is recognized as stress or anxiety, the server suggests to the user how to simplify the process. At this time, the user interface is also dynamically adjusted to provide a visually comfortable interface according to the user's emotions.

[0638] Specifically, as the user logs in and proceeds with the application process, the sentiment engine constantly monitors the user's state and displays support messages as needed. The server is equipped with a high-performance database and sentiment analysis software, enabling real-time process optimization. The completed document is generated as an electronic medium and electronically authenticated as needed. Finally, the document is automatically sent to the submitting institution, and the server continues to monitor its progress.

[0639] Through this system, users can complete complex procedures quickly and easily, and receive flexible responses that are tailored to their emotions.

[0640] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0641] Step 1:

[0642] The terminal receives login information from the user. The user enters their ID and password, and the terminal sends this information to the server. The server performs authentication, and if successful, retrieves the user's information and establishes the login status. As output, the terminal displays a user-specific dashboard.

[0643] Step 2:

[0644] The user selects the submitting institution and procedure items on the terminal. The terminal sends the user's selection information to the server. The server verifies the database information related to the submitting institution and procedure items and sends prompts for the necessary document templates to the AI ​​model. The AI ​​model outputs a list of necessary documents and displays them on the terminal via the server.

[0645] Step 3:

[0646] The server uses the terminal's camera and microphone to send the user's facial expressions and voice data to the emotion engine. The emotion engine analyzes the data and recognizes the user's emotional state. The server receives this analysis result and generates feedback and process optimization suggestions tailored to the user's emotions. As output, specific support messages and operational instructions are displayed on the terminal's screen.

[0647] Step 4:

[0648] The user enters the necessary personal information into the terminal, and once completed, the terminal sends the information to the server. The server automatically transfers the received information into a document template. After data processing, it generates a completed application document and displays a confirmation screen on the terminal. After the user reviews it, they make final adjustments to the content.

[0649] Step 5:

[0650] The server dynamically adjusts the user interface design and element layout based on information from the emotion engine. The user interface automatically changes colors and displayed content according to the emotional state, providing an optimized user interface for the device.

[0651] Step 6:

[0652] The completed documents are authenticated by the server using an electronic signature system and sent to the submitting institution's electronic application port. The server monitors the submission progress in real time and outputs information on the application's success or failure and the next steps to the terminal. This allows the user to understand the progress of their application.

[0653] (Application Example 2)

[0654] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0655] Application procedures at government offices are generally complex and stressful. Users are prone to feeling anxious and confused during the process, which reduces the efficiency of the procedures. Therefore, there is a need for a system that supports the procedures based on emotions.

[0656] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0657] In this invention, the server includes means for analyzing the user's psychological state from their facial expressions and voice and presenting information based on the user's psychological state, means for dynamically adjusting the user interface according to the psychological state, and means for automatically generating a list of necessary documents using generative artificial intelligence. This enables the user to proceed with procedures at government offices efficiently and comfortably.

[0658] An "application agency" is a public institution that accepts and manages administrative procedures and related processes.

[0659] "Generative artificial intelligence" refers to artificial intelligence that automatically generates documents and information according to the user's needs.

[0660] The "document list" is a list of all the documents required for the application.

[0661] "Common information" refers to the general personal information and document information of the user that is required for the application process.

[0662] "Electronic media" refers to digital data stored in a format that can be read by computers and digital devices.

[0663] "Electronic authentication" is a procedure for guaranteeing the legitimacy and authenticity of digital data.

[0664] "Psychological state analysis from facial expressions and voice" is a technology that automatically determines a user's psychological state by analyzing their facial expressions and voice tone.

[0665] "Dynamic user interface adjustment" refers to changing the design and operation methods of the display screen in real time according to the user's emotions and state.

[0666] One embodiment of the present invention is a system designed to streamline application procedures at government offices and support users in making decisions comfortably. This system is equipped with an emotion engine and aims to optimize the application process by analyzing the user's facial expressions and voice in real time.

[0667] The server uses the user's camera and microphone to acquire facial expressions and voice data. During this process, it utilizes the "Emotion API" of "Microsoft Azure Cognitive Services" to analyze the user's emotions. Furthermore, it uses the "OpenAI GPT-4 API" to generate appropriate advice and feedback messages based on the user's psychological state.

[0668] The server also uses generative artificial intelligence to automatically create and provide the user with a list of necessary documents based on the application agency and application content selected by the user. Depending on the user's state of mind, the system dynamically adjusts the user interface, presenting a visually easy-to-understand layout and operation guide. For example, if the user feels unsure about the application process, a concise and easy-to-understand explanation will be displayed on the smart glasses' screen, supporting the entire process to proceed smoothly.

[0669] One specific use case is when a user is going to change their address at the city hall and encounters difficulties during the process. In such cases, the glasses can display a message saying, "The process is going smoothly. We will guide you through the next steps," which can help alleviate anxiety.

[0670] Examples of prompt statements to input into the generative AI model are as follows:

[0671] "While the user was going through a procedure at the city hall, emotional data indicating confusion and anxiety was received. Please provide appropriate next steps and advice in gentle language that reflects their state of mind."

[0672] In this way, we provide an environment where users can intuitively understand complex administrative procedures and proceed with confidence.

[0673] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0674] Step 1:

[0675] The user logs into the system via their terminal and selects the relevant application agency and application details. The information entered here includes the user's authentication information and application selection data. Based on this information, the server prepares the application process.

[0676] Step 2:

[0677] The server uses the terminal's camera and microphone to acquire the user's facial expressions and voice data in real time. Based on the acquired data, it uses the "Emotion API" of "Microsoft Azure Cognitive Services" to analyze the user's psychological state. The input is data from the camera and microphone, and the output is an evaluation of the user's emotions.

[0678] Step 3:

[0679] The server utilizes generative artificial intelligence to automatically generate a list of necessary documents based on the application agency and content selected by the user. This process takes the selected application content as input and outputs the generated document list. In this process, it is crucial that the AI ​​provides a fast and accurate list of documents.

[0680] Step 4:

[0681] The server generates appropriate advice and feedback messages for the user based on emotional data analyzed by the Emotion API. To do this, it uses the "OpenAI GPT-4 API" to obtain advice text by inputting emotion-based prompts. The output text is adapted according to the user's psychological state.

[0682] Step 5:

[0683] The server dynamically adjusts the user interface according to the user's psychological state. For example, if the user is feeling anxious, the UI is changed to a simpler, more visually user-friendly one. In this step, emotional data is used as input to adjust UI parameters and output the new interface.

[0684] Step 6:

[0685] The user reviews the document generated on the terminal, performs electronic authentication on the electronically generated document, and sends it to the application agency. The input data consists of the user's review results and document list, and the output is authenticated electronic application data.

[0686] Through this series of processes, users can comfortably proceed with the application process.

[0687] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0688] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0689] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0690] [Fourth Embodiment]

[0691] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0692] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0693] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0694] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0695] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0696] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0697] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0698] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0699] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0700] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0701] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0702] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0703] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0704] This invention is a system for users to efficiently carry out various application procedures with government offices. The specific form of implementing this system is described below.

[0705] overview

[0706] This system was developed to reduce the complexity of the application process for users and to improve efficiency. It consists of a terminal operated by the user, a server that performs the processing, and an interface that the user accesses.

[0707] Processing flow

[0708] 1. User actions

[0709] Users access a dedicated application or website using their device and select the municipality and procedure they wish to apply for. After user authentication, an individual user screen is displayed.

[0710] 2. Document generation

[0711] The server uses generative artificial intelligence based on the user's selection to automatically generate a list of documents required for the relevant application procedure. The selected documents include several documents typically required for an application.

[0712] 3. Input and transcription of information

[0713] Users enter the necessary common information for their application into a terminal, requiring only a one-time input. The server receives this information and automatically transfers it to each generated document. This eliminates the need for manual, duplicate data entry.

[0714] 4. Adjusting the document format

[0715] The server automatically adjusts the format and layout of the generated documents to conform to the standards of each local government. This ensures that the documents are ready for accurate acceptance.

[0716] 5. Preparing for electronic application

[0717] The server generates the document as an electronic medium and assigns electronic authentication. The user performs a final check on their terminal and authenticates using their My Number (social security number) or electronic seal.

[0718] 6. Online submission

[0719] The completed documents are sent online from the server to the relevant local government's electronic application system. After the application process is complete, a notification of submission completion is displayed on the user's device.

[0720] Specific example

[0721] For example, consider a specific case where a user is handling the death procedures for a parent. The user enters basic information such as the deceased's name, address, and date of birth into their terminal. The server receives the information and automatically transfers it to the "death certificate," "cremation permit," and "inheritance documents." The layout of all documents is automatically adjusted, allowing the user to complete the procedure in just a few steps.

[0722] In this way, the present invention can significantly simplify cumbersome procedural tasks and reduce the user's time and effort.

[0723] The following describes the processing flow.

[0724] Step 1:

[0725] The user logs into the system using their device. Upon successful user authentication, an interface for starting the application process is displayed.

[0726] Step 2:

[0727] The user selects the municipality and type of procedure to apply to. This selection is sent to the server, and processing begins.

[0728] Step 3:

[0729] The server uses generative artificial intelligence to generate a list of required documents based on the selected municipality and procedure. This automatically selects the appropriate documents.

[0730] Step 4:

[0731] Users enter personal information and application details required for all documents into their terminals. This information is sent to and stored on the server.

[0732] Step 5:

[0733] The server automatically transfers the entered information to the necessary documents. This process ensures data consistency across documents.

[0734] Step 6:

[0735] The server automatically adjusts the format and layout of the generated documents to match the standards of each local government. The optimized documents are then provided to the user for review.

[0736] Step 7:

[0737] Users review documents on their devices and make corrections if necessary. These corrections are then reflected on the server.

[0738] Step 8:

[0739] The server applies electronic authentication to the completed documents and prepares them for electronic application. If necessary, the My Number (Social Security Number) is also entered.

[0740] Step 9:

[0741] Based on the user's submission instructions, the server securely transmits the documents online to the local government's submission system. Once the submission is complete, a confirmation notice is sent to the user's device.

[0742] (Example 1)

[0743] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0744] Traditionally, the application process to processing agencies was cumbersome, requiring users to individually create and submit numerous documents. This necessitated multiple data entry and verification steps, and particularly when applying to different agencies, document formats had to be adapted to each agency's specifications. As a result, the overall application process was extremely inefficient, posing a significant challenge for users in terms of time and effort.

[0745] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0746] In this invention, the server includes means for the user to select a processing institution and identify the processing content, means for automatically generating a document list using generative artificial intelligence, means for automatically transferring information to each document, means for automatically adjusting the format and layout, means for the user to perform a final check on the terminal, and means for sending a notification after the application is completed. This enables the user to proceed with the application process efficiently in a consistent flow.

[0747] A "user" refers to an individual or organization that uses the system to submit an application to a processing agency.

[0748] A "processing agency" refers to a public or private institution designated by the user for carrying out the application process.

[0749] "Generative artificial intelligence" refers to artificial intelligence technology that automatically creates a list of necessary documents based on user selections and optimizes the content of each document.

[0750] A "document list" refers to a list of documents required for an application, generated based on the designated processing agency and content.

[0751] "Automatic data entry" refers to a function that accurately reflects common information entered by users into each generated document.

[0752] "Format and layout" refers to the appearance and style of each document in accordance with the requirements of the processing agency.

[0753] "Final confirmation" refers to the process where the user reviews the completed document displayed on their device and makes corrections or approvals as needed.

[0754] "Notification" refers to information that informs the user of the progress or completion of the application process.

[0755] This invention is a system for users to efficiently carry out application procedures to processing agencies. The system consists of a terminal operated by the user, a server that performs data processing, and an interface that the user accesses.

[0756] Users access a dedicated application or website using their device and select the processing agency and procedure. During this process, users undergo authentication and are shown an individual user screen where they enter the necessary common information for the application once.

[0757] The server uses generative artificial intelligence to automatically generate a list of necessary documents based on the selected processing content. The server then automatically transfers user input information to these generated documents and adjusts the format and layout according to the local government's standards. Finally, the server generates the documents as electronic media and adds the necessary electronic authentication.

[0758] Users review documents on their devices and authenticate them using their My Number (social security number) or electronic seal. The authenticated documents are then sent by the server to the appropriate processing authority, and a completion notification is sent to the user's device. This process allows users to complete the application process quickly and accurately.

[0759] As a concrete example, consider a case where a user is handling the inheritance procedures for their parent. The user enters the deceased's basic information into the terminal, and the server automatically transfers this information to "inheritance-related documents," etc. The document layout is adjusted, and the procedure is completed in a few steps.

[0760] An example of a prompt message is, "Please tell me the steps to efficiently carry out the inheritance procedures for my parents." In this way, this invention significantly reduces the user's time and effort.

[0761] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0762] Step 1:

[0763] The user accesses a dedicated application or website using their device. The user enters their login information and is requested to authenticate. The entered authentication information is sent from the device to the server, which compares it with the user database and displays an individual user screen.

[0764] Step 2:

[0765] The user selects the processing authority and procedure type requested from the user interface. The selected information is sent from the terminal to the server, which then begins generating a list of documents necessary for processing. Using a generation AI model, the server outputs a list of necessary documents based on the selected items and returns it to the terminal.

[0766] Step 3:

[0767] The user checks the document list on their terminal and enters the common information required for the application. This entered information is sent from the terminal to the server. The server receives this information, automatically processes the data to transfer it to each document, and outputs an updated document list.

[0768] Step 4:

[0769] The server automatically adjusts the format and layout of each document according to local government standards based on the document list. These adjusted documents are then generated in electronic format and output to the terminal.

[0770] Step 5:

[0771] The user performs a final review of the generated document using the terminal. Upon reviewing the document, the user enters their My Number (Social Security Number) and electronic seal, and adds authentication information. The terminal then sends the authentication data to the server, which completes the electronic authentication.

[0772] Step 6:

[0773] The server sends the authenticated document to the electronic application system of the selected processing agency online. Once the transmission is complete, the server prints a notification of application completion on the terminal. The user receives this notification and confirms that the procedure has been successfully completed.

[0774] (Application Example 1)

[0775] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0776] In various store procedures, there is a need to streamline processes by reducing the time and effort required for users to individually fill out and verify multiple documents. Specifically, it is necessary to eliminate the inefficiency of users repeatedly entering the same information for each procedure, and to complete procedures efficiently and quickly.

[0777] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0778] In this invention, the server includes means for the user to select a procedural agency and specify the procedural content, means for automatically generating a list of necessary documents using generative artificial intelligence, and means for automatically transferring the input common information to multiple documents. This allows the user to reflect information in multiple procedural documents with a single information input, thereby improving the efficiency of procedures in stores.

[0779] "User" refers to a person who uses a system or service, and is the entity that carries out procedures or applications.

[0780] A "procedural agency" refers to an organization or facility that receives and processes procedures and applications submitted by users.

[0781] "Generative artificial intelligence" is a machine learning system that automatically generates documents and information based on specified conditions and inputs.

[0782] A "document list" refers to a list of multiple documents required for the procedure selected by the user.

[0783] "Electronic media" refers to a form of information that is stored and transmitted in digital format, and is a format for managing data electronically.

[0784] "Electronic authentication" refers to authentication information assigned to guarantee the security of documents and data.

[0785] A "terminal" refers to a device that a user uses to access and operate a system.

[0786] To implement this invention, the user first selects the institution to which the procedure is to be performed and identifies the procedure details via a terminal. Typically, a smartphone or tablet is used as the terminal. The terminal accesses the server via a web browser or dedicated application and inputs the information necessary for the procedure.

[0787] The server uses generative artificial intelligence to automatically generate a list of necessary documents based on the input procedural body and procedural details. Advanced generative AI models such as OpenAI's GPT-3 and Google's BERT are used for this generation. This ensures that the most suitable documents are provided for a variety of procedures.

[0788] Next, the server automatically transfers the common information entered by the user into multiple documents. This process frees the user from having to repeatedly enter the same information for each procedure. Furthermore, the server automatically adjusts the format and layout of each document according to the standards of the procedural body, generating documents in the correct format.

[0789] The server also stores the generated documents as electronic media and assigns electronic authentication. This electronic authentication uses specific protocols and technologies to ensure security. The user reviews the document on their terminal and performs final confirmation of the procedure as needed.

[0790] A concrete example is the application for a new membership at a store. In this case, the user simply enters the necessary basic information once using a terminal, and the information is automatically reflected in documents such as contracts and membership information forms. The generated documents are electronically authenticated and formatted in a way that is easy for store staff to review.

[0791] An example of a prompt message might be, "Generate the documents required for a new membership application and automatically fill in all fields using the provided information." This prompt enables accurate and efficient document generation.

[0792] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0793] Step 1:

[0794] The user accesses the application using a terminal and selects the procedural agency and the procedure. The system requires the user's requested procedural information as input. Based on this, the system outputs the user's selected procedural status.

[0795] Step 2:

[0796] The server uses generative artificial intelligence to automatically generate a list of necessary documents based on the information of the procedural body and procedure details received from the user. This process requires data on the procedural body and procedure details as input. The AI ​​model generates the appropriate documents based on prompts and outputs the results.

[0797] Step 3:

[0798] Users enter common information (such as name and address) once via a terminal. This information is reflected in all documents required for the procedure. Common information is required as input, and the output is the information reflected in a unified format in each document.

[0799] Step 4:

[0800] The server uses the received common information to automatically transfer that information to each document. The inputs are the common information and the generated documents, and the output is a document with the information correctly transferred.

[0801] Step 5:

[0802] The server automatically adjusts the format and layout of each document according to the procedural authority's standards. The input is the transcribed document, and the output is a document in a format that conforms to the procedural standards.

[0803] Step 6:

[0804] The server stores the prepared document as an electronic medium and assigns electronic authentication to it. The input is the prepared document, and the output is an authenticated electronic document.

[0805] Step 7:

[0806] The user reviews the document generated on their device, confirms that it is complete, and then submits it. The input is an authenticated electronic document, and the output is the status of the document sent to the procedural authority.

[0807] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0808] This invention is a system that enables users to efficiently and comfortably perform various application procedures with government offices. This system consists of a terminal operated by the user, a server for processing, and a user interface equipped with an emotion engine. The specific implementation of this system is described below.

[0809] overview

[0810] This system, which incorporates an emotion engine, is designed to alleviate the complexity and stress users face when applying to government offices. The emotion engine analyzes the user's emotions from their facial expressions and voice, and helps optimize the process.

[0811] Processing flow

[0812] 1. User actions

[0813] The user logs into the system via their device and selects the municipality and procedure they wish to apply to.

[0814] 2. Recognition of emotions

[0815] The server uses the device's camera and microphone to recognize the user's emotions through an emotion engine and understand the user's emotional state.

[0816] 3. Document generation and emotional feedback

[0817] The server utilizes generative artificial intelligence to create a list of necessary documents and provides appropriate feedback and support based on the user's emotions. For example, if the user is feeling stressed, it will suggest a simplified mode.

[0818] 4. Input and transcription of information

[0819] The user enters personal information into the terminal, and the server automatically transfers this information to the necessary documents. An emotion engine monitors the user's emotions during input and displays support messages if the user appears confused.

[0820] 5. Dynamic adjustment of the interface

[0821] The server dynamically adjusts the user interface based on sentiment analysis. For example, if the user is calm, it continues the process in normal mode, providing an elegant design.

[0822] 6. Electronic application and tracking

[0823] Completed documents are sent to the electronic application system after electronic authentication. Based on this, the server monitors the application status and provides real-time feedback to the user.

[0824] Specific example

[0825] For example, when a user is going through the process of registering the death of a parent, if the user's emotions are frequently perceived as anxiety or sadness, the emotion engine is activated. The server analyzes this and displays concise guides and encouraging messages on the screen. It also provides simple and easy-to-understand explanations for complex parts of the process, minimizing the user's burden.

[0826] Thus, the present invention provides a comfortable procedural experience for users, enabling smoother and more efficient applications through stress reduction.

[0827] The following describes the processing flow.

[0828] Step 1:

[0829] The user accesses the system's login screen using their device, enters their credentials, and is authenticated. Upon successful login, a dedicated interface for starting the application process is displayed.

[0830] Step 2:

[0831] The user selects the municipality and type of procedure they wish to apply to from the interface. This selection information is sent to the server, which then initiates the next step in processing.

[0832] Step 3:

[0833] Based on the received application, the server automatically generates a list of necessary documents using generative artificial intelligence. The document list is displayed on the user's device, allowing them to review and make corrections.

[0834] Step 4:

[0835] The server uses the terminal's camera and microphone to send data on the user's facial expressions and voice to the emotion engine. The emotion engine analyzes the user's emotions and returns the results to the server.

[0836] Step 5:

[0837] The server dynamically adjusts the user interface based on the results of sentiment analysis. For example, if the user is feeling stressed, it simplifies the screen display and shows comforting messages.

[0838] Step 6:

[0839] The user enters common information into the terminal. Once the input is complete, the server automatically transfers this information to the necessary documents, adjusts the document format, and prepares them for printing or electronic submission.

[0840] Step 7:

[0841] The server automatically assigns electronic authentication to the documents and generates them as electronic media with the authentication. The documents are prepared for the applying agency and await user instructions.

[0842] Step 8:

[0843] Once the user instructs the server to complete the process, the server sends the documents to the application agency's online system and verifies whether the transmission was successful. The user is then notified of the result.

[0844] Step 9:

[0845] Users can check the submission status on their devices and track the real-time application status provided by the server. Users are periodically provided with information on the review progress.

[0846] (Example 2)

[0847] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0848] Application procedures at government offices and institutions can be complex and cause significant stress for users. This stress is amplified by numerous steps, including document preparation, information entry, formatting adjustments, and authentication processes. Furthermore, the lack of interface adjustments tailored to the emotional state of individual users results in inefficient and uncomfortable procedures.

[0849] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0850] In this invention, the server includes means for making suggestions to simplify the process when the user feels stressed, based on emotion recognition using the user's facial expressions and voice; means for automatically generating a list of necessary documents using generative artificial intelligence; and means for dynamically adjusting the user interface according to the user's emotional state. This enables an efficient and comfortable application process that takes into account the emotions of individual users.

[0851] A "user" is an individual or organization that completes the application process through the system.

[0852] "Submitting agency" refers to the government office or related organization to which the user submits the application.

[0853] "Submission details" refer to the specific procedures and types of applications that users select when submitting an application.

[0854] "Generative artificial intelligence" is an AI technology that automatically generates appropriate output based on the information presented.

[0855] The "list of required documents" refers to a list of documents necessary for the application process.

[0856] "Emotion recognition" is a technology that analyzes a user's facial expressions and voice to determine their emotional state.

[0857] "User interface" refers to the screens and input methods that users use to interact with the system.

[0858] This invention is a system that allows users to efficiently and comfortably perform various application procedures to government offices and other submission agencies. The system consists of a terminal operated by the user, a server that handles processing, and a user interface that includes an emotion engine.

[0859] The server processes input from the terminal and uses generative artificial intelligence to automatically generate a list of necessary documents based on the submitting institution and the content of the submission. The generative AI model lists appropriate document templates and required information according to the user's prompts. For example, this process begins when the user enters, "Please generate the documents required for the death of my parent."

[0860] The user's emotional state is analyzed by an emotion engine using the camera and microphone connected to the device. If the emotion is recognized as stress or anxiety, the server suggests to the user how to simplify the process. At this time, the user interface is also dynamically adjusted to provide a visually comfortable interface according to the user's emotions.

[0861] Specifically, as the user logs in and proceeds with the application process, the sentiment engine constantly monitors the user's state and displays support messages as needed. The server is equipped with a high-performance database and sentiment analysis software, enabling real-time process optimization. The completed document is generated as an electronic medium and electronically authenticated as needed. Finally, the document is automatically sent to the submitting institution, and the server continues to monitor its progress.

[0862] Through this system, users can complete complex procedures quickly and easily, and receive flexible responses that are tailored to their emotions.

[0863] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0864] Step 1:

[0865] The terminal receives login information from the user. The user enters their ID and password, and the terminal sends this information to the server. The server performs authentication, and if successful, retrieves the user's information and establishes the login status. As output, the terminal displays a user-specific dashboard.

[0866] Step 2:

[0867] The user selects the submitting institution and procedure items on the terminal. The terminal sends the user's selection information to the server. The server verifies the database information related to the submitting institution and procedure items and sends prompts for the necessary document templates to the AI ​​model. The AI ​​model outputs a list of necessary documents and displays them on the terminal via the server.

[0868] Step 3:

[0869] The server uses the terminal's camera and microphone to send the user's facial expressions and voice data to the emotion engine. The emotion engine analyzes the data and recognizes the user's emotional state. The server receives this analysis result and generates feedback and process optimization suggestions tailored to the user's emotions. As output, specific support messages and operational instructions are displayed on the terminal's screen.

[0870] Step 4:

[0871] The user enters the necessary personal information into the terminal, and once completed, the terminal sends the information to the server. The server automatically transfers the received information into a document template. After data processing, it generates a completed application document and displays a confirmation screen on the terminal. After the user reviews it, they make final adjustments to the content.

[0872] Step 5:

[0873] The server dynamically adjusts the user interface design and element layout based on information from the emotion engine. The user interface automatically changes colors and displayed content according to the emotional state, providing an optimized user interface for the device.

[0874] Step 6:

[0875] The completed documents are authenticated by the server using an electronic signature system and sent to the submitting institution's electronic application port. The server monitors the submission progress in real time and outputs information on the application's success or failure and the next steps to the terminal. This allows the user to understand the progress of their application.

[0876] (Application Example 2)

[0877] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0878] Application procedures at government offices are generally complex and stressful. Users are prone to feeling anxious and confused during the process, which reduces the efficiency of the procedures. Therefore, there is a need for a system that supports the procedures based on emotions.

[0879] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0880] In this invention, the server includes means for analyzing the user's psychological state from their facial expressions and voice and presenting information based on the user's psychological state, means for dynamically adjusting the user interface according to the psychological state, and means for automatically generating a list of necessary documents using generative artificial intelligence. This enables the user to proceed with procedures at government offices efficiently and comfortably.

[0881] An "application agency" is a public institution that accepts and manages administrative procedures and related processes.

[0882] "Generative artificial intelligence" refers to artificial intelligence that automatically generates documents and information according to the user's needs.

[0883] The "document list" is a list of all the documents required for the application.

[0884] "Common information" refers to the general personal information and document information of the user that is required for the application process.

[0885] "Electronic media" refers to digital data stored in a format that can be read by computers and digital devices.

[0886] "Electronic authentication" is a procedure for guaranteeing the legitimacy and authenticity of digital data.

[0887] "Psychological state analysis from facial expressions and voice" is a technology that automatically determines a user's psychological state by analyzing their facial expressions and voice tone.

[0888] "Dynamic user interface adjustment" refers to changing the design and operation methods of the display screen in real time according to the user's emotions and state.

[0889] One embodiment of the present invention is a system designed to streamline application procedures at government offices and support users in making decisions comfortably. This system is equipped with an emotion engine and aims to optimize the application process by analyzing the user's facial expressions and voice in real time.

[0890] The server uses the user's camera and microphone to acquire facial expressions and voice data. During this process, it utilizes the "Emotion API" of "Microsoft Azure Cognitive Services" to analyze the user's emotions. Furthermore, it uses the "OpenAI GPT-4 API" to generate appropriate advice and feedback messages based on the user's psychological state.

[0891] The server also uses generative artificial intelligence to automatically create and provide the user with a list of necessary documents based on the application agency and application content selected by the user. Depending on the user's state of mind, the system dynamically adjusts the user interface, presenting a visually easy-to-understand layout and operation guide. For example, if the user feels unsure about the application process, a concise and easy-to-understand explanation will be displayed on the smart glasses' screen, supporting the entire process to proceed smoothly.

[0892] One specific use case is when a user is going to change their address at the city hall and encounters difficulties during the process. In such cases, the glasses can display a message saying, "The process is going smoothly. We will guide you through the next steps," which can help alleviate anxiety.

[0893] Examples of prompt statements to input into the generative AI model are as follows:

[0894] "While the user was going through a procedure at the city hall, emotional data indicating confusion and anxiety was received. Please provide appropriate next steps and advice in gentle language that reflects their state of mind."

[0895] In this way, we provide an environment where users can intuitively understand complex administrative procedures and proceed with confidence.

[0896] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0897] Step 1:

[0898] The user logs into the system via their terminal and selects the relevant application agency and application details. The information entered here includes the user's authentication information and application selection data. Based on this information, the server prepares the application process.

[0899] Step 2:

[0900] The server uses the terminal's camera and microphone to acquire the user's facial expressions and voice data in real time. Based on the acquired data, it uses the "Emotion API" of "Microsoft Azure Cognitive Services" to analyze the user's psychological state. The input is data from the camera and microphone, and the output is an evaluation of the user's emotions.

[0901] Step 3:

[0902] The server utilizes generative artificial intelligence to automatically generate a list of necessary documents based on the application agency and content selected by the user. This process takes the selected application content as input and outputs the generated document list. In this process, it is crucial that the AI ​​provides a fast and accurate list of documents.

[0903] Step 4:

[0904] The server generates appropriate advice and feedback messages for the user based on emotional data analyzed by the Emotion API. To do this, it uses the "OpenAI GPT-4 API" to obtain advice text by inputting emotion-based prompts. The output text is adapted according to the user's psychological state.

[0905] Step 5:

[0906] The server dynamically adjusts the user interface according to the user's psychological state. For example, if the user is feeling anxious, the UI is changed to a simpler, more visually user-friendly one. In this step, emotional data is used as input to adjust UI parameters and output the new interface.

[0907] Step 6:

[0908] The user reviews the document generated on the terminal, performs electronic authentication on the electronically generated document, and sends it to the application agency. The input data consists of the user's review results and document list, and the output is authenticated electronic application data.

[0909] Through this series of processes, users can comfortably proceed with the application process.

[0910] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0911] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0912] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0913] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0914] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0915] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0916] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0917] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0918] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0919] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0920] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0921] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0922] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0923] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0924] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0925] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0926] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0927] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0928] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0929] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0930] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference.

[0931] The following is further disclosed regarding the embodiments described above.

[0932] (Claim 1)

[0933] A means for the user to select the application agency and specify the application details,

[0934] A means for automatically generating a list of necessary documents based on the applicant agency and application content using generative artificial intelligence,

[0935] A means for automatically transferring the entered common information to the necessary documents,

[0936] A means to automatically adjust the format and layout of each document,

[0937] A means for generating the aforementioned document as an electronic medium and assigning electronic authentication,

[0938] A means of transmitting the aforementioned documents to the aforementioned application agency,

[0939] A system that includes this.

[0940] (Claim 2)

[0941] The system according to claim 1, further comprising means for allowing the user to review and modify the aforementioned list of required documents.

[0942] (Claim 3)

[0943] The system according to claim 1, further comprising means for securely managing and applying authentication information for electronic applications to the aforementioned application agency.

[0944] "Example 1"

[0945] (Claim 1)

[0946] A means for the user to select a processing institution and specify the processing details,

[0947] A means for automatically generating a list of necessary documents based on the processing organization and processing content using generative artificial intelligence,

[0948] A means for automatically transferring the entered common information to the necessary documents,

[0949] A means to automatically adjust the formatting and layout of each document,

[0950] A means for generating the aforementioned document in electronic format and assigning electronic authentication,

[0951] Means for transmitting the aforementioned document to the processing organization,

[0952] A means for the user to perform final confirmation and authentication on their device,

[0953] A means of sending a notification to the user after the application is completed,

[0954] A system that includes this.

[0955] (Claim 2)

[0956] The system according to claim 1, further comprising means for allowing the user to review and modify the aforementioned list of necessary documents.

[0957] (Claim 3)

[0958] The system according to claim 1, further comprising means for securely managing and applying authentication information for electronic applications to the aforementioned processing agency.

[0959] "Application Example 1"

[0960] (Claim 1)

[0961] A means for users to select a procedural agency and specify the details of the procedure,

[0962] A means for automatically generating a list of necessary documents based on the procedural body and the content of the procedure using generative artificial intelligence,

[0963] A means for automatically transferring the entered common information to the necessary documents,

[0964] A means to automatically adjust the format and arrangement of each document,

[0965] A means for generating the aforementioned document as an electronic medium and assigning electronic authentication,

[0966] Means for transmitting the aforementioned document to the procedural body,

[0967] To streamline customer procedures at stores, a means is provided that allows users to select procedures via their terminals and reflect the information in multiple documents simultaneously with a single input.

[0968] A system that includes this.

[0969] (Claim 2)

[0970] The system according to claim 1, further comprising means for allowing a user to view and modify the aforementioned list of necessary documents.

[0971] (Claim 3)

[0972] The system according to claim 1, further comprising means for securely managing and applying authentication information for electronic procedures to the aforementioned procedural body.

[0973] "Example 2 of combining an emotion engine"

[0974] (Claim 1)

[0975] A means for users to select a submission institution and specify the content of the submission,

[0976] A means for automatically generating a list of necessary documents based on the submitting institution and the content of the submission using generative artificial intelligence,

[0977] A means for automatically transferring the entered common information to the necessary documents,

[0978] A means for automatically adjusting the formatting and layout of each document,

[0979] A means for generating the aforementioned document in electronic format and assigning electronic authentication,

[0980] Means for transmitting the aforementioned document to the aforementioned submitting institution,

[0981] A means of implementing suggestions to simplify processes when a user experiences stress, based on emotion recognition using the user's facial expressions and voice,

[0982] Means for dynamically adjusting the user interface according to the emotional state of the user,

[0983] A system that includes this.

[0984] (Claim 2)

[0985] The system according to claim 1, further comprising means for a user to review and modify the aforementioned list of necessary documents.

[0986] (Claim 3)

[0987] The system according to claim 1, further comprising means for securely managing and applying authentication information for electronic submission to the aforementioned submitting body.

[0988] "Application example 2 when combining with an emotional engine"

[0989] (Claim 1)

[0990] A means for the user to select the application agency and specify the application details,

[0991] A means for automatically generating a list of necessary documents based on the applicant organization and application content using generative artificial intelligence,

[0992] A means for automatically transferring the entered common information to the necessary documents,

[0993] A means to automatically adjust the format and layout of each document,

[0994] A means for generating the aforementioned document as an electronic medium and assigning electronic authentication,

[0995] Means for transmitting the aforementioned document to the aforementioned applicant agency,

[0996] A means of analyzing the user's psychological state from their facial expressions and voice, and presenting information based on the user's psychological state,

[0997] A means of dynamically adjusting the user interface according to the user's psychological state,

[0998] A system that includes this.

[0999] (Claim 2)

[1000] The system according to claim 1, further comprising means for allowing the user to view and modify the aforementioned list of necessary documents.

[1001] (Claim 3)

[1002] The system according to claim 1, further comprising means for securely managing and applying authentication information for electronic applications to the aforementioned application agency. [Explanation of Symbols]

[1003] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means for the user to select the application agency and specify the application details, A means for automatically generating a list of necessary documents based on the applicant agency and application content using generative artificial intelligence, A means for automatically transferring the entered common information to the necessary documents, A means to automatically adjust the format and layout of each document, A means for generating the aforementioned document as an electronic medium and assigning electronic authentication, A means of transmitting the aforementioned documents to the aforementioned application agency, A system that includes this.

2. The system according to claim 1, further comprising means for allowing the user to review and modify the aforementioned list of required documents.

3. The system according to claim 1, further comprising means for securely managing and applying authentication information for electronic applications to the aforementioned applicant agency.

Images