System

Abstract

A system is provided.SOLUTION: The system includes a user authentication means, a means for analyzing the consultation contents of the user by using generation artificial intelligence and generating a proper response, a means for automatically providing proper administrative service information to a question from the user, a means for allowing the user to upload necessary documents and to complete an application procedure online, and a means for confirming application contents and notifying a progress situation.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Although current government services are increasingly being moved online, the offices where detailed information can be confirmed or consultations are usually only open on weekends. This means that people who have weekends off for work or who have difficulty going out are unable to fully utilize government services. Furthermore, people who have difficulty going out for environmental or physical reasons are also restricted from using government services. There is a need for a system that can solve these problems and allow anyone to easily receive government services at any time. [Means for solving the problem]

[0005] The present invention provides a system that includes a user authentication means, a means for analyzing the content of a user's consultation using generative artificial intelligence and generating an appropriate response, a means for automatically providing appropriate administrative service information in response to a user's question, a means for a user to upload necessary documents and complete application procedures online, and a means for checking the application content and notifying the progress. This system allows users to consult about or apply for administrative services 24 hours a day, regardless of time or location, and provides highly convenient administrative services to a wide range of users, including people who have difficulty going out.

[0006] "User authentication means" means the means used by the system to verify the identity of a user and prevent unauthorized access.

[0007] "Generative AI" is an artificial intelligence technology that learns from large amounts of data and generates optimal responses and information for specific tasks.

[0008] The "means for analyzing the content of the consultation and generating an appropriate response" is a means for analyzing the content of the consultation input by the user and automatically generating an optimal response.

[0009] The "means for providing administrative service information" is a means for automatically searching for and providing administrative service information related to a user's question.

[0010] "Means for completing the application process online" refers to the means by which a user can digitally submit required documents and complete the application process online.

[0011] The "means for checking the application content and notifying the progress status" is a means for checking the content of an accepted application and notifying the user of the progress status.

[0012] "Speech recognition technology" is a technology that converts voice data into text data.

[0013] "Means for learning from past consultation history and optimizing responses" refers to means for analyzing and learning from past consultation data and optimizing responses to future consultations based on that data. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0015] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0018] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0019] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0020] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0022] [First embodiment]

[0023] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0024] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0027] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0030] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0034] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0035] The present invention is a system that allows users to consult about or apply for government services 24 hours a day. This system includes a user authentication means, a response generation means using generative artificial intelligence, a means for providing government service information, a means for supporting online application procedures, and a means for notifying users of progress. The program processing of this system is explained below in natural language.

[0036] Initial Authentication and User Authentication

[0037] Program processing:

[0038] Server: When the system starts up, it initializes the user database and log database and loads various settings. When a user accesses the system, it generates a user authentication screen and sends it to the terminal.

[0039] Terminal: Displays the authentication screen and provides a screen where the user can enter information such as their My Number card and password.

[0040] User: Enter the required authentication information on the authentication screen and press the send button.

[0041] Server: Receives authentication information from the user, compares it with the database, and if authentication is successful, starts a user session. At this time, it reads the user's profile information and prepares for the next process.

[0042] Starting a conversation and listening to the details of your consultation

[0043] Program processing:

[0044] Server: After authentication, a greeting message (e.g., "Hello, what can you help us with?") is generated by the generative AI model and sent to the device.

[0045] Terminal: Displays the chat screen and provides a field for receiving input from the user.

[0046] User: Enters the content of the consultation by text or voice. If voice recognition technology is used, the voice data is converted into text.

[0047] Server: Analyzes the input consultation content and generates the next necessary questions and interview items using a generative AI model. Specifically, it automatically generates appropriate questions based on the consultation content and sends them back to the device.

[0048] Automated responses and appropriate information

[0049] Program processing:

[0050] Server: Based on the user's question or inquiry, the generative AI model generates relevant government service information, including links to relevant web pages, lists of required documents, and procedural details.

[0051] Terminal: The generated information is displayed on the chat screen.

[0052] User: Review the information provided and enter any further questions as needed.

[0053] Server: Responds to follow-up questions from the user and references past consultation history and user profile data to generate optimal responses.

[0054] Guidance and assistance with application procedures

[0055] Program processing:

[0056] Server: Based on the user's inquiry, the AI ​​model generates detailed information about the application procedure. It also generates a list of required documents and procedural steps and sends it to the device.

[0057] Terminal: Displays the documents and procedures required for the application process, helping users to easily proceed with the process.

[0058] User: Check the provided procedure information and prepare the necessary documents. Digital document upload function is also provided.

[0059] Server: When uploading required documents, digital signatures and automatic completion of required information are performed.

[0060] Complete and confirm your online application

[0061] Program processing:

[0062] Server: Receives documents uploaded by users, stores them in a database, and automatically checks the contents of the documents. If there are any errors, the server notifies the user and prompts them to make corrections.

[0063] Terminal: Provides an interface for checking the upload screen and created documents.

[0064] User: Scans or photographs the necessary documents, uploads them to the device, and proceeds with the procedure.

[0065] Progress notification and follow-up

[0066] Program processing:

[0067] Server: Notifies the employee of the details of the accepted application and tracks the progress. If there is a change in the progress, a notification is generated by the AI ​​model and sent to the user's device.

[0068] Terminal: Shows progress updates to the user.

[0069] Users: Ask follow-up questions as needed to check progress.

[0070] This system is designed to enable users to use government services effectively, regardless of time or location, by incorporating voice recognition technology and a response optimization function that learns from past consultation history, thereby providing highly convenient government services to a diverse range of users.

[0071] The processing flow will be explained below.

[0072] Step 1:

[0073] The server starts the system, initializes the user database and log database, and reads various settings.

[0074] Step 2:

[0075] The terminal detects the user's access and displays a user authentication screen.

[0076] Step 3:

[0077] The user enters authentication information such as their My Number card and password on the authentication screen and presses the send button.

[0078] Step 4:

[0079] The server receives the entered authentication information, checks it against a database, and if authentication is successful, starts a user session and loads the profile information.

[0080] Step 5:

[0081] After authentication, the server generates a greeting message (e.g., "Hello, how can I help you?") generated by the AI ​​model and sends it to the device.

[0082] Step 6:

[0083] The terminal displays a chat screen and provides fields for accepting input from the user.

[0084] Step 7:

[0085] The user inputs the content of their inquiry into the chat screen either by text or by voice. If the user inputs voice, it is converted into text using voice recognition technology.

[0086] Step 8:

[0087] The server analyzes the input consultation content and uses a generative AI model to generate optimal questions and hearing items.

[0088] Step 9:

[0089] The device displays the generated question on the chat screen.

[0090] Step 10:

[0091] The user enters the details and submits.

[0092] Step 11:

[0093] The server uses a generative AI model to generate appropriate administrative service information (links to related web pages, lists of required documents, procedural details, etc.) based on user input.

[0094] Step 12:

[0095] The terminal displays the generated information on the chat screen.

[0096] Step 13:

[0097] The user reviews the information provided and enters further questions if necessary.

[0098] Step 14:

[0099] To respond to additional questions, the server refers to the generative AI model, past consultation history, and profile data to generate the optimal response.

[0100] Step 15:

[0101] The device displays the additional response on the chat screen.

[0102] Step 16:

[0103] The user checks the application procedure information provided and prepares the necessary documents.

[0104] Step 17:

[0105] The server generates a list of documents and procedures required for the procedure and sends it to the terminal.

[0106] Step 18:

[0107] The device will display detailed information about the application process (document list, instructions, etc.).

[0108] Step 19:

[0109] The user scans or photographs the required documents and uploads them.

[0110] Step 20:

[0111] The server receives the uploaded documents, stores them, automatically checks their contents, and generates notifications if there are any errors.

[0112] Step 21:

[0113] The terminal displays the results of automatic document checks and correction requirements.

[0114] Step 22:

[0115] The user corrects the document as needed and re-uploads it.

[0116] Step 23:

[0117] The server accepts the application and notifies the relevant staff of the progress.

[0118] Step 24:

[0119] The server tracks the progress of the application, and if there are any changes, a generative AI model generates a notification and sends it to the device.

[0120] Step 25:

[0121] The device will display progress updates to the user and update them if further notices arise.

[0122] Step 26:

[0123] Users can check in on progress and ask additional questions or follow up as needed.

[0124] Example 1

[0125] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0126] Today's busy lives demand systems that enable users to access government services quickly and efficiently. However, current systems struggle to consistently and efficiently handle user authentication, analysis of consultation content, generation of appropriate responses, document upload and application completion, and progress notifications. Another challenge is properly converting users' voice input into text and providing appropriate responses based on the consultation content. Furthermore, there is a need to utilize past consultation history to improve the accuracy of responses to users.

[0127] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0128] In this invention, the server includes means for user authentication, means for analyzing the user's consultation content using a generation artificial intelligence and generating an appropriate response, means for automatically providing appropriate administrative information in response to questions from the user, means for the user to upload necessary documents and complete the application procedure online, means for checking the application content and notifying the progress, means for the generation artificial intelligence to generate a greeting message after authentication and send it to the terminal, means for analyzing the received consultation content and automatically generating the next necessary question using the generation artificial intelligence, and means for automatic checking and electronic signature.This enables users to efficiently consult or apply for administrative services 24 hours a day, and realizes the generation of optimal responses using voice input and past consultation history.

[0129] "User authentication" is the process of verifying the identity of a user accessing a system.

[0130] "Generative AI" is an AI technology that analyzes input data and generates appropriate responses.

[0131] "Analysis of consultation content" is a process for processing the consultation content entered by the user and understanding its meaning and requirements.

[0132] "Generating an appropriate response" is a procedure for automatically creating the most appropriate response to the user based on the analyzed consultation content.

[0133] "Administrative information" refers to information about various services and procedures provided by the government and local governments.

[0134] "Document upload" refers to the act of a user submitting the required documents in digital form to the system.

[0135] "Completing an application" is the process by which a user completes a particular administrative procedure by submitting the required documents and providing the required information.

[0136] "Progress notification" means informing the user of the progress of the application procedure.

[0137] The "greeting message" is the first message that the system sends to the user, and usually includes content that asks the user what they want to discuss.

[0138] "Automatic question generation" is the process in which artificial intelligence automatically creates the next necessary question based on the user's consultation content.

[0139] "Automatic check" is a procedure in which the system automatically verifies the contents of submitted documents.

[0140] An "electronic signature" is a digital signature that ensures the authenticity of a document and the identity of its sender.

[0141] The present invention is a system that allows users to consult about or apply for government services 24 hours a day. This system includes a user authentication means, a response generation means using artificial intelligence, a government information provision means, an online application procedure support means, and a progress notification means. Specific embodiments of this system are described below.

[0142] User authentication methods

[0143] First, when a user accesses the system, the server generates a user authentication screen and sends it to the terminal. The terminal displays the authentication screen and provides an interface for the user to enter their My Number card and password. When the user enters and submits their authentication information, the server receives it and compares it with the user database. If authentication is successful, the server starts a user session and loads their profile information.

[0144] Response generation method using generative artificial intelligence

[0145] Once authentication is complete, the server uses generative AI (e.g., ChatGPT) to generate a greeting message and send it to the device. For example, it generates a message like, "Hello, what would you like to discuss?" The device displays this message on the chat screen and provides a field for the user to enter the content of their consultation. Once the user enters the content of their consultation, the server receives it, analyzes it using a generative AI model, and automatically generates the next necessary question.

[0146] Administrative information provision means

[0147] The server generates relevant administrative information based on the user's question or inquiry using a generative AI model (e.g., BERT). This information includes links to related web pages, a list of required documents, and details of procedures. The generated information is sent to the device, which then displays it on the chat screen.

[0148] Online application procedure support

[0149] A particularly important process occurs when a user uploads the required documents. The device provides a digital document upload function and sends the documents prepared by the user to the server. The server receives the uploaded documents, applies the necessary digital signatures, and automatically checks the contents of the documents. If any required information is missing or incomplete, the server sends a notification to the user prompting them to make corrections.

[0150] Progress notification method

[0151] The server notifies the employee of the accepted application and tracks its progress. If there are any changes in the progress, the server generates the content using a generative AI model and notifies the user. The terminal displays the latest progress to the user. The user can ask additional questions as needed to check the progress.

[0152] Hardware and software used

[0153] The hardware includes high-performance server computers and dedicated database servers, while the software includes generative AI models (e.g., ChatGPT, BERT, etc.), speech recognition technology, natural language processing engines, and digital signature technology.

[0154] Examples and prompts

[0155] For example, if the device displays "Hello, what would you like to discuss?", the user can enter "Please tell me about the procedures for childcare support." The server analyzes this input, generates the next question, "Please tell me the ages of your children," and sends it back to the device. The server then displays the generated detailed procedure information and a list of required documents on the device, helping the user to easily complete the procedures.

[0156] As described above, the present invention is designed to enable users to efficiently use government services without being restricted by time or location, allowing users to quickly and accurately complete government procedures online.

[0157] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0158] Step 1:

[0159] The server generates a user authentication screen and sends it to the terminal.

[0160] Input: System startup and user access

[0161] Output: Authentication screen

[0162] Specific operation: The server initializes the user database and log database, reads the settings, then generates a user authentication screen and sends it to the terminal.

[0163] Step 2:

[0164] The terminal displays a user authentication screen and provides an interface for the user to enter their My Number card and password.

[0165] Input: Authentication screen from the server

[0166] Output: Authentication entry screen shown to the user

[0167] What happens: The device renders "login.html" and displays it to the user, providing fields where the user can enter their authentication information.

[0168] Step 3:

[0169] The user enters their My Number card information and password and presses the send button.

[0170] Input: Information to be entered on the authentication screen

[0171] Output: Authentication information sent to the server

[0172] Specific operations: The user holds their My Number card over the reader, enters the PIN code, and presses the send button.

[0173] Step 4:

[0174] The server checks the received authentication information against a user database, and if authentication is successful, starts a user session.

[0175] Input: Credentials from the user

[0176] Output: Authentication result and session start

[0177] Specific behavior: The server checks the authentication information against "users_db" and, if successful, generates a session ID and loads the profile information.

[0178] Step 5:

[0179] The server uses artificial intelligence to generate a greeting message and sends it to the terminal.

[0180] Input: Session information after authentication is complete

[0181] Output: Greeting message

[0182] Specific behavior: Use a generative AI model (e.g., ChatGPT) to generate a message saying "Hello, how can I help you?" and send it to the device.

[0183] Step 6:

[0184] The terminal displays a chat screen and provides a field where the user can enter the content of the consultation.

[0185] Input: Greeting message from the server

[0186] Output: The chat screen that the user sees

[0187] Specific behavior: The device displays "chat.html" containing a greeting message and an input field.

[0188] Step 7:

[0189] The user inputs the consultation content by text or voice and presses the send button.

[0190] Input: Enter the consultation details

[0191] Output: Consultation content sent to the server

[0192] Specific operation: The user enters the content of the consultation into the text field and presses the send button, or they can input it by voice. In the case of voice, it is converted into text using voice recognition technology.

[0193] Step 8:

[0194] The server analyzes the consultation content received and uses artificial intelligence to generate the next necessary questions and hearing items.

[0195] Input: User's inquiry

[0196] Output: Next question or hearing item

[0197] Specific operation: The server analyzes the consultation content received using a natural language processing engine and generates the next question using a generative AI model (e.g., ChatGPT).

[0198] Step 9:

[0199] The server uses a generative AI model to generate relevant administrative information based on the user's questions or inquiries, and sends it to the terminal.

[0200] Input: Questions and inquiries from users

[0201] Output:Administrative information

[0202] Specific operation: The server uses a generative AI model (e.g., BERT) to generate relevant web page links, a list of required documents, procedural details, etc., and sends them to the terminal.

[0203] Step 10:

[0204] The terminal displays the generated information on the chat screen.

[0205] Input: Administrative information from the server

[0206] Output: Administrative information displayed to the user

[0207] Specific operation: The device renders "chat.html" containing administrative information and displays it on the chat screen.

[0208] Step 11:

[0209] The user prepares the necessary documents and uploads them via the terminal.

[0210] Input: Required documents

[0211] Output: Digital document sent to the server

[0212] Specific operation: The user scans a document and presses the send button using the device's upload function.

[0213] Step 12:

[0214] The server stores the received documents and performs digital signatures and automatic checks.

[0215] Input: Uploaded digital document

[0216] Output: Confirmation message or correction request notification

[0217] Specific operation: The server saves the document in a database, automatically checks its contents, and if there are any errors, sends a notification to the user to correct them.

[0218] Step 13:

[0219] The server notifies the appropriate staff of accepted applications and tracks their progress.

[0220] Input: Application details

[0221] Output: Progress

[0222] Specific operation: The server notifies the application details to the progress management system, tracks the progress, and notifies the relevant staff of the necessary information.

[0223] Step 14:

[0224] If the server detects any changes in the progress, it generates a notification for the user using the AI ​​model and sends it to the device.

[0225] Input: Progress Change

[0226] Output: Progress notification

[0227] Specific operation: Using a generative AI model (e.g., ChatGPT), a message notifying of progress changes (e.g., "Your application has been accepted. The current progress is ____") is generated and sent to the device.

[0228] Step 15:

[0229] The device displays progress updates to the user.

[0230] Input: Progress notification from the server

[0231] Output: Progress displayed to the user

[0232] Specific behavior: The device renders "progress.html" containing the progress and displays it to the user.

[0233] (Application example 1)

[0234] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0235] Conventional government services have faced challenges, such as users being restricted by time and location, making it difficult to provide 24-hour service. Waiting times at the counter are also common, necessitating greater efficiency. Furthermore, there are limited ways for users to accurately obtain the information they need. Meanwhile, there are also issues with elderly people and those unfamiliar with technology, such as difficulty completing electronic application procedures.

[0236] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0237] In this invention, the server includes a user authentication means, a means for analyzing the content of the user's consultation using artificial intelligence and generating an appropriate response, and a means for automatically providing appropriate administrative service information in response to a question from the user, thereby enabling users to efficiently obtain the information and procedures they need 24 hours a day.

[0238] "User authentication means" refers to a means for identifying and authenticating a user, and examples include facial recognition technology and My Number card reading functions.

[0239] "Generative AI" refers to AI that uses a generative AI model to generate appropriate responses based on user input.

[0240] The "response generation means" is a system component that analyzes the content of the user's consultation and generates an appropriate response based on that analysis.

[0241] The "administrative service information providing means" is a system function that automatically provides information on related administrative services in response to a user's question.

[0242] The "means for completing the application procedure online" is a system function that allows users to upload the necessary documents and complete the application procedure online.

[0243] The "progress status notification means" is a system function for checking the application content and notifying the user of the progress status.

[0244] "Facial recognition technology" is a technology that uses a camera to recognize a user's face and authenticate the user based on this.

[0245] "Real-time response generation means" is a system function that uses a generative AI model to generate a response based on user input in real time.

[0246] A "robot display" is a display device mounted on a robot that visually provides information to the user.

[0247] "Speech recognition technology" is a technology that converts a user's voice into text and analyzes it.

[0248] "Means for learning past consultation history" is a system function that accumulates past consultation details and user interactions and optimizes future responses based on that information.

[0249] This invention is a system that allows users to consult about or apply for government services 24 hours a day. This system includes a user authentication means, a response generation means using generative artificial intelligence, a government service information provision means, an online application procedure support means, and a progress notification means.

[0250] Initial Authentication and User Authentication

[0251] Program processing:

[0252] When the system starts up, the server initializes the user database and log database and loads various settings. When a user accesses the system, it generates a user authentication screen and sends it to the terminal. The terminal displays the authentication screen and provides a screen where the user can enter information such as facial recognition technology and My Number card information. The user enters the necessary authentication information on the authentication screen and presses the send button. The server receives the authentication information from the user, compares it with the database, and if authentication is successful, starts the user session. At this time, it loads the user's profile information and prepares for the next process.

[0253] Starting a conversation and listening to the details of your consultation

[0254] Program processing:

[0255] After authentication, the server generates a greeting message (e.g., "Hello, what would you like to discuss?") using the generative AI model and sends it to the device. The device displays a chat screen and provides a field to receive input from the user. The user inputs the content of the consultation using text or voice. If voice recognition technology is used, the voice data is converted into text. The server analyzes the input consultation content and then generates the necessary questions and hearing items using the generative AI model. Specifically, it automatically generates appropriate questions based on the consultation content and sends them back to the device.

[0256] Automated responses and appropriate information

[0257] Program processing:

[0258] The server uses a generative AI model to generate relevant government service information based on the user's questions and inquiries. This information includes links to relevant web pages, lists of required documents, and detailed procedures. The device displays the generated information on the chat screen. The user can review the information provided and enter further questions as needed. The server responds to the user's additional questions and references past consultation history and user profile data to generate the most appropriate response.

[0259] Guidance and assistance with application procedures

[0260] Program processing:

[0261] Based on the user's inquiry, the server uses a generative AI model to generate detailed information about the applicable application procedure. A list of the required documents and procedural steps is generated and sent to the device. The device displays the documents and procedures required for the application procedure, helping the user to easily proceed with the procedure. The user checks the provided procedural information and prepares the necessary documents. At this time, a function to upload digital documents is also provided. When uploading the required documents, the server automatically completes the required information and digital signatures.

[0262] Complete and confirm your online application

[0263] Program processing:

[0264] The server receives documents uploaded by users, stores them in a database, and automatically checks the contents of the documents. If there are any errors, it notifies the user and prompts them to make corrections. The terminal provides an interface for checking the upload screen and completed documents. The user scans or photographs the necessary documents, uploads them to the terminal, and proceeds with the procedure.

[0265] Progress notification and follow-up

[0266] Program processing:

[0267] The server notifies the responsible employee of the accepted application and tracks its progress. If there is a change in the progress, a notification is generated by the AI ​​model and sent to the user's device. The device displays the latest progress to the user. The user can ask additional questions as needed to check the progress.

[0268] As a concrete example, this system is used in robots installed in brick-and-mortar stores such as city halls. When citizens visit the office, they are authenticated using facial recognition technology, and a generative AI model is used to accept and respond to inquiries in real time. For example, if a user types in "Can you tell me about renewing my passport?", the system generates a response such as "Here is the necessary procedural information. Please see the link:..."

[0269] Example prompt sentence:

[0270] User: What about renewing my passport?

[0271] System: Please refer to this link for passport renewal: [LINK]

[0272] In order to specifically implement the invention, it is necessary to build a system in which various hardware and software work together. The main hardware used includes a robot with a camera, a My Number card reader, a scanner, etc., and the software used includes a generative AI model (e.g., GPT-2), voice recognition technology, and face recognition technology (e.g., the face_recognition library).

[0273] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0274] Step 1:

[0275] When the system starts up, the server initializes the user database and log database and loads various settings. When a terminal accesses the server, the server generates a user authentication screen and sends it to the terminal. The user database stores pre-registered user information, and the log database records past access history and operation logs. This puts the system into a ready state.

[0276] Step 2:

[0277] The device displays the user authentication screen sent from the server. The user is instructed to stand in front of the facial recognition camera, and the system performs facial recognition. A My Number card reader may be used to enter the required authentication information. The input information (face image and My Number card data) is sent to the server.

[0278] Step 3:

[0279] The server receives the authentication information sent from the device and checks it against a user database. It uses facial recognition technology to compare the user's facial image with those in the database. At the same time, it checks the data on the My Number card. If authentication is successful, the server starts a user session and loads the user's profile information. It then sends an authentication success message to the device.

[0280] Step 4:

[0281] After successful authentication, the server uses a generative AI model to generate a greeting message (e.g., "Hello, how can I help you?") and sends it to the device. The greeting message is an important first step in an automated response.

[0282] Step 5:

[0283] The device displays the greeting message sent from the server on the chat screen. The user inputs the content of the consultation by text or voice. In the case of voice input, the device uses voice recognition technology to convert the voice data into text and send it to the server.

[0284] Step 6:

[0285] The server receives the text of the consultation sent by the user and analyzes the content using a generative AI model. Specifically, the generative AI model analyzes the input text and automatically generates the next necessary questions and hearing items. The generated questions and hearing items are then sent back to the device.

[0286] Step 7:

[0287] The terminal displays the questions and hearing items sent from the server on the chat screen and waits for further input from the user. The user inputs additional questions and information as appropriate and sends them from the terminal to the server.

[0288] Step 8:

[0289] The server receives additional questions and information from the user and uses a generative AI model to generate appropriate government service information based on the information. The information includes links to related web pages, lists of required documents, and details of procedures. The generated information is then sent to the device.

[0290] Step 9:

[0291] The terminal displays the information sent from the server on the chat screen. The user checks the provided information and enters further questions as necessary. The server references past consultation history and user profile data to generate the optimal response.

[0292] Step 10:

[0293] Based on the user's inquiry, the server uses a generative AI model to generate detailed information about the application procedure. This generates a list of required documents and procedural steps and sends it to the device. The device then displays the documents and steps required for the application procedure, helping the user to easily proceed with the procedure.

[0294] Step 11:

[0295] The user checks the provided procedure information and prepares the necessary documents. At this time, a digital document upload function is also provided. The user automatically completes the digital signature and necessary information and uploads the documents. The uploaded documents are sent to the server.

[0296] Step 12:

[0297] The server receives documents uploaded by users and stores them in a database. The contents of the documents are automatically checked, and if there are any errors, the user is notified and prompted to make corrections. The user can check the upload screen and created documents from their device and make corrections as necessary.

[0298] Step 13:

[0299] The server notifies the employee of the application and tracks its progress. If there are any changes in the progress, the generative AI model generates a notification and sends it to the terminal. The terminal then displays the latest progress to the user and accepts additional questions as needed.

[0300] Examples:

[0301] If the user types "Tell me about renewing my passport," the system generates a response like "Here's the procedure you need. Please see the link:..."

[0302] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0303] This invention is a system that allows users to consult about or apply for government services 24 hours a day. By combining this system with an emotion engine that recognizes user emotions and optimizes responses, the aim is to provide more flexible and user-friendly services. This system includes a user authentication means, a response generation means using generative artificial intelligence, a means for providing government service information, a means for supporting online application procedures, a progress notification means, and an emotion engine. The program processing of this system is explained below in natural language.

[0304] Initial Authentication and User Authentication

[0305] Program processing:

[0306] The server starts the system, initializes the user database and log database, and loads various settings. When a user accesses the system, it generates a user authentication screen and sends it to the terminal.

[0307] The terminal displays a user authentication screen, providing a screen where the user can enter authentication information such as their My Number card or password.

[0308] The user enters the required authentication information on the authentication screen and presses the send button.

[0309] The server receives authentication information from the user, checks it against a database, and if authentication is successful, starts a user session and loads profile information.

[0310] Starting a conversation and listening to the details of your consultation

[0311] Program processing:

[0312] After authentication, the server generates a greeting message (e.g., "Hello, how can I help you?") generated by the AI ​​model and sends it to the device.

[0313] The terminal displays a chat screen and provides fields for accepting input from the user.

[0314] The user inputs the content of their consultation on the chat screen using text or voice. If voice recognition technology is used, the voice data is converted into text.

[0315] The server analyzes the input consultation content and uses a generative AI model to generate optimal questions and hearing items.

[0316] Emotion recognition and response optimization

[0317] Program processing:

[0318] The server analyzes the user's voice and text inputs and uses an emotion engine to recognize the user's emotions. This emotion data is then reflected in the generation of responses.

[0319] The device displays the generated questions and responses on the chat screen, adjusting the content and tone of the responses depending on the user's emotional state.

[0320] The user enters more information or asks additional questions and submits.

[0321] The server references the emotion engine and past consultation history to optimize the response based on the current emotional state.

[0322] Automated responses and appropriate information

[0323] Program processing:

[0324] The server uses a generative AI model to generate relevant government service information based on the user's inquiry, including links to relevant web pages, lists of required documents, and procedural details.

[0325] The terminal displays the generated information on the chat screen.

[0326] The user reviews the information provided and enters further questions if necessary.

[0327] The server uses generative AI models and emotion engines to generate optimal responses to follow-up questions.

[0328] Guidance and assistance with application procedures

[0329] Program processing:

[0330] Based on the user's inquiry, the server uses a generative AI model to generate detailed information about the application procedure in question, and provides appropriate guidance based on the user's emotions.

[0331] The device displays a list of the documents and procedures required for the application process, making it easier for users to proceed with the process.

[0332] Users can review the provided procedure information and prepare the necessary documents, including the ability to upload digital documents.

[0333] When the server uploads the required documents, it digitally signs them and automatically completes the required information.

[0334] Complete and confirm your online application

[0335] Program processing:

[0336] The server receives documents uploaded by users, stores them in a database, and automatically checks the contents. If there are any errors, the server notifies the user and prompts them to correct them.

[0337] The device provides an interface for viewing the upload screen and created documents.

[0338] The user scans or photographs the necessary documents, uploads them to the device, and proceeds with the procedure.

[0339] Progress notification and follow-up

[0340] Program processing:

[0341] The server notifies the employee of the details of the accepted application and tracks the progress. If there are any changes in the progress, a notification based on the generative AI model and emotion data is sent to the device.

[0342] The device will display progress updates to the user and update them if further notices arise.

[0343] Users can check in on progress and ask additional questions or follow up as needed.

[0344] In this way, a system incorporating an emotion engine can respond in a way that is sensitive to the user's emotions, improving the user experience and providing more satisfying government services.

[0345] The processing flow will be explained below.

[0346] Step 1:

[0347] The server starts the system, initializes the user database and log database, and reads various settings.

[0348] Step 2:

[0349] The terminal detects the user's access and displays a user authentication screen.

[0350] Step 3:

[0351] The user enters authentication information such as their My Number card and password on the authentication screen and presses the send button.

[0352] Step 4:

[0353] The server receives the entered authentication information, checks it against a database, and if authentication is successful, starts a user session and loads the profile information.

[0354] Step 5:

[0355] After authentication, the server generates a greeting message (e.g., "Hello, what can you help us with?") generated by the generative AI model and sends it to the device.

[0356] Step 6:

[0357] The terminal displays a chat screen and provides fields for accepting input from the user.

[0358] Step 7:

[0359] The user inputs the content of their inquiry on the chat screen either by text or by voice. In the case of voice input, the voice input is converted into text using voice recognition technology.

[0360] Step 8:

[0361] The server analyzes the input consultation content and uses a generative AI model to generate appropriate questions and hearing items.

[0362] Step 9:

[0363] The device displays the generated question on the chat screen.

[0364] Step 10:

[0365] The user enters the details and submits.

[0366] Step 11:

[0367] The server collects user input and uses an emotion engine to analyze the user's emotions. Based on the results, it generates an optimal response according to the user's emotional state.

[0368] Step 12:

[0369] The device displays the generated response on the chat screen, adjusting the content and tone of the response depending on the user's emotional state.

[0370] Step 13:

[0371] The user reviews the information provided and enters further questions if necessary, during which sentiment is again analyzed.

[0372] Step 14:

[0373] The server refers to the emotion engine and past consultation history based on additional questions or consultation content, optimizes the response, and then sends it.

[0374] Step 15:

[0375] The device will display an optimized response on the chat screen.

[0376] Step 16:

[0377] The user checks the application procedure information provided and prepares the necessary documents.

[0378] Step 17:

[0379] The server generates a list of documents and procedures required for the procedure and sends it to the terminal.

[0380] Step 18:

[0381] The device will display detailed information about the application process (document list, instructions, etc.).

[0382] Step 19:

[0383] The user scans or photographs the required documents and uploads them.

[0384] Step 20:

[0385] The server receives the uploaded documents, stores them, and automatically checks their contents. If there are any errors, it notifies the user and prompts them to correct them.

[0386] Step 21:

[0387] The terminal displays the results of automatic document checks and correction requirements.

[0388] Step 22:

[0389] The user corrects the document as needed and re-uploads it.

[0390] Step 23:

[0391] The server accepts the application and notifies the relevant staff of the progress.

[0392] Step 24:

[0393] The server tracks the progress of the application, and if there is a change in the progress, it generates a notification based on the emotion data and sends it to the device.

[0394] Step 25:

[0395] The device will display progress updates to the user and update them if further notices arise.

[0396] Step 26:

[0397] The user checks the progress and asks additional questions or follow-ups as needed. Again, the emotion engine performs sentiment analysis based on the user's input and generates an appropriate response.

[0398] In this way, administrative services can be provided in a way that is in tune with the user's feelings, and it is expected that user satisfaction will increase.

[0399] Example 2

[0400] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0401] Current government services are time-constrained for users, and they are unable to make consultations or applications, especially outside of office hours. It is also difficult for users to check the progress of documents and procedures submitted in real time. Furthermore, standardized responses are provided without consideration for users' feelings, resulting in low satisfaction for many users. The present invention aims to solve these problems.

[0402] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0403] In this invention, the server includes a user authentication means, a means for analyzing the content of the user's consultation using generative artificial intelligence and generating an appropriate response, a means for automatically providing appropriate information in response to a user's question, an online processing means for the user to upload necessary documents and complete the application procedure, a means for checking the application content and notifying the progress, and a means for recognizing the user's emotions and optimizing the response. This allows users to access government services 24 hours a day, check the progress in real time, and receive responses that are sensitive to their emotions.

[0404] "User authentication means" refers to a means for verifying that a user has legitimate access rights by entering authentication information such as a My Number card or password when accessing a system.

[0405] "Generative AI" is an AI technology that uses a generative AI model to analyze input data and automatically generate the optimal response for the user.

[0406] The "means for analyzing the consultation content and generating an appropriate response" is a means for analyzing the consultation content input by the user and generating appropriate questions and answers according to the content.

[0407] A means for providing "appropriate information" is a means for searching and providing the most appropriate information in response to a user's question.

[0408] "Online processing means for uploading required documents and completing application procedures" refers to a means by which a user uploads the documents required to complete the application procedures online and processes those documents within the system.

[0409] The "means for checking application content and notifying progress status" is a means for tracking the application content submitted by the user and notifying the user of the progress status in real time.

[0410] "Means for recognizing emotions and optimizing responses" refers to means for recognizing a user's emotions by analyzing voice data and text, and providing an optimal response according to those emotions.

[0411] The present invention is a system that allows users to consult about or apply for government services 24 hours a day. This system includes a user authentication means, a response generation means using a generative AI model, an appropriate information provision means, an online application procedure means, a progress notification means, and an emotion recognition means. The specific processing of each means is explained below.

[0412] User authentication method

[0413] When the system starts up, the server initializes the user database and log database and loads various settings. When a user accesses the system, the server generates an authentication screen and sends it to the terminal. The terminal displays the authentication screen, and the user enters authentication information such as their My Number card or password. When the user submits the authentication information, the server verifies it, and if successful, starts a user session and loads the profile information.

[0414] Response generation method using generative AI model

[0415] After the user is authenticated, the server uses a generative AI model to generate a greeting message and sends it to the device. The device then displays a chat screen and accepts user input. When the user inputs their consultation details via text or voice, the server analyzes them and generates the most appropriate questions and questions to ask. For example, it generates a message such as "Hello, what would you like to discuss?"

[0416] Appropriate means of providing information

[0417] Based on the user's inquiry, the server uses a generative AI model to generate relevant government service information. This includes links to related web pages, lists of required documents, and detailed procedures. The generated information is sent to the terminal so that the user can review it. If the user enters further questions, the server will also use the generative AI model to generate optimal responses to those additional questions.

[0418] Online application procedures

[0419] Documents submitted by users are uploaded from their devices to the server. The server stores the uploaded documents in a database and performs automatic checks. If there are any deficiencies, the user is notified and prompted to make corrections. Details of online applications are automatically filled in with digital signatures and required information.

[0420] Progress notification method

[0421] The server notifies the responsible employee of accepted applications and tracks their progress. Any changes in progress are notified to the device based on the generative AI model and emotion data. The device displays the latest progress to the user and updates them with any further notifications. The user can view the progress and ask additional questions or follow up as needed.

[0422] emotion recognition means

[0423] The server analyzes the user's voice and text inputs and uses an emotion engine to recognize the user's emotions. The emotion data is then used to generate responses. For example, if the server detects that the user is feeling anxious, it will generate a more reassuring response.

[0424] Examples:

[0425] If a user wants to apply for a copy of their resident registration card, they input a prompt sentence such as, "Hello, I would like to get a copy of my resident registration card. How do I do this?" The system uses an emotion engine to return a response that increases the user's sense of security. For example, the system might generate a response such as, "Don't worry, we'll guide you through the necessary steps."

[0426] The above is a specific embodiment of the system of the present invention. This system allows users to use government services 24 hours a day while receiving compassionate support.

[0427] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0428] Specific flow of processing steps

[0429] Initial Authentication and User Authentication

[0430] Step 1: Start the system and initialize the database

[0431] The server starts the system.

[0432] The server initializes the user database and log database and loads various settings.

[0433] Input: System startup command

[0434] Output: Initialized database and loaded settings

[0435] Step 2: Generate and send the authentication screen

[0436] The server detects user access and generates an authentication screen.

[0437] The server sends an authentication screen to the terminal.

[0438] Specific operation: Generates an HTML template for the authentication screen and constructs an HTTP response.

[0439] Input: User access data

[0440] Output: HTML data of the authentication screen

[0441] Step 3: Enter and submit your credentials

[0442] The device displays an authentication screen and provides fields for entering authentication information.

[0443] The user enters authentication information such as their My Number card and password and presses the send button.

[0444] Specific operation: Validates the input form and processes the submission of authentication information.

[0445] Input: User credentials

[0446] Output: Sending authentication information to the server

[0447] Step 4: Verify credentials and start a session

[0448] The server receives authentication information from the user and checks it against a database.

[0449] If authentication is successful, the server starts a user session and loads profile information.

[0450] Specific operation: Runs the authentication information matching algorithm and initializes session information.

[0451] Input: User credentials

[0452] Output: Authentication result and session ID

[0453] Starting a conversation and listening to the details of your consultation

[0454] Step 5: Generate and send a greeting message

[0455] After authentication, the server uses a generative AI model to generate a greeting message (e.g., "Hello, how can I help you?").

[0456] The server sends a greeting message to the terminal.

[0457] Specific operation: Call the generative AI model and generate an appropriate message.

[0458] Input: User authentication success data

[0459] Output: Greeting message

[0460] Step 6: Display the chat screen and accept input

[0461] The terminal displays a chat screen and provides fields for the user to enter information.

[0462] The user inputs the consultation content by text or voice.

[0463] Specific operation: Renders the chat interface and accepts user input.

[0464] Input: Greeting message

[0465] Output: User input data

[0466] Step 7: Analyzing the consultation content and generating questions

[0467] The server analyzes the input consultation content and uses a generative AI model to generate optimal questions and hearing items.

[0468] The server sends the generated question to the terminal.

[0469] Specific operation: Analyzes using natural language processing algorithms and generates a response from a generative AI model.

[0470] Input: User's inquiry

[0471] Output: Generated questions

[0472] Emotion recognition and response optimization

[0473] Step 8: Sentiment analysis and response adjustment

[0474] The server analyzes the voice and text input from the user and recognizes the user's emotions using an emotion engine.

[0475] The server adjusts the content and tone of the response based on the emotional data.

[0476] Specific operations: Executes sentiment analysis algorithm and adjusts parameters for response generation.

[0477] Input: User input data and sentiment analysis results

[0478] Output: Adjusted response

[0479] Step 9: Viewing Optimized Questions

[0480] The device displays the generated questions and responses on the chat screen.

[0481] The user enters more information or a follow-up question and submits.

[0482] Specific operation: Update the chat interface and re-process input.

[0483] Input: Adjusted response

[0484] Output: Additional user input data

[0485] Step 10: Continuously optimize your response

[0486] The server references the emotion engine and past consultation history to continually optimize responses based on the current emotional state.

[0487] Specific operations: Refer to the history database and evaluate emotion data.

[0488] Input: User's emotional data and past consultation history

[0489] Output: Optimal response reflecting current emotional state

[0490] Automated responses and appropriate information

[0491] Step 11: Generate and send relevant information

[0492] The server generates relevant administrative service information using a generative AI model based on the user's consultation content and sends it to the terminal.

[0493] What it does: Uses generative AI models to find and generate relevant information.

[0494] Input: User's inquiry

[0495] Output: Relevant information (e.g., list of required documents, details of procedure)

[0496] Step 12: View and verify information

[0497] The terminal displays the generated information on the chat screen.

[0498] The user reviews the information provided and enters any additional questions.

[0499] Specific operation: Renders the generated information and accepts user input.

[0500] Input: Generated related information

[0501] Output: Additional user input data

[0502] Step 13: Generate additional questions and responses

[0503] The server uses the generative AI model and emotion engine to generate the optimal response to the user's follow-up question and sends it to the device.

[0504] Specific action: The generative AI model is called again to generate an appropriate response.

[0505] Input: User's additional question

[0506] Output: The generated response

[0507] Guidance and assistance with application procedures

[0508] Step 14: Generate and display application information

[0509] Based on the consultation content, the server uses a generative AI model to generate detailed information about the relevant application procedure and sends it to the terminal.

[0510] The device will display a list of the documents and procedures required for the application process.

[0511] Specific operation: Use a generative AI model to generate and list application procedure information.

[0512] Input: User's inquiry

[0513] Output: Detailed information on application procedures

[0514] Step 15: Check and prepare your procedures

[0515] The user checks the provided procedure information and prepares the necessary documents.

[0516] The terminal provides the function of uploading digital documents.

[0517] Specific operation: Displays procedural information and provides an upload interface.

[0518] Input: Application procedure details

[0519] Output: User-prepared document data

[0520] Step 16: Upload documents and auto-complete

[0521] The user scans or photographs the required documents and uploads them to the device.

[0522] The server receives the uploaded documents, stores them in a database, and performs digital signatures and auto-completes required information.

[0523] Specific Actions: Receives uploaded documents, adds digital signatures, and handles auto-completion.

[0524] Input: User document data

[0525] Output: Saved data and completed information

[0526] Complete and confirm your online application

[0527] Step 17: Automatically check and save application details

[0528] The server stores the uploaded documents in a database and automatically checks their contents.

[0529] If there is an error, the server will notify the user and prompt them to correct it.

[0530] Specific operations: Automatically verify document contents and generate notices of deficiencies.

[0531] Input: Uploaded documents

[0532] Output: Verification results and deficiency notices

[0533] Step 18: Display the application screen

[0534] The device provides an interface for viewing the upload screen and created documents.

[0535] Specific operation: Renders the document confirmation interface.

[0536] Input: Application procedure progress

[0537] Output: Check interface

[0538] Step 19: Completion of the procedure

[0539] The user uploads the necessary documents and proceeds with the process.

[0540] Specific operations: Accepts user input and manages document progress.

[0541] Input: Prepared document data

[0542] Output: Application in progress

[0543] Progress notification and follow-up

[0544] Step 20: Communicate and track progress

[0545] The server notifies the appropriate staff of accepted applications and tracks their progress.

[0546] If there is a change in progress, a notification based on the generative AI model and emotion data is sent to the device.

[0547] What it does: Tracks progress and generates notification messages.

[0548] Input: Received application details and progress data

[0549] Output: Progress notification

[0550] Step 21: View and Update Progress

[0551] The device will display progress updates to the user and update them with any notifications.

[0552] What it does: Displays progress data and updates the interface.

[0553] Input: Progress notification

[0554] Output: Latest progress

[0555] Step 22: Follow up

[0556] Users can check in on progress and ask additional questions or follow up as needed.

[0557] Specific operation: Accepts user input and sends it to the server.

[0558] Input: User's follow-up question

[0559] Output: Query data sent to the server

[0560] This process flow allows users to use government services smoothly while receiving emotionally sensitive responses.

[0561] (Application example 2)

[0562] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0563] In the field of government services, there is a demand for systems that allow users to make inquiries or applications 24 hours a day. However, conventional systems do not provide responses that take into account the user's emotional state, and in many cases, they are unable to fully resolve their anxieties or questions. Similar problems exist with security-related inquiries, and in order to improve user satisfaction, it is necessary to optimize responses that take emotions into account.

[0564] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0565] In this invention, the server includes a user authentication means, a means for analyzing the content of the user's consultation using a generative artificial intelligence and generating an appropriate response, and a means for recognizing the user's emotions using an emotion engine and optimizing the response, thereby making it possible to provide an optimal response according to the user's emotional state.

[0566] "User authentication means" refers to a means for verifying the identity of a user when the user accesses the system.

[0567] "Generative AI" is AI that analyzes user input information and generates an appropriate response to it.

[0568] The "administrative service information providing means" is a means for automatically providing information on relevant administrative services in response to a user's question.

[0569] "Online application procedure means" refers to the means by which a user can upload the necessary documents and complete the application procedure online.

[0570] The "progress status notification means" is a means for checking the application contents and notifying the user of the progress status.

[0571] An "emotion engine" is a technology for recognizing a user's emotions and optimizing responses.

[0572] "Speech recognition technology" is a technology that converts a user's voice input into text and analyzes the content.

[0573] The "means for learning past consultation history" is a means for learning the contents of the user's past consultations and optimizing the current response based on the learned contents.

[0574] The "security-related consultation response means" is a means for recognizing emotions and generating an optimal response to security-related inquiries from users.

[0575] This invention is a system that allows users to make inquiries and applications regarding government services and security 24 hours a day. The system includes a user authentication means, a generative artificial intelligence, a government service information providing means, an online application procedure means, a progress notification means, and an emotion engine.

[0576] 1. User authentication method

[0577] The server starts the system, initializes the user database and log database, and loads various settings. The terminal displays the user authentication screen, and the user enters authentication information such as their My Number card or password. The server compares this authentication information with the database, and if authentication is successful, the user session begins.

[0578] 2. Generative Artificial Intelligence

[0579] After authentication, the server uses an AI model to generate a greeting message (e.g., "Hello, what can I help you with?") and sends it to the device. The device displays a chat screen and accepts input from the user via text or voice. The server analyzes the input and generates the optimal response.

[0580] 3. Emotion Engine

[0581] The server analyzes the user's voice and text inputs and uses an emotion engine to recognize the user's emotions. This emotion data is reflected in response generation, providing the optimal response according to the user's emotional state.

[0582] 4. Means of providing information on administrative services

[0583] Depending on the user's inquiry, the server generates relevant administrative service information, including links to related web pages, a list of required documents, and detailed procedures. The device displays the generated information on the chat screen.

[0584] 5. Online application procedures

[0585] When the user checks the information provided and prepares the necessary documents, a digital document upload function is provided. The server receives the uploaded documents, stores them in a database, and automatically checks their contents. If there are any deficiencies, the user is notified and prompted to make corrections.

[0586] 6. Progress Notification Methods

[0587] After the application is accepted, the server tracks the progress and sends notifications of any changes to the device, which displays the latest progress to the user and updates them with any further notifications.

[0588] Specific hardware and software

[0589] The system uses the following hardware and software:

[0590] Server: Hosts the main part of the system and holds the user database, log database, and AI model.

[0591] Device: Provides the user interface and accepts user input. This can be a smartphone, PC, tablet, etc.

[0592] Generative AI model: A machine learning model that analyzes the user's inquiry content and generates the optimal response.

[0593] Emotion engine: A software module for analyzing user emotions and reflecting them in responses.

[0594] Speech recognition technology: Technology for converting a user's voice input into text.

[0595] Examples of specific examples and prompts

[0596] For example, if a user asks, "I've been seeing suspicious cars around my house lately. What should I do?" the emotion engine will recognize the anxiety and provide a reassuring response such as, "It's natural to be worried. We recommend that you report the suspicious vehicle to the nearest police station. You may also want to consider installing surveillance cameras around your home."

[0597] Prompt Sentence Examples

[0598] Understand the user's concerns and generate the best response to alleviate their fears and worries. For example, if the user is reporting seeing a suspicious car, tailor your response using the following criteria:

[0599] 1. If you're feeling anxious, use a reassuring tone.

[0600] 2. Providing specific measures and information.

[0601] You are an AI assistant that understands emotions, so respond appropriately.

[0602] In this way, this system, which combines an emotion engine, enables responses that are sensitive to the user's emotions, improving the user experience.

[0603] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0604] Step 1:

[0605] The server starts the system, initializes the user database and log database, and reads various settings. This generates a user authentication screen and sends it to the terminal. The inputs are the server configuration file and the initial database information, and the output is the user authentication screen. Specific operations include establishing a database connection, reading the configuration file, and executing the screen generation algorithm.

[0606] Step 2:

[0607] The terminal displays a user authentication screen, and the user enters authentication information such as their My Number card or password. This input information is sent to the server. The input is the user's authentication information, and the authentication information is sent to the server as output. Specifically, the system displays a user interface and provides input fields.

[0608] Step 3:

[0609] The server receives authentication information from the user, compares it with the database, and if authentication is successful, starts a user session and loads profile information. The input is the user's authentication information, and the output is the authentication result and user profile information. Specific operations include querying the database, running the authentication algorithm, and generating session information.

[0610] Step 4:

[0611] The server generates a greeting message generated by an AI model and sends it to the device. The input is user profile information, and the output is the greeting message. Specific operations include calling the AI ​​model, running the message generation process, and sending the message to the device.

[0612] Step 5:

[0613] The terminal displays a chat screen and provides a field to accept input from the user. When the user inputs the content of their consultation by text or voice, the voice data is converted into text. The input is the user's consultation content, and the text version of the consultation content is generated as the output. Specific operations include displaying the chat screen and converting the voice data into text using voice recognition technology.

[0614] Step 6:

[0615] The server analyzes the input consultation content and uses a generative AI model to generate optimal questions and hearing items. The input is the text of the consultation content, and the output is the generation of optimal questions and hearing items. Specific operations include analyzing the consultation content, calling the AI ​​model, and the question generation process.

[0616] Step 7:

[0617] The server analyzes the user's voice and text input and recognizes the user's emotions using an emotion engine. This emotion data is reflected in the generation of a response. The input is the user's voice or text data, and the output is emotion data and a response. Specific operations include analyzing the voice and text input, calling the emotion engine, and the response generation process.

[0618] Step 8:

[0619] The device displays the generated questions and responses on the chat screen. At this time, the content and tone of the responses are adjusted according to the user's emotional state. The inputs are emotional data and question and response data, and the adjusted responses are displayed on the chat screen as the output. Specific operations include updating the chat screen and adjusting the responses based on the emotional data.

[0620] Step 9:

[0621] The server generates relevant administrative service information based on the user's consultation content and sends it to the terminal. The queried administrative service information is the input, and the generated information is sent to the terminal as the output. Specific operations include querying the administrative service database, information generation process, and sending the information to the terminal.

[0622] Step 10:

[0623] The device checks the provided information and inputs further questions as necessary. In response, the server generates an optimal response using the generative AI model and emotion engine. The input is additional question information, and the output is the generated response. Specific operations include processing the input of the question, calling the AI ​​model and emotion engine, and generating a response.

[0624] Step 11:

[0625] The server generates detailed information about the application procedure in question based on the user's consultation content and provides appropriate guidance according to the user's emotions. The input is the user's consultation content and emotion data, and the output is detailed information and guidance according to the emotion. Specific operations include analyzing the consultation content, generating procedure information, and generating guidance based on the emotion data.

[0626] Step 12:

[0627] When the server uploads a required document, it automatically completes the required information and adds a digital signature. The input is the document information uploaded by the user, and the output is a document with a digital signature. Specific operations include receiving and saving the document, applying the auto-completion algorithm, and adding a digital signature.

[0628] Step 13:

[0629] The server notifies the employee in charge of the accepted application details and tracks the progress. If there is a change in the progress, a notification based on the generative AI model and emotion data is sent to the terminal. The inputs are the application details and progress data, and notification data is generated as the output. Specific operations include checking the application details, tracking the progress, and generating notification data.

[0630] Step 14:

[0631] The terminal displays the latest progress to the user and updates it when further notifications are received. The input is progress notification data, and the output is the updated progress. Specific operations include updating the progress display, receiving notification data, and displaying it.

[0632] The above is the specific processing flow of this system.

[0633] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0634] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0635] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0636] [Second embodiment]

[0637] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0638] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0639] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0640] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0641] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0642] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0643] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0644] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0645] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0646] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0647] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0648] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0649] The present invention is a system that allows users to consult about or apply for government services 24 hours a day. This system includes a user authentication means, a response generation means using generative artificial intelligence, a means for providing government service information, a means for supporting online application procedures, and a means for notifying users of progress. The program processing of this system is explained below in natural language.

[0650] Initial Authentication and User Authentication

[0651] Program processing:

[0652] Server: When the system starts up, it initializes the user database and log database and loads various settings. When a user accesses the system, it generates a user authentication screen and sends it to the terminal.

[0653] Terminal: Displays the authentication screen and provides a screen where the user can enter information such as their My Number card and password.

[0654] User: Enter the required authentication information on the authentication screen and press the send button.

[0655] Server: Receives authentication information from the user, compares it with the database, and if authentication is successful, starts a user session. At this time, it reads the user's profile information and prepares for the next process.

[0656] Starting a conversation and listening to the details of your consultation

[0657] Program processing:

[0658] Server: After authentication, a greeting message (e.g., "Hello, what can you help us with?") is generated by the generative AI model and sent to the device.

[0659] Terminal: Displays the chat screen and provides a field for receiving input from the user.

[0660] User: Enters the content of the consultation by text or voice. If voice recognition technology is used, the voice data is converted into text.

[0661] Server: Analyzes the input consultation content and generates the next necessary questions and interview items using a generative AI model. Specifically, it automatically generates appropriate questions based on the consultation content and sends them back to the device.

[0662] Automated responses and appropriate information

[0663] Program processing:

[0664] Server: Based on the user's question or inquiry, the generative AI model generates relevant government service information, including links to relevant web pages, lists of required documents, and procedural details.

[0665] Terminal: The generated information is displayed on the chat screen.

[0666] User: Review the information provided and enter any further questions as needed.

[0667] Server: Responds to follow-up questions from the user and references past consultation history and user profile data to generate optimal responses.

[0668] Guidance and assistance with application procedures

[0669] Program processing:

[0670] Server: Based on the user's inquiry, the AI ​​model generates detailed information about the application procedure. It also generates a list of required documents and procedural steps and sends it to the device.

[0671] Terminal: Displays the documents and procedures required for the application process, helping users to easily proceed with the process.

[0672] User: Check the provided procedure information and prepare the necessary documents. Digital document upload function is also provided.

[0673] Server: When uploading required documents, digital signatures and automatic completion of required information are performed.

[0674] Complete and confirm your online application

[0675] Program processing:

[0676] Server: Receives documents uploaded by users, stores them in a database, and automatically checks the contents of the documents. If there are any errors, the server notifies the user and prompts them to make corrections.

[0677] Terminal: Provides an interface for checking the upload screen and created documents.

[0678] User: Scans or photographs the necessary documents, uploads them to the device, and proceeds with the procedure.

[0679] Progress notification and follow-up

[0680] Program processing:

[0681] Server: Notifies the employee of the details of the accepted application and tracks the progress. If there is a change in the progress, a notification is generated by the AI ​​model and sent to the user's device.

[0682] Terminal: Shows progress updates to the user.

[0683] Users: Ask follow-up questions as needed to check progress.

[0684] This system is designed to enable users to use government services effectively, regardless of time or location, by incorporating voice recognition technology and a response optimization function that learns from past consultation history, thereby providing highly convenient government services to a diverse range of users.

[0685] The processing flow will be explained below.

[0686] Step 1:

[0687] The server starts the system, initializes the user database and log database, and reads various settings.

[0688] Step 2:

[0689] The terminal detects the user's access and displays a user authentication screen.

[0690] Step 3:

[0691] The user enters authentication information such as their My Number card and password on the authentication screen and presses the send button.

[0692] Step 4:

[0693] The server receives the entered authentication information, checks it against a database, and if authentication is successful, starts a user session and loads the profile information.

[0694] Step 5:

[0695] After authentication, the server generates a greeting message (e.g., "Hello, how can I help you?") generated by the AI ​​model and sends it to the device.

[0696] Step 6:

[0697] The terminal displays a chat screen and provides fields for accepting input from the user.

[0698] Step 7:

[0699] The user inputs the content of their inquiry into the chat screen either by text or by voice. If the user inputs voice, it is converted into text using voice recognition technology.

[0700] Step 8:

[0701] The server analyzes the input consultation content and uses a generative AI model to generate optimal questions and hearing items.

[0702] Step 9:

[0703] The device displays the generated question on the chat screen.

[0704] Step 10:

[0705] The user enters the details and submits.

[0706] Step 11:

[0707] The server uses a generative AI model to generate appropriate administrative service information (links to related web pages, lists of required documents, procedural details, etc.) based on user input.

[0708] Step 12:

[0709] The terminal displays the generated information on the chat screen.

[0710] Step 13:

[0711] The user reviews the information provided and enters further questions if necessary.

[0712] Step 14:

[0713] To respond to additional questions, the server refers to the generative AI model, past consultation history, and profile data to generate the optimal response.

[0714] Step 15:

[0715] The device displays the additional response on the chat screen.

[0716] Step 16:

[0717] The user checks the application procedure information provided and prepares the necessary documents.

[0718] Step 17:

[0719] The server generates a list of documents and procedures required for the procedure and sends it to the terminal.

[0720] Step 18:

[0721] The device will display detailed information about the application process (document list, instructions, etc.).

[0722] Step 19:

[0723] The user scans or photographs the required documents and uploads them.

[0724] Step 20:

[0725] The server receives the uploaded documents, stores them, automatically checks their contents, and generates notifications if there are any errors.

[0726] Step 21:

[0727] The terminal displays the results of automatic document checks and correction requirements.

[0728] Step 22:

[0729] The user corrects the document as needed and re-uploads it.

[0730] Step 23:

[0731] The server accepts the application and notifies the relevant staff of the progress.

[0732] Step 24:

[0733] The server tracks the progress of the application, and if there are any changes, a generative AI model generates a notification and sends it to the device.

[0734] Step 25:

[0735] The device will display progress updates to the user and update them if further notices arise.

[0736] Step 26:

[0737] Users can check in on progress and ask additional questions or follow up as needed.

[0738] Example 1

[0739] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0740] Today's busy lives demand systems that enable users to access government services quickly and efficiently. However, current systems struggle to consistently and efficiently handle user authentication, analysis of consultation content, generation of appropriate responses, document upload and application completion, and progress notifications. Another challenge is properly converting users' voice input into text and providing appropriate responses based on the consultation content. Furthermore, there is a need to utilize past consultation history to improve the accuracy of responses to users.

[0741] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0742] In this invention, the server includes means for user authentication, means for analyzing the user's consultation content using a generation artificial intelligence and generating an appropriate response, means for automatically providing appropriate administrative information in response to questions from the user, means for the user to upload necessary documents and complete the application procedure online, means for checking the application content and notifying the progress, means for the generation artificial intelligence to generate a greeting message after authentication and send it to the terminal, means for analyzing the received consultation content and automatically generating the next necessary question using the generation artificial intelligence, and means for automatic checking and electronic signature.This enables users to efficiently consult or apply for administrative services 24 hours a day, and realizes the generation of optimal responses using voice input and past consultation history.

[0743] "User authentication" is the process of verifying the identity of a user accessing a system.

[0744] "Generative AI" is an AI technology that analyzes input data and generates appropriate responses.

[0745] "Analysis of consultation content" is a process for processing the consultation content entered by the user and understanding its meaning and requirements.

[0746] "Generating an appropriate response" is a procedure for automatically creating the most appropriate response to the user based on the analyzed consultation content.

[0747] "Administrative information" refers to information about various services and procedures provided by the government and local governments.

[0748] "Document upload" refers to the act of a user submitting the required documents in digital form to the system.

[0749] "Completing an application" is the process by which a user completes a particular administrative procedure by submitting the required documents and providing the required information.

[0750] "Progress notification" means informing the user of the progress of the application procedure.

[0751] The "greeting message" is the first message that the system sends to the user, and usually includes content that asks the user what they want to discuss.

[0752] "Automatic question generation" is the process in which artificial intelligence automatically creates the next necessary question based on the user's consultation content.

[0753] "Automatic check" is a procedure in which the system automatically verifies the contents of submitted documents.

[0754] An "electronic signature" is a digital signature that ensures the authenticity of a document and the identity of its sender.

[0755] The present invention is a system that allows users to consult about or apply for government services 24 hours a day. This system includes a user authentication means, a response generation means using artificial intelligence, a government information provision means, an online application procedure support means, and a progress notification means. Specific embodiments of this system are described below.

[0756] User authentication methods

[0757] First, when a user accesses the system, the server generates a user authentication screen and sends it to the terminal. The terminal displays the authentication screen and provides an interface for the user to enter their My Number card and password. When the user enters and submits their authentication information, the server receives it and compares it with the user database. If authentication is successful, the server starts a user session and loads their profile information.

[0758] Response generation method using generative artificial intelligence

[0759] Once authentication is complete, the server uses generative AI (e.g., ChatGPT) to generate a greeting message and send it to the device. For example, it generates a message like, "Hello, what would you like to discuss?" The device displays this message on the chat screen and provides a field for the user to enter the content of their consultation. Once the user enters the content of their consultation, the server receives it, analyzes it using a generative AI model, and automatically generates the next necessary question.

[0760] Administrative information provision means

[0761] The server generates relevant administrative information based on the user's question or inquiry using a generative AI model (e.g., BERT). This information includes links to related web pages, a list of required documents, and details of procedures. The generated information is sent to the device, which then displays it on the chat screen.

[0762] Online application procedure support

[0763] A particularly important process occurs when a user uploads the required documents. The device provides a digital document upload function and sends the documents prepared by the user to the server. The server receives the uploaded documents, applies the necessary digital signatures, and automatically checks the contents of the documents. If any required information is missing or incomplete, the server sends a notification to the user prompting them to make corrections.

[0764] Progress notification method

[0765] The server notifies the employee of the accepted application and tracks its progress. If there are any changes in the progress, the server generates the content using a generative AI model and notifies the user. The terminal displays the latest progress to the user. The user can ask additional questions as needed to check the progress.

[0766] Hardware and software used

[0767] The hardware includes high-performance server computers and dedicated database servers, while the software includes generative AI models (e.g., ChatGPT, BERT, etc.), speech recognition technology, natural language processing engines, and digital signature technology.

[0768] Examples and prompts

[0769] For example, if the device displays "Hello, what would you like to discuss?", the user can enter "Please tell me about the procedures for childcare support." The server analyzes this input, generates the next question, "Please tell me the ages of your children," and sends it back to the device. The server then displays the generated detailed procedure information and a list of required documents on the device, helping the user to easily complete the procedures.

[0770] As described above, the present invention is designed to enable users to efficiently use government services without being restricted by time or location, allowing users to quickly and accurately complete government procedures online.

[0771] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0772] Step 1:

[0773] The server generates a user authentication screen and sends it to the terminal.

[0774] Input: System startup and user access

[0775] Output: Authentication screen

[0776] Specific operation: The server initializes the user database and log database, reads the settings, then generates a user authentication screen and sends it to the terminal.

[0777] Step 2:

[0778] The terminal displays a user authentication screen and provides an interface for the user to enter their My Number card and password.

[0779] Input: Authentication screen from the server

[0780] Output: Authentication entry screen shown to the user

[0781] What happens: The device renders "login.html" and displays it to the user, providing fields where the user can enter their authentication information.

[0782] Step 3:

[0783] The user enters their My Number card information and password and presses the send button.

[0784] Input: Information to be entered on the authentication screen

[0785] Output: Authentication information sent to the server

[0786] Specific operations: The user holds their My Number card over the reader, enters the PIN code, and presses the send button.

[0787] Step 4:

[0788] The server checks the received authentication information against a user database, and if authentication is successful, starts a user session.

[0789] Input: Credentials from the user

[0790] Output: Authentication result and session start

[0791] Specific behavior: The server checks the authentication information against "users_db" and, if successful, generates a session ID and loads the profile information.

[0792] Step 5:

[0793] The server uses artificial intelligence to generate a greeting message and sends it to the terminal.

[0794] Input: Session information after authentication is complete

[0795] Output: Greeting message

[0796] Specific behavior: Use a generative AI model (e.g., ChatGPT) to generate a message saying "Hello, how can I help you?" and send it to the device.

[0797] Step 6:

[0798] The terminal displays a chat screen and provides a field where the user can enter the content of the consultation.

[0799] Input: Greeting message from the server

[0800] Output: The chat screen that the user sees

[0801] Specific behavior: The device displays "chat.html" containing a greeting message and an input field.

[0802] Step 7:

[0803] The user inputs the consultation content by text or voice and presses the send button.

[0804] Input: Enter the consultation details

[0805] Output: Consultation content sent to the server

[0806] Specific operation: The user enters the content of the consultation into the text field and presses the send button, or they can input it by voice. In the case of voice, it is converted into text using voice recognition technology.

[0807] Step 8:

[0808] The server analyzes the consultation content received and uses artificial intelligence to generate the next necessary questions and hearing items.

[0809] Input: User's inquiry

[0810] Output: Next question or hearing item

[0811] Specific operation: The server analyzes the consultation content received using a natural language processing engine and generates the next question using a generative AI model (e.g., ChatGPT).

[0812] Step 9:

[0813] The server uses a generative AI model to generate relevant administrative information based on the user's questions or inquiries, and sends it to the terminal.

[0814] Input: Questions and inquiries from users

[0815] Output:Administrative information

[0816] Specific operation: The server uses a generative AI model (e.g., BERT) to generate relevant web page links, a list of required documents, procedural details, etc., and sends them to the terminal.

[0817] Step 10:

[0818] The terminal displays the generated information on the chat screen.

[0819] Input: Administrative information from the server

[0820] Output: Administrative information displayed to the user

[0821] Specific operation: The device renders "chat.html" containing administrative information and displays it on the chat screen.

[0822] Step 11:

[0823] The user prepares the necessary documents and uploads them via the terminal.

[0824] Input: Required documents

[0825] Output: Digital document sent to the server

[0826] Specific operation: The user scans a document and presses the send button using the device's upload function.

[0827] Step 12:

[0828] The server stores the received documents and performs digital signatures and automatic checks.

[0829] Input: Uploaded digital document

[0830] Output: Confirmation message or correction request notification

[0831] Specific operation: The server saves the document in a database, automatically checks its contents, and if there are any errors, sends a notification to the user to correct them.

[0832] Step 13:

[0833] The server notifies the appropriate staff of accepted applications and tracks their progress.

[0834] Input: Application details

[0835] Output: Progress

[0836] Specific operation: The server notifies the application details to the progress management system, tracks the progress, and notifies the relevant staff of the necessary information.

[0837] Step 14:

[0838] If the server detects any changes in the progress, it generates a notification for the user using the AI ​​model and sends it to the device.

[0839] Input: Progress Change

[0840] Output: Progress notification

[0841] Specific operation: Using a generative AI model (e.g., ChatGPT), a message notifying of progress changes (e.g., "Your application has been accepted. The current progress is ____") is generated and sent to the device.

[0842] Step 15:

[0843] The device displays progress updates to the user.

[0844] Input: Progress notification from the server

[0845] Output: Progress displayed to the user

[0846] Specific behavior: The device renders "progress.html" containing the progress and displays it to the user.

[0847] (Application example 1)

[0848] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0849] Conventional government services have faced challenges, such as users being restricted by time and location, making it difficult to provide 24-hour service. Waiting times at the counter are also common, necessitating greater efficiency. Furthermore, there are limited ways for users to accurately obtain the information they need. Meanwhile, there are also issues with elderly people and those unfamiliar with technology, such as difficulty completing electronic application procedures.

[0850] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0851] In this invention, the server includes a user authentication means, a means for analyzing the content of the user's consultation using artificial intelligence and generating an appropriate response, and a means for automatically providing appropriate administrative service information in response to a question from the user, thereby enabling users to efficiently obtain the information and procedures they need 24 hours a day.

[0852] "User authentication means" refers to a means for identifying and authenticating a user, and examples include facial recognition technology and My Number card reading functions.

[0853] "Generative AI" refers to AI that uses a generative AI model to generate appropriate responses based on user input.

[0854] The "response generation means" is a system component that analyzes the content of the user's consultation and generates an appropriate response based on that analysis.

[0855] The "administrative service information providing means" is a system function that automatically provides information on related administrative services in response to a user's question.

[0856] The "means for completing the application procedure online" is a system function that allows users to upload the necessary documents and complete the application procedure online.

[0857] The "progress status notification means" is a system function for checking the application content and notifying the user of the progress status.

[0858] "Facial recognition technology" is a technology that uses a camera to recognize a user's face and authenticate the user based on this.

[0859] "Real-time response generation means" is a system function that uses a generative AI model to generate a response based on user input in real time.

[0860] A "robot display" is a display device mounted on a robot that visually provides information to the user.

[0861] "Speech recognition technology" is a technology that converts a user's voice into text and analyzes it.

[0862] "Means for learning past consultation history" is a system function that accumulates past consultation details and user interactions and optimizes future responses based on that information.

[0863] This invention is a system that allows users to consult about or apply for government services 24 hours a day. This system includes a user authentication means, a response generation means using generative artificial intelligence, a government service information provision means, an online application procedure support means, and a progress notification means.

[0864] Initial Authentication and User Authentication

[0865] Program processing:

[0866] When the system starts up, the server initializes the user database and log database and loads various settings. When a user accesses the system, it generates a user authentication screen and sends it to the terminal. The terminal displays the authentication screen and provides a screen where the user can enter information such as facial recognition technology and My Number card information. The user enters the necessary authentication information on the authentication screen and presses the send button. The server receives the authentication information from the user, compares it with the database, and if authentication is successful, starts the user session. At this time, it loads the user's profile information and prepares for the next process.

[0867] Starting a conversation and listening to the details of your consultation

[0868] Program processing:

[0869] After authentication, the server generates a greeting message (e.g., "Hello, what would you like to discuss?") using the generative AI model and sends it to the device. The device displays a chat screen and provides a field to receive input from the user. The user inputs the content of the consultation using text or voice. If voice recognition technology is used, the voice data is converted into text. The server analyzes the input consultation content and then generates the necessary questions and hearing items using the generative AI model. Specifically, it automatically generates appropriate questions based on the consultation content and sends them back to the device.

[0870] Automated responses and appropriate information

[0871] Program processing:

[0872] The server uses a generative AI model to generate relevant government service information based on the user's questions and inquiries. This information includes links to relevant web pages, lists of required documents, and detailed procedures. The device displays the generated information on the chat screen. The user can review the information provided and enter further questions as needed. The server responds to the user's additional questions and references past consultation history and user profile data to generate the most appropriate response.

[0873] Guidance and assistance with application procedures

[0874] Program processing:

[0875] Based on the user's inquiry, the server uses a generative AI model to generate detailed information about the applicable application procedure. A list of the required documents and procedural steps is generated and sent to the device. The device displays the documents and procedures required for the application procedure, helping the user to easily proceed with the procedure. The user checks the provided procedural information and prepares the necessary documents. At this time, a function to upload digital documents is also provided. When uploading the required documents, the server automatically completes the required information and digital signatures.

[0876] Complete and confirm your online application

[0877] Program processing:

[0878] The server receives documents uploaded by users, stores them in a database, and automatically checks the contents of the documents. If there are any errors, it notifies the user and prompts them to make corrections. The terminal provides an interface for checking the upload screen and completed documents. The user scans or photographs the necessary documents, uploads them to the terminal, and proceeds with the procedure.

[0879] Progress notification and follow-up

[0880] Program processing:

[0881] The server notifies the responsible employee of the accepted application and tracks its progress. If there is a change in the progress, a notification is generated by the AI ​​model and sent to the user's device. The device displays the latest progress to the user. The user can ask additional questions as needed to check the progress.

[0882] As a concrete example, this system is used in robots installed in brick-and-mortar stores such as city halls. When citizens visit the office, they are authenticated using facial recognition technology, and a generative AI model is used to accept and respond to inquiries in real time. For example, if a user types in "Can you tell me about renewing my passport?", the system generates a response such as "Here is the necessary procedural information. Please see the link:..."

[0883] Example prompt sentence:

[0884] User: What about renewing my passport?

[0885] System: Please refer to this link for passport renewal: [LINK]

[0886] In order to specifically implement the invention, it is necessary to build a system in which various hardware and software work together. The main hardware used includes a robot with a camera, a My Number card reader, a scanner, etc., and the software used includes a generative AI model (e.g., GPT-2), voice recognition technology, and face recognition technology (e.g., the face_recognition library).

[0887] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0888] Step 1:

[0889] When the system starts up, the server initializes the user database and log database and loads various settings. When a terminal accesses the server, the server generates a user authentication screen and sends it to the terminal. The user database stores pre-registered user information, and the log database records past access history and operation logs. This puts the system into a ready state.

[0890] Step 2:

[0891] The device displays the user authentication screen sent from the server. The user is instructed to stand in front of the facial recognition camera, and the system performs facial recognition. A My Number card reader may be used to enter the required authentication information. The input information (face image and My Number card data) is sent to the server.

[0892] Step 3:

[0893] The server receives the authentication information sent from the device and checks it against a user database. It uses facial recognition technology to compare the user's facial image with those in the database. At the same time, it checks the data on the My Number card. If authentication is successful, the server starts a user session and loads the user's profile information. It then sends an authentication success message to the device.

[0894] Step 4:

[0895] After successful authentication, the server uses a generative AI model to generate a greeting message (e.g., "Hello, how can I help you?") and sends it to the device. The greeting message is an important first step in an automated response.

[0896] Step 5:

[0897] The device displays the greeting message sent from the server on the chat screen. The user inputs the content of the consultation by text or voice. In the case of voice input, the device uses voice recognition technology to convert the voice data into text and send it to the server.

[0898] Step 6:

[0899] The server receives the text of the consultation sent by the user and analyzes the content using a generative AI model. Specifically, the generative AI model analyzes the input text and automatically generates the next necessary questions and hearing items. The generated questions and hearing items are then sent back to the device.

[0900] Step 7:

[0901] The terminal displays the questions and hearing items sent from the server on the chat screen and waits for further input from the user. The user inputs additional questions and information as appropriate and sends them from the terminal to the server.

[0902] Step 8:

[0903] The server receives additional questions and information from the user and uses a generative AI model to generate appropriate government service information based on the information. The information includes links to related web pages, lists of required documents, and details of procedures. The generated information is then sent to the device.

[0904] Step 9:

[0905] The terminal displays the information sent from the server on the chat screen. The user checks the provided information and enters further questions as necessary. The server references past consultation history and user profile data to generate the optimal response.

[0906] Step 10:

[0907] Based on the user's inquiry, the server uses a generative AI model to generate detailed information about the application procedure. This generates a list of required documents and procedural steps and sends it to the device. The device then displays the documents and steps required for the application procedure, helping the user to easily proceed with the procedure.

[0908] Step 11:

[0909] The user checks the provided procedure information and prepares the necessary documents. At this time, a digital document upload function is also provided. The user automatically completes the digital signature and necessary information and uploads the documents. The uploaded documents are sent to the server.

[0910] Step 12:

[0911] The server receives documents uploaded by users and stores them in a database. The contents of the documents are automatically checked, and if there are any errors, the user is notified and prompted to make corrections. The user can check the upload screen and created documents from their device and make corrections as necessary.

[0912] Step 13:

[0913] The server notifies the employee of the application and tracks its progress. If there are any changes in the progress, the generative AI model generates a notification and sends it to the terminal. The terminal then displays the latest progress to the user and accepts additional questions as needed.

[0914] Examples:

[0915] If the user types "Tell me about renewing my passport," the system generates a response like "Here's the procedure you need. Please see the link:..."

[0916] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0917] This invention is a system that allows users to consult about or apply for government services 24 hours a day. By combining this system with an emotion engine that recognizes user emotions and optimizes responses, the aim is to provide more flexible and user-friendly services. This system includes a user authentication means, a response generation means using generative artificial intelligence, a means for providing government service information, a means for supporting online application procedures, a progress notification means, and an emotion engine. The program processing of this system is explained below in natural language.

[0918] Initial Authentication and User Authentication

[0919] Program processing:

[0920] The server starts the system, initializes the user database and log database, and loads various settings. When a user accesses the system, it generates a user authentication screen and sends it to the terminal.

[0921] The terminal displays a user authentication screen, providing a screen where the user can enter authentication information such as their My Number card or password.

[0922] The user enters the required authentication information on the authentication screen and presses the send button.

[0923] The server receives authentication information from the user, checks it against a database, and if authentication is successful, starts a user session and loads profile information.

[0924] Starting a conversation and listening to the details of your consultation

[0925] Program processing:

[0926] After authentication, the server generates a greeting message (e.g., "Hello, how can I help you?") generated by the AI ​​model and sends it to the device.

[0927] The terminal displays a chat screen and provides fields for accepting input from the user.

[0928] The user inputs the content of their consultation on the chat screen using text or voice. If voice recognition technology is used, the voice data is converted into text.

[0929] The server analyzes the input consultation content and uses a generative AI model to generate optimal questions and hearing items.

[0930] Emotion recognition and response optimization

[0931] Program processing:

[0932] The server analyzes the user's voice and text inputs and uses an emotion engine to recognize the user's emotions. This emotion data is then reflected in the generation of responses.

[0933] The device displays the generated questions and responses on the chat screen, adjusting the content and tone of the responses depending on the user's emotional state.

[0934] The user enters more information or asks additional questions and submits.

[0935] The server references the emotion engine and past consultation history to optimize the response based on the current emotional state.

[0936] Automated responses and appropriate information

[0937] Program processing:

[0938] The server uses a generative AI model to generate relevant government service information based on the user's inquiry, including links to relevant web pages, lists of required documents, and procedural details.

[0939] The terminal displays the generated information on the chat screen.

[0940] The user reviews the information provided and enters further questions if necessary.

[0941] The server uses generative AI models and emotion engines to generate optimal responses to follow-up questions.

[0942] Guidance and assistance with application procedures

[0943] Program processing:

[0944] Based on the user's inquiry, the server uses a generative AI model to generate detailed information about the application procedure in question, and provides appropriate guidance based on the user's emotions.

[0945] The device displays a list of the documents and procedures required for the application process, making it easier for users to proceed with the process.

[0946] Users can review the provided procedure information and prepare the necessary documents, including the ability to upload digital documents.

[0947] When the server uploads the required documents, it digitally signs them and automatically completes the required information.

[0948] Complete and confirm your online application

[0949] Program processing:

[0950] The server receives documents uploaded by users, stores them in a database, and automatically checks the contents. If there are any errors, the server notifies the user and prompts them to correct them.

[0951] The device provides an interface for viewing the upload screen and created documents.

[0952] The user scans or photographs the necessary documents, uploads them to the device, and proceeds with the procedure.

[0953] Progress notification and follow-up

[0954] Program processing:

[0955] The server notifies the employee of the details of the accepted application and tracks the progress. If there are any changes in the progress, a notification based on the generative AI model and emotion data is sent to the device.

[0956] The device will display progress updates to the user and update them if further notices arise.

[0957] Users can check in on progress and ask additional questions or follow up as needed.

[0958] In this way, a system incorporating an emotion engine can respond in a way that is sensitive to the user's emotions, improving the user experience and providing more satisfying government services.

[0959] The processing flow will be explained below.

[0960] Step 1:

[0961] The server starts the system, initializes the user database and log database, and reads various settings.

[0962] Step 2:

[0963] The terminal detects the user's access and displays a user authentication screen.

[0964] Step 3:

[0965] The user enters authentication information such as their My Number card and password on the authentication screen and presses the send button.

[0966] Step 4:

[0967] The server receives the entered authentication information, checks it against a database, and if authentication is successful, starts a user session and loads the profile information.

[0968] Step 5:

[0969] After authentication, the server generates a greeting message (e.g., "Hello, what can you help us with?") generated by the generative AI model and sends it to the device.

[0970] Step 6:

[0971] The terminal displays a chat screen and provides fields for accepting input from the user.

[0972] Step 7:

[0973] The user inputs the content of their inquiry on the chat screen either by text or by voice. In the case of voice input, the voice input is converted into text using voice recognition technology.

[0974] Step 8:

[0975] The server analyzes the input consultation content and uses a generative AI model to generate appropriate questions and hearing items.

[0976] Step 9:

[0977] The device displays the generated question on the chat screen.

[0978] Step 10:

[0979] The user enters the details and submits.

[0980] Step 11:

[0981] The server collects user input and uses an emotion engine to analyze the user's emotions. Based on the results, it generates an optimal response according to the user's emotional state.

[0982] Step 12:

[0983] The device displays the generated response on the chat screen, adjusting the content and tone of the response depending on the user's emotional state.

[0984] Step 13:

[0985] The user reviews the information provided and enters further questions if necessary, during which sentiment is again analyzed.

[0986] Step 14:

[0987] The server refers to the emotion engine and past consultation history based on additional questions or consultation content, optimizes the response, and then sends it.

[0988] Step 15:

[0989] The device will display an optimized response on the chat screen.

[0990] Step 16:

[0991] The user checks the application procedure information provided and prepares the necessary documents.

[0992] Step 17:

[0993] The server generates a list of documents and procedures required for the procedure and sends it to the terminal.

[0994] Step 18:

[0995] The device will display detailed information about the application process (document list, instructions, etc.).

[0996] Step 19:

[0997] The user scans or photographs the required documents and uploads them.

[0998] Step 20:

[0999] The server receives the uploaded documents, stores them, and automatically checks their contents. If there are any errors, it notifies the user and prompts them to correct them.

[1000] Step 21:

[1001] The terminal displays the results of automatic document checks and correction requirements.

[1002] Step 22:

[1003] The user corrects the document as needed and re-uploads it.

[1004] Step 23:

[1005] The server accepts the application and notifies the relevant staff of the progress.

[1006] Step 24:

[1007] The server tracks the progress of the application, and if there is a change in the progress, it generates a notification based on the emotion data and sends it to the device.

[1008] Step 25:

[1009] The device will display progress updates to the user and update them if further notices arise.

[1010] Step 26:

[1011] The user checks the progress and asks additional questions or follow-ups as needed. Again, the emotion engine performs sentiment analysis based on the user's input and generates an appropriate response.

[1012] In this way, administrative services can be provided in a way that is in tune with the user's feelings, and it is expected that user satisfaction will increase.

[1013] Example 2

[1014] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1015] Current government services are time-constrained for users, and they are unable to make consultations or applications, especially outside of office hours. It is also difficult for users to check the progress of documents and procedures submitted in real time. Furthermore, standardized responses are provided without consideration for users' feelings, resulting in low satisfaction for many users. The present invention aims to solve these problems.

[1016] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1017] In this invention, the server includes a user authentication means, a means for analyzing the content of the user's consultation using generative artificial intelligence and generating an appropriate response, a means for automatically providing appropriate information in response to a user's question, an online processing means for the user to upload necessary documents and complete the application procedure, a means for checking the application content and notifying the progress, and a means for recognizing the user's emotions and optimizing the response. This allows users to access government services 24 hours a day, check the progress in real time, and receive responses that are sensitive to their emotions.

[1018] "User authentication means" refers to a means for verifying that a user has legitimate access rights by entering authentication information such as a My Number card or password when accessing a system.

[1019] "Generative AI" is an AI technology that uses a generative AI model to analyze input data and automatically generate the optimal response for the user.

[1020] The "means for analyzing the consultation content and generating an appropriate response" is a means for analyzing the consultation content input by the user and generating appropriate questions and answers according to the content.

[1021] A means for providing "appropriate information" is a means for searching and providing the most appropriate information in response to a user's question.

[1022] "Online processing means for uploading required documents and completing application procedures" refers to a means by which a user uploads the documents required to complete the application procedures online and processes those documents within the system.

[1023] The "means for checking application content and notifying progress status" is a means for tracking the application content submitted by the user and notifying the user of the progress status in real time.

[1024] "Means for recognizing emotions and optimizing responses" refers to means for recognizing a user's emotions by analyzing voice data and text, and providing an optimal response according to those emotions.

[1025] The present invention is a system that allows users to consult about or apply for government services 24 hours a day. This system includes a user authentication means, a response generation means using a generative AI model, an appropriate information provision means, an online application procedure means, a progress notification means, and an emotion recognition means. The specific processing of each means is explained below.

[1026] User authentication method

[1027] When the system starts up, the server initializes the user database and log database and loads various settings. When a user accesses the system, the server generates an authentication screen and sends it to the terminal. The terminal displays the authentication screen, and the user enters authentication information such as their My Number card or password. When the user submits the authentication information, the server verifies it, and if successful, starts a user session and loads the profile information.

[1028] Response generation method using generative AI model

[1029] After the user is authenticated, the server uses a generative AI model to generate a greeting message and sends it to the device. The device then displays a chat screen and accepts user input. When the user inputs their consultation details via text or voice, the server analyzes them and generates the most appropriate questions and questions to ask. For example, it generates a message such as "Hello, what would you like to discuss?"

[1030] Appropriate means of providing information

[1031] Based on the user's inquiry, the server uses a generative AI model to generate relevant government service information. This includes links to related web pages, lists of required documents, and detailed procedures. The generated information is sent to the terminal so that the user can review it. If the user enters further questions, the server will also use the generative AI model to generate optimal responses to those additional questions.

[1032] Online application procedures

[1033] Documents submitted by users are uploaded from their devices to the server. The server stores the uploaded documents in a database and performs automatic checks. If there are any deficiencies, the user is notified and prompted to make corrections. Details of online applications are automatically filled in with digital signatures and required information.

[1034] Progress notification method

[1035] The server notifies the responsible employee of accepted applications and tracks their progress. Any changes in progress are notified to the device based on the generative AI model and emotion data. The device displays the latest progress to the user and updates them with any further notifications. The user can view the progress and ask additional questions or follow up as needed.

[1036] emotion recognition means

[1037] The server analyzes the user's voice and text inputs and uses an emotion engine to recognize the user's emotions. The emotion data is then used to generate responses. For example, if the server detects that the user is feeling anxious, it will generate a more reassuring response.

[1038] Examples:

[1039] If a user wants to apply for a copy of their resident registration card, they input a prompt sentence such as, "Hello, I would like to get a copy of my resident registration card. How do I do this?" The system uses an emotion engine to return a response that increases the user's sense of security. For example, the system might generate a response such as, "Don't worry, we'll guide you through the necessary steps."

[1040] The above is a specific embodiment of the system of the present invention. This system allows users to use government services 24 hours a day while receiving compassionate support.

[1041] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1042] Specific flow of processing steps

[1043] Initial Authentication and User Authentication

[1044] Step 1: Start the system and initialize the database

[1045] The server starts the system.

[1046] The server initializes the user database and log database and loads various settings.

[1047] Input: System startup command

[1048] Output: Initialized database and loaded settings

[1049] Step 2: Generate and send the authentication screen

[1050] The server detects user access and generates an authentication screen.

[1051] The server sends an authentication screen to the terminal.

[1052] Specific operation: Generates an HTML template for the authentication screen and constructs an HTTP response.

[1053] Input: User access data

[1054] Output: HTML data of the authentication screen

[1055] Step 3: Enter and submit your credentials

[1056] The device displays an authentication screen and provides fields for entering authentication information.

[1057] The user enters authentication information such as their My Number card and password and presses the send button.

[1058] Specific operation: Validates the input form and processes the submission of authentication information.

[1059] Input: User credentials

[1060] Output: Sending authentication information to the server

[1061] Step 4: Verify credentials and start a session

[1062] The server receives authentication information from the user and checks it against a database.

[1063] If authentication is successful, the server starts a user session and loads profile information.

[1064] Specific operation: Runs the authentication information matching algorithm and initializes session information.

[1065] Input: User credentials

[1066] Output: Authentication result and session ID

[1067] Starting a conversation and listening to the details of your consultation

[1068] Step 5: Generate and send a greeting message

[1069] After authentication, the server uses a generative AI model to generate a greeting message (e.g., "Hello, how can I help you?").

[1070] The server sends a greeting message to the terminal.

[1071] Specific operation: Call the generative AI model and generate an appropriate message.

[1072] Input: User authentication success data

[1073] Output: Greeting message

[1074] Step 6: Display the chat screen and accept input

[1075] The terminal displays a chat screen and provides fields for the user to enter information.

[1076] The user inputs the consultation content by text or voice.

[1077] Specific operation: Renders the chat interface and accepts user input.

[1078] Input: Greeting message

[1079] Output: User input data

[1080] Step 7: Analyzing the consultation content and generating questions

[1081] The server analyzes the input consultation content and uses a generative AI model to generate optimal questions and hearing items.

[1082] The server sends the generated question to the terminal.

[1083] Specific operation: Analyzes using natural language processing algorithms and generates a response from a generative AI model.

[1084] Input: User's inquiry

[1085] Output: Generated questions

[1086] Emotion recognition and response optimization

[1087] Step 8: Sentiment analysis and response adjustment

[1088] The server analyzes the voice and text input from the user and recognizes the user's emotions using an emotion engine.

[1089] The server adjusts the content and tone of the response based on the emotional data.

[1090] Specific operations: Executes sentiment analysis algorithm and adjusts parameters for response generation.

[1091] Input: User input data and sentiment analysis results

[1092] Output: Adjusted response

[1093] Step 9: Viewing Optimized Questions

[1094] The device displays the generated questions and responses on the chat screen.

[1095] The user enters more information or a follow-up question and submits.

[1096] Specific operation: Update the chat interface and re-process input.

[1097] Input: Adjusted response

[1098] Output: Additional user input data

[1099] Step 10: Continuously optimize your response

[1100] The server references the emotion engine and past consultation history to continually optimize responses based on the current emotional state.

[1101] Specific operations: Refer to the history database and evaluate emotion data.

[1102] Input: User's emotional data and past consultation history

[1103] Output: Optimal response reflecting current emotional state

[1104] Automated responses and appropriate information

[1105] Step 11: Generate and send relevant information

[1106] The server generates relevant administrative service information using a generative AI model based on the user's consultation content and sends it to the terminal.

[1107] What it does: Uses generative AI models to find and generate relevant information.

[1108] Input: User's inquiry

[1109] Output: Relevant information (e.g., list of required documents, details of procedure)

[1110] Step 12: View and verify information

[1111] The terminal displays the generated information on the chat screen.

[1112] The user reviews the information provided and enters any additional questions.

[1113] Specific operation: Renders the generated information and accepts user input.

[1114] Input: Generated related information

[1115] Output: Additional user input data

[1116] Step 13: Generate additional questions and responses

[1117] The server uses the generative AI model and emotion engine to generate the optimal response to the user's follow-up question and sends it to the device.

[1118] Specific action: The generative AI model is called again to generate an appropriate response.

[1119] Input: User's additional question

[1120] Output: The generated response

[1121] Guidance and assistance with application procedures

[1122] Step 14: Generate and display application information

[1123] Based on the consultation content, the server uses a generative AI model to generate detailed information about the relevant application procedure and sends it to the terminal.

[1124] The device will display a list of the documents and procedures required for the application process.

[1125] Specific operation: Use a generative AI model to generate and list application procedure information.

[1126] Input: User's inquiry

[1127] Output: Detailed information on application procedures

[1128] Step 15: Check and prepare your procedures

[1129] The user checks the provided procedure information and prepares the necessary documents.

[1130] The terminal provides the function of uploading digital documents.

[1131] Specific operation: Displays procedural information and provides an upload interface.

[1132] Input: Application procedure details

[1133] Output: User-prepared document data

[1134] Step 16: Upload documents and auto-complete

[1135] The user scans or photographs the required documents and uploads them to the device.

[1136] The server receives the uploaded documents, stores them in a database, and performs digital signatures and auto-completes required information.

[1137] Specific Actions: Receives uploaded documents, adds digital signatures, and handles auto-completion.

[1138] Input: User document data

[1139] Output: Saved data and completed information

[1140] Complete and confirm your online application

[1141] Step 17: Automatically check and save application details

[1142] The server stores the uploaded documents in a database and automatically checks their contents.

[1143] If there is an error, the server will notify the user and prompt them to correct it.

[1144] Specific operations: Automatically verify document contents and generate notices of deficiencies.

[1145] Input: Uploaded documents

[1146] Output: Verification results and deficiency notices

[1147] Step 18: Display the application screen

[1148] The device provides an interface for viewing the upload screen and created documents.

[1149] Specific operation: Renders the document confirmation interface.

[1150] Input: Application procedure progress

[1151] Output: Check interface

[1152] Step 19: Completion of the procedure

[1153] The user uploads the necessary documents and proceeds with the process.

[1154] Specific operations: Accepts user input and manages document progress.

[1155] Input: Prepared document data

[1156] Output: Application in progress

[1157] Progress notification and follow-up

[1158] Step 20: Communicate and track progress

[1159] The server notifies the appropriate staff of accepted applications and tracks their progress.

[1160] If there is a change in progress, a notification based on the generative AI model and emotion data is sent to the device.

[1161] What it does: Tracks progress and generates notification messages.

[1162] Input: Received application details and progress data

[1163] Output: Progress notification

[1164] Step 21: View and Update Progress

[1165] The device will display progress updates to the user and update them with any notifications.

[1166] What it does: Displays progress data and updates the interface.

[1167] Input: Progress notification

[1168] Output: Latest progress

[1169] Step 22: Follow up

[1170] Users can check in on progress and ask additional questions or follow up as needed.

[1171] Specific operation: Accepts user input and sends it to the server.

[1172] Input: User's follow-up question

[1173] Output: Query data sent to the server

[1174] This process flow allows users to use government services smoothly while receiving emotionally sensitive responses.

[1175] (Application example 2)

[1176] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1177] In the field of government services, there is a demand for systems that allow users to make inquiries or applications 24 hours a day. However, conventional systems do not provide responses that take into account the user's emotional state, and in many cases, they are unable to fully resolve their anxieties or questions. Similar problems exist with security-related inquiries, and in order to improve user satisfaction, it is necessary to optimize responses that take emotions into account.

[1178] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1179] In this invention, the server includes a user authentication means, a means for analyzing the content of the user's consultation using a generative artificial intelligence and generating an appropriate response, and a means for recognizing the user's emotions using an emotion engine and optimizing the response, thereby making it possible to provide an optimal response according to the user's emotional state.

[1180] "User authentication means" refers to a means for verifying the identity of a user when the user accesses the system.

[1181] "Generative AI" is AI that analyzes user input information and generates an appropriate response to it.

[1182] The "administrative service information providing means" is a means for automatically providing information on relevant administrative services in response to a user's question.

[1183] "Online application procedure means" refers to the means by which a user can upload the necessary documents and complete the application procedure online.

[1184] The "progress status notification means" is a means for checking the application contents and notifying the user of the progress status.

[1185] An "emotion engine" is a technology for recognizing a user's emotions and optimizing responses.

[1186] "Speech recognition technology" is a technology that converts a user's voice input into text and analyzes the content.

[1187] The "means for learning past consultation history" is a means for learning the contents of the user's past consultations and optimizing the current response based on the learned contents.

[1188] The "security-related consultation response means" is a means for recognizing emotions and generating an optimal response to security-related inquiries from users.

[1189] This invention is a system that allows users to make inquiries and applications regarding government services and security 24 hours a day. The system includes a user authentication means, a generative artificial intelligence, a government service information providing means, an online application procedure means, a progress notification means, and an emotion engine.

[1190] 1. User authentication method

[1191] The server starts the system, initializes the user database and log database, and loads various settings. The terminal displays the user authentication screen, and the user enters authentication information such as their My Number card or password. The server compares this authentication information with the database, and if authentication is successful, the user session begins.

[1192] 2. Generative Artificial Intelligence

[1193] After authentication, the server uses an AI model to generate a greeting message (e.g., "Hello, what can I help you with?") and sends it to the device. The device displays a chat screen and accepts input from the user via text or voice. The server analyzes the input and generates the optimal response.

[1194] 3. Emotion Engine

[1195] The server analyzes the user's voice and text inputs and uses an emotion engine to recognize the user's emotions. This emotion data is reflected in response generation, providing the optimal response according to the user's emotional state.

[1196] 4. Means of providing information on administrative services

[1197] Depending on the user's inquiry, the server generates relevant administrative service information, including links to related web pages, a list of required documents, and detailed procedures. The device displays the generated information on the chat screen.

[1198] 5. Online application procedures

[1199] When the user checks the information provided and prepares the necessary documents, a digital document upload function is provided. The server receives the uploaded documents, stores them in a database, and automatically checks their contents. If there are any deficiencies, the user is notified and prompted to make corrections.

[1200] 6. Progress Notification Methods

[1201] After the application is accepted, the server tracks the progress and sends notifications of any changes to the device, which displays the latest progress to the user and updates them with any further notifications.

[1202] Specific hardware and software

[1203] The system uses the following hardware and software:

[1204] Server: Hosts the main part of the system and holds the user database, log database, and AI model.

[1205] Device: Provides the user interface and accepts user input. This can be a smartphone, PC, tablet, etc.

[1206] Generative AI model: A machine learning model that analyzes the user's inquiry content and generates the optimal response.

[1207] Emotion engine: A software module for analyzing user emotions and reflecting them in responses.

[1208] Speech recognition technology: Technology for converting a user's voice input into text.

[1209] Examples of specific examples and prompts

[1210] For example, if a user asks, "I've been seeing suspicious cars around my house lately. What should I do?" the emotion engine will recognize the anxiety and provide a reassuring response such as, "It's natural to be worried. We recommend that you report the suspicious vehicle to the nearest police station. You may also want to consider installing surveillance cameras around your home."

[1211] Prompt Sentence Examples

[1212] Understand the user's concerns and generate the best response to alleviate their fears and worries. For example, if the user is reporting seeing a suspicious car, tailor your response using the following criteria:

[1213] 1. If you're feeling anxious, use a reassuring tone.

[1214] 2. Providing specific measures and information.

[1215] You are an AI assistant that understands emotions, so respond appropriately.

[1216] In this way, this system, which combines an emotion engine, enables responses that are sensitive to the user's emotions, improving the user experience.

[1217] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1218] Step 1:

[1219] The server starts the system, initializes the user database and log database, and reads various settings. This generates a user authentication screen and sends it to the terminal. The inputs are the server configuration file and the initial database information, and the output is the user authentication screen. Specific operations include establishing a database connection, reading the configuration file, and executing the screen generation algorithm.

[1220] Step 2:

[1221] The terminal displays a user authentication screen, and the user enters authentication information such as their My Number card or password. This input information is sent to the server. The input is the user's authentication information, and the authentication information is sent to the server as output. Specifically, the system displays a user interface and provides input fields.

[1222] Step 3:

[1223] The server receives authentication information from the user, compares it with the database, and if authentication is successful, starts a user session and loads profile information. The input is the user's authentication information, and the output is the authentication result and user profile information. Specific operations include querying the database, running the authentication algorithm, and generating session information.

[1224] Step 4:

[1225] The server generates a greeting message generated by an AI model and sends it to the device. The input is user profile information, and the output is the greeting message. Specific operations include calling the AI ​​model, running the message generation process, and sending the message to the device.

[1226] Step 5:

[1227] The terminal displays a chat screen and provides a field to accept input from the user. When the user inputs the content of their consultation by text or voice, the voice data is converted into text. The input is the user's consultation content, and the text version of the consultation content is generated as the output. Specific operations include displaying the chat screen and converting the voice data into text using voice recognition technology.

[1228] Step 6:

[1229] The server analyzes the input consultation content and uses a generative AI model to generate optimal questions and hearing items. The input is the text of the consultation content, and the output is the generation of optimal questions and hearing items. Specific operations include analyzing the consultation content, calling the AI ​​model, and the question generation process.

[1230] Step 7:

[1231] The server analyzes the user's voice and text input and recognizes the user's emotions using an emotion engine. This emotion data is reflected in the generation of a response. The input is the user's voice or text data, and the output is emotion data and a response. Specific operations include analyzing the voice and text input, calling the emotion engine, and the response generation process.

[1232] Step 8:

[1233] The device displays the generated questions and responses on the chat screen. At this time, the content and tone of the responses are adjusted according to the user's emotional state. The inputs are emotional data and question and response data, and the adjusted responses are displayed on the chat screen as the output. Specific operations include updating the chat screen and adjusting the responses based on the emotional data.

[1234] Step 9:

[1235] The server generates relevant administrative service information based on the user's consultation content and sends it to the terminal. The queried administrative service information is the input, and the generated information is sent to the terminal as the output. Specific operations include querying the administrative service database, information generation process, and sending the information to the terminal.

[1236] Step 10:

[1237] The device checks the provided information and inputs further questions as necessary. In response, the server generates an optimal response using the generative AI model and emotion engine. The input is additional question information, and the output is the generated response. Specific operations include processing the input of the question, calling the AI ​​model and emotion engine, and generating a response.

[1238] Step 11:

[1239] The server generates detailed information about the application procedure in question based on the user's consultation content and provides appropriate guidance according to the user's emotions. The input is the user's consultation content and emotion data, and the output is detailed information and guidance according to the emotion. Specific operations include analyzing the consultation content, generating procedure information, and generating guidance based on the emotion data.

[1240] Step 12:

[1241] When the server uploads a required document, it automatically completes the required information and adds a digital signature. The input is the document information uploaded by the user, and the output is a document with a digital signature. Specific operations include receiving and saving the document, applying the auto-completion algorithm, and adding a digital signature.

[1242] Step 13:

[1243] The server notifies the employee in charge of the accepted application details and tracks the progress. If there is a change in the progress, a notification based on the generative AI model and emotion data is sent to the terminal. The inputs are the application details and progress data, and notification data is generated as the output. Specific operations include checking the application details, tracking the progress, and generating notification data.

[1244] Step 14:

[1245] The terminal displays the latest progress to the user and updates it when further notifications are received. The input is progress notification data, and the output is the updated progress. Specific operations include updating the progress display, receiving notification data, and displaying it.

[1246] The above is the specific processing flow of this system.

[1247] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1248] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1249] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1250] [Third embodiment]

[1251] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1252] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1253] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1254] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1255] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1256] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1257] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1258] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1259] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1260] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1261] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1262] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1263] The present invention is a system that allows users to consult about or apply for government services 24 hours a day. This system includes a user authentication means, a response generation means using generative artificial intelligence, a means for providing government service information, a means for supporting online application procedures, and a means for notifying users of progress. The program processing of this system is explained below in natural language.

[1264] Initial Authentication and User Authentication

[1265] Program processing:

[1266] Server: When the system starts up, it initializes the user database and log database and loads various settings. When a user accesses the system, it generates a user authentication screen and sends it to the terminal.

[1267] Terminal: Displays the authentication screen and provides a screen where the user can enter information such as their My Number card and password.

[1268] User: Enter the required authentication information on the authentication screen and press the send button.

[1269] Server: Receives authentication information from the user, compares it with the database, and if authentication is successful, starts a user session. At this time, it reads the user's profile information and prepares for the next process.

[1270] Starting a conversation and listening to the details of your consultation

[1271] Program processing:

[1272] Server: After authentication, a greeting message (e.g., "Hello, what can you help us with?") is generated by the generative AI model and sent to the device.

[1273] Terminal: Displays the chat screen and provides a field for receiving input from the user.

[1274] User: Enters the content of the consultation by text or voice. If voice recognition technology is used, the voice data is converted into text.

[1275] Server: Analyzes the input consultation content and generates the next necessary questions and interview items using a generative AI model. Specifically, it automatically generates appropriate questions based on the consultation content and sends them back to the device.

[1276] Automated responses and appropriate information

[1277] Program processing:

[1278] Server: Based on the user's question or inquiry, the generative AI model generates relevant government service information, including links to relevant web pages, lists of required documents, and procedural details.

[1279] Terminal: The generated information is displayed on the chat screen.

[1280] User: Review the information provided and enter any further questions as needed.

[1281] Server: Responds to follow-up questions from the user and references past consultation history and user profile data to generate optimal responses.

[1282] Guidance and assistance with application procedures

[1283] Program processing:

[1284] Server: Based on the user's inquiry, the AI ​​model generates detailed information about the application procedure. It also generates a list of required documents and procedural steps and sends it to the device.

[1285] Terminal: Displays the documents and procedures required for the application process, helping users to easily proceed with the process.

[1286] User: Check the provided procedure information and prepare the necessary documents. Digital document upload function is also provided.

[1287] Server: When uploading required documents, digital signatures and automatic completion of required information are performed.

[1288] Complete and confirm your online application

[1289] Program processing:

[1290] Server: Receives documents uploaded by users, stores them in a database, and automatically checks the contents of the documents. If there are any errors, the server notifies the user and prompts them to make corrections.

[1291] Terminal: Provides an interface for checking the upload screen and created documents.

[1292] User: Scans or photographs the necessary documents, uploads them to the device, and proceeds with the procedure.

[1293] Progress notification and follow-up

[1294] Program processing:

[1295] Server: Notifies the employee of the details of the accepted application and tracks the progress. If there is a change in the progress, a notification is generated by the AI ​​model and sent to the user's device.

[1296] Terminal: Shows progress updates to the user.

[1297] Users: Ask follow-up questions as needed to check progress.

[1298] This system is designed to enable users to use government services effectively, regardless of time or location, by incorporating voice recognition technology and a response optimization function that learns from past consultation history, thereby providing highly convenient government services to a diverse range of users.

[1299] The processing flow will be explained below.

[1300] Step 1:

[1301] The server starts the system, initializes the user database and log database, and reads various settings.

[1302] Step 2:

[1303] The terminal detects the user's access and displays a user authentication screen.

[1304] Step 3:

[1305] The user enters authentication information such as their My Number card and password on the authentication screen and presses the send button.

[1306] Step 4:

[1307] The server receives the entered authentication information, checks it against a database, and if authentication is successful, starts a user session and loads the profile information.

[1308] Step 5:

[1309] After authentication, the server generates a greeting message (e.g., "Hello, how can I help you?") generated by the AI ​​model and sends it to the device.

[1310] Step 6:

[1311] The terminal displays a chat screen and provides fields for accepting input from the user.

[1312] Step 7:

[1313] The user inputs the content of their inquiry into the chat screen either by text or by voice. If the user inputs voice, it is converted into text using voice recognition technology.

[1314] Step 8:

[1315] The server analyzes the input consultation content and uses a generative AI model to generate optimal questions and hearing items.

[1316] Step 9:

[1317] The device displays the generated question on the chat screen.

[1318] Step 10:

[1319] The user enters the details and submits.

[1320] Step 11:

[1321] The server uses a generative AI model to generate appropriate administrative service information (links to related web pages, lists of required documents, procedural details, etc.) based on user input.

[1322] Step 12:

[1323] The terminal displays the generated information on the chat screen.

[1324] Step 13:

[1325] The user reviews the information provided and enters further questions if necessary.

[1326] Step 14:

[1327] To respond to additional questions, the server refers to the generative AI model, past consultation history, and profile data to generate the optimal response.

[1328] Step 15:

[1329] The device displays the additional response on the chat screen.

[1330] Step 16:

[1331] The user checks the application procedure information provided and prepares the necessary documents.

[1332] Step 17:

[1333] The server generates a list of documents and procedures required for the procedure and sends it to the terminal.

[1334] Step 18:

[1335] The device will display detailed information about the application process (document list, instructions, etc.).

[1336] Step 19:

[1337] The user scans or photographs the required documents and uploads them.

[1338] Step 20:

[1339] The server receives the uploaded documents, stores them, automatically checks their contents, and generates notifications if there are any errors.

[1340] Step 21:

[1341] The terminal displays the results of automatic document checks and correction requirements.

[1342] Step 22:

[1343] The user corrects the document as needed and re-uploads it.

[1344] Step 23:

[1345] The server accepts the application and notifies the relevant staff of the progress.

[1346] Step 24:

[1347] The server tracks the progress of the application, and if there are any changes, a generative AI model generates a notification and sends it to the device.

[1348] Step 25:

[1349] The device will display progress updates to the user and update them if further notices arise.

[1350] Step 26:

[1351] Users can check in on progress and ask additional questions or follow up as needed.

[1352] Example 1

[1353] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1354] Today's busy lives demand systems that enable users to access government services quickly and efficiently. However, current systems struggle to consistently and efficiently handle user authentication, analysis of consultation content, generation of appropriate responses, document upload and application completion, and progress notifications. Another challenge is properly converting users' voice input into text and providing appropriate responses based on the consultation content. Furthermore, there is a need to utilize past consultation history to improve the accuracy of responses to users.

[1355] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1356] In this invention, the server includes means for user authentication, means for analyzing the user's consultation content using a generation artificial intelligence and generating an appropriate response, means for automatically providing appropriate administrative information in response to questions from the user, means for the user to upload necessary documents and complete the application procedure online, means for checking the application content and notifying the progress, means for the generation artificial intelligence to generate a greeting message after authentication and send it to the terminal, means for analyzing the received consultation content and automatically generating the next necessary question using the generation artificial intelligence, and means for automatic checking and electronic signature.This enables users to efficiently consult or apply for administrative services 24 hours a day, and realizes the generation of optimal responses using voice input and past consultation history.

[1357] "User authentication" is the process of verifying the identity of a user accessing a system.

[1358] "Generative AI" is an AI technology that analyzes input data and generates appropriate responses.

[1359] "Analysis of consultation content" is a process for processing the consultation content entered by the user and understanding its meaning and requirements.

[1360] "Generating an appropriate response" is a procedure for automatically creating the most appropriate response to the user based on the analyzed consultation content.

[1361] "Administrative information" refers to information about various services and procedures provided by the government and local governments.

[1362] "Document upload" refers to the act of a user submitting the required documents in digital form to the system.

[1363] "Completing an application" is the process by which a user completes a particular administrative procedure by submitting the required documents and providing the required information.

[1364] "Progress notification" means informing the user of the progress of the application procedure.

[1365] The "greeting message" is the first message that the system sends to the user, and usually includes content that asks the user what they want to discuss.

[1366] "Automatic question generation" is the process in which artificial intelligence automatically creates the next necessary question based on the user's consultation content.

[1367] "Automatic check" is a procedure in which the system automatically verifies the contents of submitted documents.

[1368] An "electronic signature" is a digital signature that ensures the authenticity of a document and the identity of its sender.

[1369] The present invention is a system that allows users to consult about or apply for government services 24 hours a day. This system includes a user authentication means, a response generation means using artificial intelligence, a government information provision means, an online application procedure support means, and a progress notification means. Specific embodiments of this system are described below.

[1370] User authentication methods

[1371] First, when a user accesses the system, the server generates a user authentication screen and sends it to the terminal. The terminal displays the authentication screen and provides an interface for the user to enter their My Number card and password. When the user enters and submits their authentication information, the server receives it and compares it with the user database. If authentication is successful, the server starts a user session and loads their profile information.

[1372] Response generation method using generative artificial intelligence

[1373] Once authentication is complete, the server uses generative AI (e.g., ChatGPT) to generate a greeting message and send it to the device. For example, it generates a message like, "Hello, what would you like to discuss?" The device displays this message on the chat screen and provides a field for the user to enter the content of their consultation. Once the user enters the content of their consultation, the server receives it, analyzes it using a generative AI model, and automatically generates the next necessary question.

[1374] Administrative information provision means

[1375] The server generates relevant administrative information based on the user's question or inquiry using a generative AI model (e.g., BERT). This information includes links to related web pages, a list of required documents, and details of procedures. The generated information is sent to the device, which then displays it on the chat screen.

[1376] Online application procedure support

[1377] A particularly important process occurs when a user uploads the required documents. The device provides a digital document upload function and sends the documents prepared by the user to the server. The server receives the uploaded documents, applies the necessary digital signatures, and automatically checks the contents of the documents. If any required information is missing or incomplete, the server sends a notification to the user prompting them to make corrections.

[1378] Progress notification method

[1379] The server notifies the employee of the accepted application and tracks its progress. If there are any changes in the progress, the server generates the content using a generative AI model and notifies the user. The terminal displays the latest progress to the user. The user can ask additional questions as needed to check the progress.

[1380] Hardware and software used

[1381] The hardware includes high-performance server computers and dedicated database servers, while the software includes generative AI models (e.g., ChatGPT, BERT, etc.), speech recognition technology, natural language processing engines, and digital signature technology.

[1382] Examples and prompts

[1383] For example, if the device displays "Hello, what would you like to discuss?", the user can enter "Please tell me about the procedures for childcare support." The server analyzes this input, generates the next question, "Please tell me the ages of your children," and sends it back to the device. The server then displays the generated detailed procedure information and a list of required documents on the device, helping the user to easily complete the procedures.

[1384] As described above, the present invention is designed to enable users to efficiently use government services without being restricted by time or location, allowing users to quickly and accurately complete government procedures online.

[1385] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1386] Step 1:

[1387] The server generates a user authentication screen and sends it to the terminal.

[1388] Input: System startup and user access

[1389] Output: Authentication screen

[1390] Specific operation: The server initializes the user database and log database, reads the settings, then generates a user authentication screen and sends it to the terminal.

[1391] Step 2:

[1392] The terminal displays a user authentication screen and provides an interface for the user to enter their My Number card and password.

[1393] Input: Authentication screen from the server

[1394] Output: Authentication entry screen shown to the user

[1395] What happens: The device renders "login.html" and displays it to the user, providing fields where the user can enter their authentication information.

[1396] Step 3:

[1397] The user enters their My Number card information and password and presses the send button.

[1398] Input: Information to be entered on the authentication screen

[1399] Output: Authentication information sent to the server

[1400] Specific operations: The user holds their My Number card over the reader, enters the PIN code, and presses the send button.

[1401] Step 4:

[1402] The server checks the received authentication information against a user database, and if authentication is successful, starts a user session.

[1403] Input: Credentials from the user

[1404] Output: Authentication result and session start

[1405] Specific behavior: The server checks the authentication information against "users_db" and, if successful, generates a session ID and loads the profile information.

[1406] Step 5:

[1407] The server uses artificial intelligence to generate a greeting message and sends it to the terminal.

[1408] Input: Session information after authentication is complete

[1409] Output: Greeting message

[1410] Specific behavior: Use a generative AI model (e.g., ChatGPT) to generate a message saying "Hello, how can I help you?" and send it to the device.

[1411] Step 6:

[1412] The terminal displays a chat screen and provides a field where the user can enter the content of the consultation.

[1413] Input: Greeting message from the server

[1414] Output: The chat screen that the user sees

[1415] Specific behavior: The device displays "chat.html" containing a greeting message and an input field.

[1416] Step 7:

[1417] The user inputs the consultation content by text or voice and presses the send button.

[1418] Input: Enter the consultation details

[1419] Output: Consultation content sent to the server

[1420] Specific operation: The user enters the content of the consultation into the text field and presses the send button, or they can input it by voice. In the case of voice, it is converted into text using voice recognition technology.

[1421] Step 8:

[1422] The server analyzes the consultation content received and uses artificial intelligence to generate the next necessary questions and hearing items.

[1423] Input: User's inquiry

[1424] Output: Next question or hearing item

[1425] Specific operation: The server analyzes the consultation content received using a natural language processing engine and generates the next question using a generative AI model (e.g., ChatGPT).

[1426] Step 9:

[1427] The server uses a generative AI model to generate relevant administrative information based on the user's questions or inquiries, and sends it to the terminal.

[1428] Input: Questions and inquiries from users

[1429] Output:Administrative information

[1430] Specific operation: The server uses a generative AI model (e.g., BERT) to generate relevant web page links, a list of required documents, procedural details, etc., and sends them to the terminal.

[1431] Step 10:

[1432] The terminal displays the generated information on the chat screen.

[1433] Input: Administrative information from the server

[1434] Output: Administrative information displayed to the user

[1435] Specific operation: The device renders "chat.html" containing administrative information and displays it on the chat screen.

[1436] Step 11:

[1437] The user prepares the necessary documents and uploads them via the terminal.

[1438] Input: Required documents

[1439] Output: Digital document sent to the server

[1440] Specific operation: The user scans a document and presses the send button using the device's upload function.

[1441] Step 12:

[1442] The server stores the received documents and performs digital signatures and automatic checks.

[1443] Input: Uploaded digital document

[1444] Output: Confirmation message or correction request notification

[1445] Specific operation: The server saves the document in a database, automatically checks its contents, and if there are any errors, sends a notification to the user to correct them.

[1446] Step 13:

[1447] The server notifies the appropriate staff of accepted applications and tracks their progress.

[1448] Input: Application details

[1449] Output: Progress

[1450] Specific operation: The server notifies the application details to the progress management system, tracks the progress, and notifies the relevant staff of the necessary information.

[1451] Step 14:

[1452] If the server detects any changes in the progress, it generates a notification for the user using the AI ​​model and sends it to the device.

[1453] Input: Progress Change

[1454] Output: Progress notification

[1455] Specific operation: Using a generative AI model (e.g., ChatGPT), a message notifying of progress changes (e.g., "Your application has been accepted. The current progress is ____") is generated and sent to the device.

[1456] Step 15:

[1457] The device displays progress updates to the user.

[1458] Input: Progress notification from the server

[1459] Output: Progress displayed to the user

[1460] Specific behavior: The device renders "progress.html" containing the progress and displays it to the user.

[1461] (Application example 1)

[1462] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1463] Conventional government services have faced challenges, such as users being restricted by time and location, making it difficult to provide 24-hour service. Waiting times at the counter are also common, necessitating greater efficiency. Furthermore, there are limited ways for users to accurately obtain the information they need. Meanwhile, there are also issues with elderly people and those unfamiliar with technology, such as difficulty completing electronic application procedures.

[1464] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1465] In this invention, the server includes a user authentication means, a means for analyzing the content of the user's consultation using artificial intelligence and generating an appropriate response, and a means for automatically providing appropriate administrative service information in response to a question from the user, thereby enabling users to efficiently obtain the information and procedures they need 24 hours a day.

[1466] "User authentication means" refers to a means for identifying and authenticating a user, and examples include facial recognition technology and My Number card reading functions.

[1467] "Generative AI" refers to AI that uses a generative AI model to generate appropriate responses based on user input.

[1468] The "response generation means" is a system component that analyzes the content of the user's consultation and generates an appropriate response based on that analysis.

[1469] The "administrative service information providing means" is a system function that automatically provides information on related administrative services in response to a user's question.

[1470] The "means for completing the application procedure online" is a system function that allows users to upload the necessary documents and complete the application procedure online.

[1471] The "progress status notification means" is a system function for checking the application content and notifying the user of the progress status.

[1472] "Facial recognition technology" is a technology that uses a camera to recognize a user's face and authenticate the user based on this.

[1473] "Real-time response generation means" is a system function that uses a generative AI model to generate a response based on user input in real time.

[1474] A "robot display" is a display device mounted on a robot that visually provides information to the user.

[1475] "Speech recognition technology" is a technology that converts a user's voice into text and analyzes it.

[1476] "Means for learning past consultation history" is a system function that accumulates past consultation details and user interactions and optimizes future responses based on that information.

[1477] This invention is a system that allows users to consult about or apply for government services 24 hours a day. This system includes a user authentication means, a response generation means using generative artificial intelligence, a government service information provision means, an online application procedure support means, and a progress notification means.

[1478] Initial Authentication and User Authentication

[1479] Program processing:

[1480] When the system starts up, the server initializes the user database and log database and loads various settings. When a user accesses the system, it generates a user authentication screen and sends it to the terminal. The terminal displays the authentication screen and provides a screen where the user can enter information such as facial recognition technology and My Number card information. The user enters the necessary authentication information on the authentication screen and presses the send button. The server receives the authentication information from the user, compares it with the database, and if authentication is successful, starts the user session. At this time, it loads the user's profile information and prepares for the next process.

[1481] Starting a conversation and listening to the details of your consultation

[1482] Program processing:

[1483] After authentication, the server generates a greeting message (e.g., "Hello, what would you like to discuss?") using the generative AI model and sends it to the device. The device displays a chat screen and provides a field to receive input from the user. The user inputs the content of the consultation using text or voice. If voice recognition technology is used, the voice data is converted into text. The server analyzes the input consultation content and then generates the necessary questions and hearing items using the generative AI model. Specifically, it automatically generates appropriate questions based on the consultation content and sends them back to the device.

[1484] Automated responses and appropriate information

[1485] Program processing:

[1486] The server uses a generative AI model to generate relevant government service information based on the user's questions and inquiries. This information includes links to relevant web pages, lists of required documents, and detailed procedures. The device displays the generated information on the chat screen. The user can review the information provided and enter further questions as needed. The server responds to the user's additional questions and references past consultation history and user profile data to generate the most appropriate response.

[1487] Guidance and assistance with application procedures

[1488] Program processing:

[1489] Based on the user's inquiry, the server uses a generative AI model to generate detailed information about the applicable application procedure. A list of the required documents and procedural steps is generated and sent to the device. The device displays the documents and procedures required for the application procedure, helping the user to easily proceed with the procedure. The user checks the provided procedural information and prepares the necessary documents. At this time, a function to upload digital documents is also provided. When uploading the required documents, the server automatically completes the required information and digital signatures.

[1490] Complete and confirm your online application

[1491] Program processing:

[1492] The server receives documents uploaded by users, stores them in a database, and automatically checks the contents of the documents. If there are any errors, it notifies the user and prompts them to make corrections. The terminal provides an interface for checking the upload screen and completed documents. The user scans or photographs the necessary documents, uploads them to the terminal, and proceeds with the procedure.

[1493] Progress notification and follow-up

[1494] Program processing:

[1495] The server notifies the responsible employee of the accepted application and tracks its progress. If there is a change in the progress, a notification is generated by the AI ​​model and sent to the user's device. The device displays the latest progress to the user. The user can ask additional questions as needed to check the progress.

[1496] As a concrete example, this system is used in robots installed in brick-and-mortar stores such as city halls. When citizens visit the office, they are authenticated using facial recognition technology, and a generative AI model is used to accept and respond to inquiries in real time. For example, if a user types in "Can you tell me about renewing my passport?", the system generates a response such as "Here is the necessary procedural information. Please see the link:..."

[1497] Example prompt sentence:

[1498] User: What about renewing my passport?

[1499] System: Please refer to this link for passport renewal: [LINK]

[1500] In order to specifically implement the invention, it is necessary to build a system in which various hardware and software work together. The main hardware used includes a robot with a camera, a My Number card reader, a scanner, etc., and the software used includes a generative AI model (e.g., GPT-2), voice recognition technology, and face recognition technology (e.g., the face_recognition library).

[1501] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1502] Step 1:

[1503] When the system starts up, the server initializes the user database and log database and loads various settings. When a terminal accesses the server, the server generates a user authentication screen and sends it to the terminal. The user database stores pre-registered user information, and the log database records past access history and operation logs. This puts the system into a ready state.

[1504] Step 2:

[1505] The device displays the user authentication screen sent from the server. The user is instructed to stand in front of the facial recognition camera, and the system performs facial recognition. A My Number card reader may be used to enter the required authentication information. The input information (face image and My Number card data) is sent to the server.

[1506] Step 3:

[1507] The server receives the authentication information sent from the device and checks it against a user database. It uses facial recognition technology to compare the user's facial image with those in the database. At the same time, it checks the data on the My Number card. If authentication is successful, the server starts a user session and loads the user's profile information. It then sends an authentication success message to the device.

[1508] Step 4:

[1509] After successful authentication, the server uses a generative AI model to generate a greeting message (e.g., "Hello, how can I help you?") and sends it to the device. The greeting message is an important first step in an automated response.

[1510] Step 5:

[1511] The device displays the greeting message sent from the server on the chat screen. The user inputs the content of the consultation by text or voice. In the case of voice input, the device uses voice recognition technology to convert the voice data into text and send it to the server.

[1512] Step 6:

[1513] The server receives the text of the consultation sent by the user and analyzes the content using a generative AI model. Specifically, the generative AI model analyzes the input text and automatically generates the next necessary questions and hearing items. The generated questions and hearing items are then sent back to the device.

[1514] Step 7:

[1515] The terminal displays the questions and hearing items sent from the server on the chat screen and waits for further input from the user. The user inputs additional questions and information as appropriate and sends them from the terminal to the server.

[1516] Step 8:

[1517] The server receives additional questions and information from the user and uses a generative AI model to generate appropriate government service information based on the information. The information includes links to related web pages, lists of required documents, and details of procedures. The generated information is then sent to the device.

[1518] Step 9:

[1519] The terminal displays the information sent from the server on the chat screen. The user checks the provided information and enters further questions as necessary. The server references past consultation history and user profile data to generate the optimal response.

[1520] Step 10:

[1521] Based on the user's inquiry, the server uses a generative AI model to generate detailed information about the application procedure. This generates a list of required documents and procedural steps and sends it to the device. The device then displays the documents and steps required for the application procedure, helping the user to easily proceed with the procedure.

[1522] Step 11:

[1523] The user checks the provided procedure information and prepares the necessary documents. At this time, a digital document upload function is also provided. The user automatically completes the digital signature and necessary information and uploads the documents. The uploaded documents are sent to the server.

[1524] Step 12:

[1525] The server receives documents uploaded by users and stores them in a database. The contents of the documents are automatically checked, and if there are any errors, the user is notified and prompted to make corrections. The user can check the upload screen and created documents from their device and make corrections as necessary.

[1526] Step 13:

[1527] The server notifies the employee of the application and tracks its progress. If there are any changes in the progress, the generative AI model generates a notification and sends it to the terminal. The terminal then displays the latest progress to the user and accepts additional questions as needed.

[1528] Examples:

[1529] If the user types "Tell me about renewing my passport," the system generates a response like "Here's the procedure you need. Please see the link:..."

[1530] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1531] This invention is a system that allows users to consult about or apply for government services 24 hours a day. By combining this system with an emotion engine that recognizes user emotions and optimizes responses, the aim is to provide more flexible and user-friendly services. This system includes a user authentication means, a response generation means using generative artificial intelligence, a means for providing government service information, a means for supporting online application procedures, a progress notification means, and an emotion engine. The program processing of this system is explained below in natural language.

[1532] Initial Authentication and User Authentication

[1533] Program processing:

[1534] The server starts the system, initializes the user database and log database, and loads various settings. When a user accesses the system, it generates a user authentication screen and sends it to the terminal.

[1535] The terminal displays a user authentication screen, providing a screen where the user can enter authentication information such as their My Number card or password.

[1536] The user enters the required authentication information on the authentication screen and presses the send button.

[1537] The server receives authentication information from the user, checks it against a database, and if authentication is successful, starts a user session and loads profile information.

[1538] Starting a conversation and listening to the details of your consultation

[1539] Program processing:

[1540] After authentication, the server generates a greeting message (e.g., "Hello, how can I help you?") generated by the AI ​​model and sends it to the device.

[1541] The terminal displays a chat screen and provides fields for accepting input from the user.

[1542] The user inputs the content of their consultation on the chat screen using text or voice. If voice recognition technology is used, the voice data is converted into text.

[1543] The server analyzes the input consultation content and uses a generative AI model to generate optimal questions and hearing items.

[1544] Emotion recognition and response optimization

[1545] Program processing:

[1546] The server analyzes the user's voice and text inputs and uses an emotion engine to recognize the user's emotions. This emotion data is then reflected in the generation of responses.

[1547] The device displays the generated questions and responses on the chat screen, adjusting the content and tone of the responses depending on the user's emotional state.

[1548] The user enters more information or asks additional questions and submits.

[1549] The server references the emotion engine and past consultation history to optimize the response based on the current emotional state.

[1550] Automated responses and appropriate information

[1551] Program processing:

[1552] The server uses a generative AI model to generate relevant government service information based on the user's inquiry, including links to relevant web pages, lists of required documents, and procedural details.

[1553] The terminal displays the generated information on the chat screen.

[1554] The user reviews the information provided and enters further questions if necessary.

[1555] The server uses generative AI models and emotion engines to generate optimal responses to follow-up questions.

[1556] Guidance and assistance with application procedures

[1557] Program processing:

[1558] Based on the user's inquiry, the server uses a generative AI model to generate detailed information about the application procedure in question, and provides appropriate guidance based on the user's emotions.

[1559] The device displays a list of the documents and procedures required for the application process, making it easier for users to proceed with the process.

[1560] Users can review the provided procedure information and prepare the necessary documents, including the ability to upload digital documents.

[1561] When the server uploads the required documents, it digitally signs them and automatically completes the required information.

[1562] Complete and confirm your online application

[1563] Program processing:

[1564] The server receives documents uploaded by users, stores them in a database, and automatically checks the contents. If there are any errors, the server notifies the user and prompts them to correct them.

[1565] The device provides an interface for viewing the upload screen and created documents.

[1566] The user scans or photographs the necessary documents, uploads them to the device, and proceeds with the procedure.

[1567] Progress notification and follow-up

[1568] Program processing:

[1569] The server notifies the employee of the details of the accepted application and tracks the progress. If there are any changes in the progress, a notification based on the generative AI model and emotion data is sent to the device.

[1570] The device will display progress updates to the user and update them if further notices arise.

[1571] Users can check in on progress and ask additional questions or follow up as needed.

[1572] In this way, a system incorporating an emotion engine can respond in a way that is sensitive to the user's emotions, improving the user experience and providing more satisfying government services.

[1573] The processing flow will be explained below.

[1574] Step 1:

[1575] The server starts the system, initializes the user database and log database, and reads various settings.

[1576] Step 2:

[1577] The terminal detects the user's access and displays a user authentication screen.

[1578] Step 3:

[1579] The user enters authentication information such as their My Number card and password on the authentication screen and presses the send button.

[1580] Step 4:

[1581] The server receives the entered authentication information, checks it against a database, and if authentication is successful, starts a user session and loads the profile information.

[1582] Step 5:

[1583] After authentication, the server generates a greeting message (e.g., "Hello, what can you help us with?") generated by the generative AI model and sends it to the device.

[1584] Step 6:

[1585] The terminal displays a chat screen and provides fields for accepting input from the user.

[1586] Step 7:

[1587] The user inputs the content of their inquiry on the chat screen either by text or by voice. In the case of voice input, the voice input is converted into text using voice recognition technology.

[1588] Step 8:

[1589] The server analyzes the input consultation content and uses a generative AI model to generate appropriate questions and hearing items.

[1590] Step 9:

[1591] The device displays the generated question on the chat screen.

[1592] Step 10:

[1593] The user enters the details and submits.

[1594] Step 11:

[1595] The server collects user input and uses an emotion engine to analyze the user's emotions. Based on the results, it generates an optimal response according to the user's emotional state.

[1596] Step 12:

[1597] The device displays the generated response on the chat screen, adjusting the content and tone of the response depending on the user's emotional state.

[1598] Step 13:

[1599] The user reviews the information provided and enters further questions if necessary, during which sentiment is again analyzed.

[1600] Step 14:

[1601] The server refers to the emotion engine and past consultation history based on additional questions or consultation content, optimizes the response, and then sends it.

[1602] Step 15:

[1603] The device will display an optimized response on the chat screen.

[1604] Step 16:

[1605] The user checks the application procedure information provided and prepares the necessary documents.

[1606] Step 17:

[1607] The server generates a list of documents and procedures required for the procedure and sends it to the terminal.

[1608] Step 18:

[1609] The device will display detailed information about the application process (document list, instructions, etc.).

[1610] Step 19:

[1611] The user scans or photographs the required documents and uploads them.

[1612] Step 20:

[1613] The server receives the uploaded documents, stores them, and automatically checks their contents. If there are any errors, it notifies the user and prompts them to correct them.

[1614] Step 21:

[1615] The terminal displays the results of automatic document checks and correction requirements.

[1616] Step 22:

[1617] The user corrects the document as needed and re-uploads it.

[1618] Step 23:

[1619] The server accepts the application and notifies the relevant staff of the progress.

[1620] Step 24:

[1621] The server tracks the progress of the application, and if there is a change in the progress, it generates a notification based on the emotion data and sends it to the device.

[1622] Step 25:

[1623] The device will display progress updates to the user and update them if further notices arise.

[1624] Step 26:

[1625] The user checks the progress and asks additional questions or follow-ups as needed. Again, the emotion engine performs sentiment analysis based on the user's input and generates an appropriate response.

[1626] In this way, administrative services can be provided in a way that is in tune with the user's feelings, and it is expected that user satisfaction will increase.

[1627] Example 2

[1628] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1629] Current government services are time-constrained for users, and they are unable to make consultations or applications, especially outside of office hours. It is also difficult for users to check the progress of documents and procedures submitted in real time. Furthermore, standardized responses are provided without consideration for users' feelings, resulting in low satisfaction for many users. The present invention aims to solve these problems.

[1630] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1631] In this invention, the server includes a user authentication means, a means for analyzing the content of the user's consultation using generative artificial intelligence and generating an appropriate response, a means for automatically providing appropriate information in response to a user's question, an online processing means for the user to upload necessary documents and complete the application procedure, a means for checking the application content and notifying the progress, and a means for recognizing the user's emotions and optimizing the response. This allows users to access government services 24 hours a day, check the progress in real time, and receive responses that are sensitive to their emotions.

[1632] "User authentication means" refers to a means for verifying that a user has legitimate access rights by entering authentication information such as a My Number card or password when accessing a system.

[1633] "Generative AI" is an AI technology that uses a generative AI model to analyze input data and automatically generate the optimal response for the user.

[1634] The "means for analyzing the consultation content and generating an appropriate response" is a means for analyzing the consultation content input by the user and generating appropriate questions and answers according to the content.

[1635] A means for providing "appropriate information" is a means for searching and providing the most appropriate information in response to a user's question.

[1636] "Online processing means for uploading required documents and completing application procedures" refers to a means by which a user uploads the documents required to complete the application procedures online and processes those documents within the system.

[1637] The "means for checking application content and notifying progress status" is a means for tracking the application content submitted by the user and notifying the user of the progress status in real time.

[1638] "Means for recognizing emotions and optimizing responses" refers to means for recognizing a user's emotions by analyzing voice data and text, and providing an optimal response according to those emotions.

[1639] The present invention is a system that allows users to consult about or apply for government services 24 hours a day. This system includes a user authentication means, a response generation means using a generative AI model, an appropriate information provision means, an online application procedure means, a progress notification means, and an emotion recognition means. The specific processing of each means is explained below.

[1640] User authentication method

[1641] When the system starts up, the server initializes the user database and log database and loads various settings. When a user accesses the system, the server generates an authentication screen and sends it to the terminal. The terminal displays the authentication screen, and the user enters authentication information such as their My Number card or password. When the user submits the authentication information, the server verifies it, and if successful, starts a user session and loads the profile information.

[1642] Response generation method using generative AI model

[1643] After the user is authenticated, the server uses a generative AI model to generate a greeting message and sends it to the device. The device then displays a chat screen and accepts user input. When the user inputs their consultation details via text or voice, the server analyzes them and generates the most appropriate questions and questions to ask. For example, it generates a message such as "Hello, what would you like to discuss?"

[1644] Appropriate means of providing information

[1645] Based on the user's inquiry, the server uses a generative AI model to generate relevant government service information. This includes links to related web pages, lists of required documents, and detailed procedures. The generated information is sent to the terminal so that the user can review it. If the user enters further questions, the server will also use the generative AI model to generate optimal responses to those additional questions.

[1646] Online application procedures

[1647] Documents submitted by users are uploaded from their devices to the server. The server stores the uploaded documents in a database and performs automatic checks. If there are any deficiencies, the user is notified and prompted to make corrections. Details of online applications are automatically filled in with digital signatures and required information.

[1648] Progress notification method

[1649] The server notifies the responsible employee of accepted applications and tracks their progress. Any changes in progress are notified to the device based on the generative AI model and emotion data. The device displays the latest progress to the user and updates them with any further notifications. The user can view the progress and ask additional questions or follow up as needed.

[1650] emotion recognition means

[1651] The server analyzes the user's voice and text inputs and uses an emotion engine to recognize the user's emotions. The emotion data is then used to generate responses. For example, if the server detects that the user is feeling anxious, it will generate a more reassuring response.

[1652] Examples:

[1653] If a user wants to apply for a copy of their resident registration card, they input a prompt sentence such as, "Hello, I would like to get a copy of my resident registration card. How do I do this?" The system uses an emotion engine to return a response that increases the user's sense of security. For example, the system might generate a response such as, "Don't worry, we'll guide you through the necessary steps."

[1654] The above is a specific embodiment of the system of the present invention. This system allows users to use government services 24 hours a day while receiving compassionate support.

[1655] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1656] Specific flow of processing steps

[1657] Initial Authentication and User Authentication

[1658] Step 1: Start the system and initialize the database

[1659] The server starts the system.

[1660] The server initializes the user database and log database and loads various settings.

[1661] Input: System startup command

[1662] Output: Initialized database and loaded settings

[1663] Step 2: Generate and send the authentication screen

[1664] The server detects user access and generates an authentication screen.

[1665] The server sends an authentication screen to the terminal.

[1666] Specific operation: Generates an HTML template for the authentication screen and constructs an HTTP response.

[1667] Input: User access data

[1668] Output: HTML data of the authentication screen

[1669] Step 3: Enter and submit your credentials

[1670] The device displays an authentication screen and provides fields for entering authentication information.

[1671] The user enters authentication information such as their My Number card and password and presses the send button.

[1672] Specific operation: Validates the input form and processes the submission of authentication information.

[1673] Input: User credentials

[1674] Output: Sending authentication information to the server

[1675] Step 4: Verify credentials and start a session

[1676] The server receives authentication information from the user and checks it against a database.

[1677] If authentication is successful, the server starts a user session and loads profile information.

[1678] Specific operation: Runs the authentication information matching algorithm and initializes session information.

[1679] Input: User credentials

[1680] Output: Authentication result and session ID

[1681] Starting a conversation and listening to the details of your consultation

[1682] Step 5: Generate and send a greeting message

[1683] After authentication, the server uses a generative AI model to generate a greeting message (e.g., "Hello, how can I help you?").

[1684] The server sends a greeting message to the terminal.

[1685] Specific operation: Call the generative AI model and generate an appropriate message.

[1686] Input: User authentication success data

[1687] Output: Greeting message

[1688] Step 6: Display the chat screen and accept input

[1689] The terminal displays a chat screen and provides fields for the user to enter information.

[1690] The user inputs the consultation content by text or voice.

[1691] Specific operation: Renders the chat interface and accepts user input.

[1692] Input: Greeting message

[1693] Output: User input data

[1694] Step 7: Analyzing the consultation content and generating questions

[1695] The server analyzes the input consultation content and uses a generative AI model to generate optimal questions and hearing items.

[1696] The server sends the generated question to the terminal.

[1697] Specific operation: Analyzes using natural language processing algorithms and generates a response from a generative AI model.

[1698] Input: User's inquiry

[1699] Output: Generated questions

[1700] Emotion recognition and response optimization

[1701] Step 8: Sentiment analysis and response adjustment

[1702] The server analyzes the voice and text input from the user and recognizes the user's emotions using an emotion engine.

[1703] The server adjusts the content and tone of the response based on the emotional data.

[1704] Specific operations: Executes sentiment analysis algorithm and adjusts parameters for response generation.

[1705] Input: User input data and sentiment analysis results

[1706] Output: Adjusted response

[1707] Step 9: Viewing Optimized Questions

[1708] The device displays the generated questions and responses on the chat screen.

[1709] The user enters more information or a follow-up question and submits.

[1710] Specific operation: Update the chat interface and re-process input.

[1711] Input: Adjusted response

[1712] Output: Additional user input data

[1713] Step 10: Continuously optimize your response

[1714] The server references the emotion engine and past consultation history to continually optimize responses based on the current emotional state.

[1715] Specific operations: Refer to the history database and evaluate emotion data.

[1716] Input: User's emotional data and past consultation history

[1717] Output: Optimal response reflecting current emotional state

[1718] Automated responses and appropriate information

[1719] Step 11: Generate and send relevant information

[1720] The server generates relevant administrative service information using a generative AI model based on the user's consultation content and sends it to the terminal.

[1721] What it does: Uses generative AI models to find and generate relevant information.

[1722] Input: User's inquiry

[1723] Output: Relevant information (e.g., list of required documents, details of procedure)

[1724] Step 12: View and verify information

[1725] The terminal displays the generated information on the chat screen.

[1726] The user reviews the information provided and enters any additional questions.

[1727] Specific operation: Renders the generated information and accepts user input.

[1728] Input: Generated related information

[1729] Output: Additional user input data

[1730] Step 13: Generate additional questions and responses

[1731] The server uses the generative AI model and emotion engine to generate the optimal response to the user's follow-up question and sends it to the device.

[1732] Specific action: The generative AI model is called again to generate an appropriate response.

[1733] Input: User's additional question

[1734] Output: The generated response

[1735] Guidance and assistance with application procedures

[1736] Step 14: Generate and display application information

[1737] Based on the consultation content, the server uses a generative AI model to generate detailed information about the relevant application procedure and sends it to the terminal.

[1738] The device will display a list of the documents and procedures required for the application process.

[1739] Specific operation: Use a generative AI model to generate and list application procedure information.

[1740] Input: User's inquiry

[1741] Output: Detailed information on application procedures

[1742] Step 15: Check and prepare your procedures

[1743] The user checks the provided procedure information and prepares the necessary documents.

[1744] The terminal provides the function of uploading digital documents.

[1745] Specific operation: Displays procedural information and provides an upload interface.

[1746] Input: Application procedure details

[1747] Output: User-prepared document data

[1748] Step 16: Upload documents and auto-complete

[1749] The user scans or photographs the required documents and uploads them to the device.

[1750] The server receives the uploaded documents, stores them in a database, and performs digital signatures and auto-completes required information.

[1751] Specific Actions: Receives uploaded documents, adds digital signatures, and handles auto-completion.

[1752] Input: User document data

[1753] Output: Saved data and completed information

[1754] Complete and confirm your online application

[1755] Step 17: Automatically check and save application details

[1756] The server stores the uploaded documents in a database and automatically checks their contents.

[1757] If there is an error, the server will notify the user and prompt them to correct it.

[1758] Specific operations: Automatically verify document contents and generate notices of deficiencies.

[1759] Input: Uploaded documents

[1760] Output: Verification results and deficiency notices

[1761] Step 18: Display the application screen

[1762] The device provides an interface for viewing the upload screen and created documents.

[1763] Specific operation: Renders the document confirmation interface.

[1764] Input: Application procedure progress

[1765] Output: Check interface

[1766] Step 19: Completion of the procedure

[1767] The user uploads the necessary documents and proceeds with the process.

[1768] Specific operations: Accepts user input and manages document progress.

[1769] Input: Prepared document data

[1770] Output: Application in progress

[1771] Progress notification and follow-up

[1772] Step 20: Communicate and track progress

[1773] The server notifies the appropriate staff of accepted applications and tracks their progress.

[1774] If there is a change in progress, a notification based on the generative AI model and emotion data is sent to the device.

[1775] What it does: Tracks progress and generates notification messages.

[1776] Input: Received application details and progress data

[1777] Output: Progress notification

[1778] Step 21: View and Update Progress

[1779] The device will display progress updates to the user and update them with any notifications.

[1780] What it does: Displays progress data and updates the interface.

[1781] Input: Progress notification

[1782] Output: Latest progress

[1783] Step 22: Follow up

[1784] Users can check in on progress and ask additional questions or follow up as needed.

[1785] Specific operation: Accepts user input and sends it to the server.

[1786] Input: User's follow-up question

[1787] Output: Query data sent to the server

[1788] This process flow allows users to use government services smoothly while receiving emotionally sensitive responses.

[1789] (Application example 2)

[1790] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1791] In the field of government services, there is a demand for systems that allow users to make inquiries or applications 24 hours a day. However, conventional systems do not provide responses that take into account the user's emotional state, and in many cases, they are unable to fully resolve their anxieties or questions. Similar problems exist with security-related inquiries, and in order to improve user satisfaction, it is necessary to optimize responses that take emotions into account.

[1792] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1793] In this invention, the server includes a user authentication means, a means for analyzing the content of the user's consultation using a generative artificial intelligence and generating an appropriate response, and a means for recognizing the user's emotions using an emotion engine and optimizing the response, thereby making it possible to provide an optimal response according to the user's emotional state.

[1794] "User authentication means" refers to a means for verifying the identity of a user when the user accesses the system.

[1795] "Generative AI" is AI that analyzes user input information and generates an appropriate response to it.

[1796] The "administrative service information providing means" is a means for automatically providing information on relevant administrative services in response to a user's question.

[1797] "Online application procedure means" refers to the means by which a user can upload the necessary documents and complete the application procedure online.

[1798] The "progress status notification means" is a means for checking the application contents and notifying the user of the progress status.

[1799] An "emotion engine" is a technology for recognizing a user's emotions and optimizing responses.

[1800] "Speech recognition technology" is a technology that converts a user's voice input into text and analyzes the content.

[1801] The "means for learning past consultation history" is a means for learning the contents of the user's past consultations and optimizing the current response based on the learned contents.

[1802] The "security-related consultation response means" is a means for recognizing emotions and generating an optimal response to security-related inquiries from users.

[1803] This invention is a system that allows users to make inquiries and applications regarding government services and security 24 hours a day. The system includes a user authentication means, a generative artificial intelligence, a government service information providing means, an online application procedure means, a progress notification means, and an emotion engine.

[1804] 1. User authentication method

[1805] The server starts the system, initializes the user database and log database, and loads various settings. The terminal displays the user authentication screen, and the user enters authentication information such as their My Number card or password. The server compares this authentication information with the database, and if authentication is successful, the user session begins.

[1806] 2. Generative Artificial Intelligence

[1807] After authentication, the server uses an AI model to generate a greeting message (e.g., "Hello, what can I help you with?") and sends it to the device. The device displays a chat screen and accepts input from the user via text or voice. The server analyzes the input and generates the optimal response.

[1808] 3. Emotion Engine

[1809] The server analyzes the user's voice and text inputs and uses an emotion engine to recognize the user's emotions. This emotion data is reflected in response generation, providing the optimal response according to the user's emotional state.

[1810] 4. Means of providing information on administrative services

[1811] Depending on the user's inquiry, the server generates relevant administrative service information, including links to related web pages, a list of required documents, and detailed procedures. The device displays the generated information on the chat screen.

[1812] 5. Online application procedures

[1813] When the user checks the information provided and prepares the necessary documents, a digital document upload function is provided. The server receives the uploaded documents, stores them in a database, and automatically checks their contents. If there are any deficiencies, the user is notified and prompted to make corrections.

[1814] 6. Progress Notification Methods

[1815] After the application is accepted, the server tracks the progress and sends notifications of any changes to the device, which displays the latest progress to the user and updates them with any further notifications.

[1816] Specific hardware and software

[1817] The system uses the following hardware and software:

[1818] Server: Hosts the main part of the system and holds the user database, log database, and AI model.

[1819] Device: Provides the user interface and accepts user input. This can be a smartphone, PC, tablet, etc.

[1820] Generative AI model: A machine learning model that analyzes the user's inquiry content and generates the optimal response.

[1821] Emotion engine: A software module for analyzing user emotions and reflecting them in responses.

[1822] Speech recognition technology: Technology for converting a user's voice input into text.

[1823] Examples of specific examples and prompts

[1824] For example, if a user asks, "I've been seeing suspicious cars around my house lately. What should I do?" the emotion engine will recognize the anxiety and provide a reassuring response such as, "It's natural to be worried. We recommend that you report the suspicious vehicle to the nearest police station. You may also want to consider installing surveillance cameras around your home."

[1825] Prompt Sentence Examples

[1826] Understand the user's concerns and generate the best response to alleviate their fears and worries. For example, if the user is reporting seeing a suspicious car, tailor your response using the following criteria:

[1827] 1. If you're feeling anxious, use a reassuring tone.

[1828] 2. Providing specific measures and information.

[1829] You are an AI assistant that understands emotions, so respond appropriately.

[1830] In this way, this system, which combines an emotion engine, enables responses that are sensitive to the user's emotions, improving the user experience.

[1831] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1832] Step 1:

[1833] The server starts the system, initializes the user database and log database, and reads various settings. This generates a user authentication screen and sends it to the terminal. The inputs are the server configuration file and the initial database information, and the output is the user authentication screen. Specific operations include establishing a database connection, reading the configuration file, and executing the screen generation algorithm.

[1834] Step 2:

[1835] The terminal displays a user authentication screen, and the user enters authentication information such as their My Number card or password. This input information is sent to the server. The input is the user's authentication information, and the authentication information is sent to the server as output. Specifically, the system displays a user interface and provides input fields.

[1836] Step 3:

[1837] The server receives authentication information from the user, compares it with the database, and if authentication is successful, starts a user session and loads profile information. The input is the user's authentication information, and the output is the authentication result and user profile information. Specific operations include querying the database, running the authentication algorithm, and generating session information.

[1838] Step 4:

[1839] The server generates a greeting message generated by an AI model and sends it to the device. The input is user profile information, and the output is the greeting message. Specific operations include calling the AI ​​model, running the message generation process, and sending the message to the device.

[1840] Step 5:

[1841] The terminal displays a chat screen and provides a field to accept input from the user. When the user inputs the content of their consultation by text or voice, the voice data is converted into text. The input is the user's consultation content, and the text version of the consultation content is generated as the output. Specific operations include displaying the chat screen and converting the voice data into text using voice recognition technology.

[1842] Step 6:

[1843] The server analyzes the input consultation content and uses a generative AI model to generate optimal questions and hearing items. The input is the text of the consultation content, and the output is the generation of optimal questions and hearing items. Specific operations include analyzing the consultation content, calling the AI ​​model, and the question generation process.

[1844] Step 7:

[1845] The server analyzes the user's voice and text input and recognizes the user's emotions using an emotion engine. This emotion data is reflected in the generation of a response. The input is the user's voice or text data, and the output is emotion data and a response. Specific operations include analyzing the voice and text input, calling the emotion engine, and the response generation process.

[1846] Step 8:

[1847] The device displays the generated questions and responses on the chat screen. At this time, the content and tone of the responses are adjusted according to the user's emotional state. The inputs are emotional data and question and response data, and the adjusted responses are displayed on the chat screen as the output. Specific operations include updating the chat screen and adjusting the responses based on the emotional data.

[1848] Step 9:

[1849] The server generates relevant administrative service information based on the user's consultation content and sends it to the terminal. The queried administrative service information is the input, and the generated information is sent to the terminal as the output. Specific operations include querying the administrative service database, information generation process, and sending the information to the terminal.

[1850] Step 10:

[1851] The device checks the provided information and inputs further questions as necessary. In response, the server generates an optimal response using the generative AI model and emotion engine. The input is additional question information, and the output is the generated response. Specific operations include processing the input of the question, calling the AI ​​model and emotion engine, and generating a response.

[1852] Step 11:

[1853] The server generates detailed information about the application procedure in question based on the user's consultation content and provides appropriate guidance according to the user's emotions. The input is the user's consultation content and emotion data, and the output is detailed information and guidance according to the emotion. Specific operations include analyzing the consultation content, generating procedure information, and generating guidance based on the emotion data.

[1854] Step 12:

[1855] When the server uploads a required document, it automatically completes the required information and adds a digital signature. The input is the document information uploaded by the user, and the output is a document with a digital signature. Specific operations include receiving and saving the document, applying the auto-completion algorithm, and adding a digital signature.

[1856] Step 13:

[1857] The server notifies the employee in charge of the accepted application details and tracks the progress. If there is a change in the progress, a notification based on the generative AI model and emotion data is sent to the terminal. The inputs are the application details and progress data, and notification data is generated as the output. Specific operations include checking the application details, tracking the progress, and generating notification data.

[1858] Step 14:

[1859] The terminal displays the latest progress to the user and updates it when further notifications are received. The input is progress notification data, and the output is the updated progress. Specific operations include updating the progress display, receiving notification data, and displaying it.

[1860] The above is the specific processing flow of this system.

[1861] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1862] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1863] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1864] [Fourth embodiment]

[1865] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1866] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1867] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1868] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1869] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1870] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1871] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1872] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1873] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1874] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1875] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1876] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1877] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1878] The present invention is a system that allows users to consult about or apply for government services 24 hours a day. This system includes a user authentication means, a response generation means using generative artificial intelligence, a means for providing government service information, a means for supporting online application procedures, and a means for notifying users of progress. The program processing of this system is explained below in natural language.

[1879] Initial Authentication and User Authentication

[1880] Program processing:

[1881] Server: When the system starts up, it initializes the user database and log database and loads various settings. When a user accesses the system, it generates a user authentication screen and sends it to the terminal.

[1882] Terminal: Displays the authentication screen and provides a screen where the user can enter information such as their My Number card and password.

[1883] User: Enter the required authentication information on the authentication screen and press the send button.

[1884] Server: Receives authentication information from the user, compares it with the database, and if authentication is successful, starts a user session. At this time, it reads the user's profile information and prepares for the next process.

[1885] Starting a conversation and listening to the details of your consultation

[1886] Program processing:

[1887] Server: After authentication, a greeting message (e.g., "Hello, what can you help us with?") is generated by the generative AI model and sent to the device.

[1888] Terminal: Displays the chat screen and provides a field for receiving input from the user.

[1889] User: Enters the content of the consultation by text or voice. If voice recognition technology is used, the voice data is converted into text.

[1890] Server: Analyzes the input consultation content and generates the next necessary questions and interview items using a generative AI model. Specifically, it automatically generates appropriate questions based on the consultation content and sends them back to the device.

[1891] Automated responses and appropriate information

[1892] Program processing:

[1893] Server: Based on the user's question or inquiry, the generative AI model generates relevant government service information, including links to relevant web pages, lists of required documents, and procedural details.

[1894] Terminal: The generated information is displayed on the chat screen.

[1895] User: Review the information provided and enter any further questions as needed.

[1896] Server: Responds to follow-up questions from the user and references past consultation history and user profile data to generate optimal responses.

[1897] Guidance and assistance with application procedures

[1898] Program processing:

[1899] Server: Based on the user's inquiry, the AI ​​model generates detailed information about the application procedure. It also generates a list of required documents and procedural steps and sends it to the device.

[1900] Terminal: Displays the documents and procedures required for the application process, helping users to easily proceed with the process.

[1901] User: Check the provided procedure information and prepare the necessary documents. Digital document upload function is also provided.

[1902] Server: When uploading required documents, digital signatures and automatic completion of required information are performed.

[1903] Complete and confirm your online application

[1904] Program processing:

[1905] Server: Receives documents uploaded by users, stores them in a database, and automatically checks the contents of the documents. If there are any errors, the server notifies the user and prompts them to make corrections.

[1906] Terminal: Provides an interface for checking the upload screen and created documents.

[1907] User: Scans or photographs the necessary documents, uploads them to the device, and proceeds with the procedure.

[1908] Progress notification and follow-up

[1909] Program processing:

[1910] Server: Notifies the employee of the details of the accepted application and tracks the progress. If there is a change in the progress, a notification is generated by the AI ​​model and sent to the user's device.

[1911] Terminal: Shows progress updates to the user.

[1912] Users: Ask follow-up questions as needed to check progress.

[1913] This system is designed to enable users to use government services effectively, regardless of time or location, by incorporating voice recognition technology and a response optimization function that learns from past consultation history, thereby providing highly convenient government services to a diverse range of users.

[1914] The processing flow will be explained below.

[1915] Step 1:

[1916] The server starts the system, initializes the user database and log database, and reads various settings.

[1917] Step 2:

[1918] The terminal detects the user's access and displays a user authentication screen.

[1919] Step 3:

[1920] The user enters authentication information such as their My Number card and password on the authentication screen and presses the send button.

[1921] Step 4:

[1922] The server receives the entered authentication information, checks it against a database, and if authentication is successful, starts a user session and loads the profile information.

[1923] Step 5:

[1924] After authentication, the server generates a greeting message (e.g., "Hello, how can I help you?") generated by the AI ​​model and sends it to the device.

[1925] Step 6:

[1926] The terminal displays a chat screen and provides fields for accepting input from the user.

[1927] Step 7:

[1928] The user inputs the content of their inquiry into the chat screen either by text or by voice. If the user inputs voice, it is converted into text using voice recognition technology.

[1929] Step 8:

[1930] The server analyzes the input consultation content and uses a generative AI model to generate optimal questions and hearing items.

[1931] Step 9:

[1932] The device displays the generated question on the chat screen.

[1933] Step 10:

[1934] The user enters the details and submits.

[1935] Step 11:

[1936] The server uses a generative AI model to generate appropriate administrative service information (links to related web pages, lists of required documents, procedural details, etc.) based on user input.

[1937] Step 12:

[1938] The terminal displays the generated information on the chat screen.

[1939] Step 13:

[1940] The user reviews the information provided and enters further questions if necessary.

[1941] Step 14:

[1942] To respond to additional questions, the server refers to the generative AI model, past consultation history, and profile data to generate the optimal response.

[1943] Step 15:

[1944] The device displays the additional response on the chat screen.

[1945] Step 16:

[1946] The user checks the application procedure information provided and prepares the necessary documents.

[1947] Step 17:

[1948] The server generates a list of documents and procedures required for the procedure and sends it to the terminal.

[1949] Step 18:

[1950] The device will display detailed information about the application process (document list, instructions, etc.).

[1951] Step 19:

[1952] The user scans or photographs the required documents and uploads them.

[1953] Step 20:

[1954] The server receives the uploaded documents, stores them, automatically checks their contents, and generates notifications if there are any errors.

[1955] Step 21:

[1956] The terminal displays the results of automatic document checks and correction requirements.

[1957] Step 22:

[1958] The user corrects the document as needed and re-uploads it.

[1959] Step 23:

[1960] The server accepts the application and notifies the relevant staff of the progress.

[1961] Step 24:

[1962] The server tracks the progress of the application, and if there are any changes, a generative AI model generates a notification and sends it to the device.

[1963] Step 25:

[1964] The device will display progress updates to the user and update them if further notices arise.

[1965] Step 26:

[1966] Users can check in on progress and ask additional questions or follow up as needed.

[1967] Example 1

[1968] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1969] Today's busy lives demand systems that enable users to access government services quickly and efficiently. However, current systems struggle to consistently and efficiently handle user authentication, analysis of consultation content, generation of appropriate responses, document upload and application completion, and progress notifications. Another challenge is properly converting users' voice input into text and providing appropriate responses based on the consultation content. Furthermore, there is a need to utilize past consultation history to improve the accuracy of responses to users.

[1970] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1971] In this invention, the server includes means for user authentication, means for analyzing the user's consultation content using a generation artificial intelligence and generating an appropriate response, means for automatically providing appropriate administrative information in response to questions from the user, means for the user to upload necessary documents and complete the application procedure online, means for checking the application content and notifying the progress, means for the generation artificial intelligence to generate a greeting message after authentication and send it to the terminal, means for analyzing the received consultation content and automatically generating the next necessary question using the generation artificial intelligence, and means for automatic checking and electronic signature.This enables users to efficiently consult or apply for administrative services 24 hours a day, and realizes the generation of optimal responses using voice input and past consultation history.

[1972] "User authentication" is the process of verifying the identity of a user accessing a system.

[1973] "Generative AI" is an AI technology that analyzes input data and generates appropriate responses.

[1974] "Analysis of consultation content" is a process for processing the consultation content entered by the user and understanding its meaning and requirements.

[1975] "Generating an appropriate response" is a procedure for automatically creating the most appropriate response to the user based on the analyzed consultation content.

[1976] "Administrative information" refers to information about various services and procedures provided by the government and local governments.

[1977] "Document upload" refers to the act of a user submitting the required documents in digital form to the system.

[1978] "Completing an application" is the process by which a user completes a particular administrative procedure by submitting the required documents and providing the required information.

[1979] "Progress notification" means informing the user of the progress of the application procedure.

[1980] The "greeting message" is the first message that the system sends to the user, and usually includes content that asks the user what they want to discuss.

[1981] "Automatic question generation" is the process in which artificial intelligence automatically creates the next necessary question based on the user's consultation content.

[1982] "Automatic check" is a procedure in which the system automatically verifies the contents of submitted documents.

[1983] An "electronic signature" is a digital signature that ensures the authenticity of a document and the identity of its sender.

[1984] The present invention is a system that allows users to consult about or apply for government services 24 hours a day. This system includes a user authentication means, a response generation means using artificial intelligence, a government information provision means, an online application procedure support means, and a progress notification means. Specific embodiments of this system are described below.

[1985] User authentication methods

[1986] First, when a user accesses the system, the server generates a user authentication screen and sends it to the terminal. The terminal displays the authentication screen and provides an interface for the user to enter their My Number card and password. When the user enters and submits their authentication information, the server receives it and compares it with the user database. If authentication is successful, the server starts a user session and loads their profile information.

[1987] Response generation method using generative artificial intelligence

[1988] Once authentication is complete, the server uses generative AI (e.g., ChatGPT) to generate a greeting message and send it to the device. For example, it generates a message like, "Hello, what would you like to discuss?" The device displays this message on the chat screen and provides a field for the user to enter the content of their consultation. Once the user enters the content of their consultation, the server receives it, analyzes it using a generative AI model, and automatically generates the next necessary question.

[1989] Administrative information provision means

[1990] The server generates relevant administrative information based on the user's question or inquiry using a generative AI model (e.g., BERT). This information includes links to related web pages, a list of required documents, and details of procedures. The generated information is sent to the device, which then displays it on the chat screen.

[1991] Online application procedure support

[1992] A particularly important process occurs when a user uploads the required documents. The device provides a digital document upload function and sends the documents prepared by the user to the server. The server receives the uploaded documents, applies the necessary digital signatures, and automatically checks the contents of the documents. If any required information is missing or incomplete, the server sends a notification to the user prompting them to make corrections.

[1993] Progress notification method

[1994] The server notifies the employee of the accepted application and tracks its progress. If there are any changes in the progress, the server generates the content using a generative AI model and notifies the user. The terminal displays the latest progress to the user. The user can ask additional questions as needed to check the progress.

[1995] Hardware and software used

[1996] The hardware includes high-performance server computers and dedicated database servers, while the software includes generative AI models (e.g., ChatGPT, BERT, etc.), speech recognition technology, natural language processing engines, and digital signature technology.

[1997] Examples and prompts

[1998] For example, if the device displays "Hello, what would you like to discuss?", the user can enter "Please tell me about the procedures for childcare support." The server analyzes this input, generates the next question, "Please tell me the ages of your children," and sends it back to the device. The server then displays the generated detailed procedure information and a list of required documents on the device, helping the user to easily complete the procedures.

[1999] As described above, the present invention is designed to enable users to efficiently use government services without being restricted by time or location, allowing users to quickly and accurately complete government procedures online.

[2000] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2001] Step 1:

[2002] The server generates a user authentication screen and sends it to the terminal.

[2003] Input: System startup and user access

[2004] Output: Authentication screen

[2005] Specific operation: The server initializes the user database and log database, reads the settings, then generates a user authentication screen and sends it to the terminal.

[2006] Step 2:

[2007] The terminal displays a user authentication screen and provides an interface for the user to enter their My Number card and password.

[2008] Input: Authentication screen from the server

[2009] Output: Authentication entry screen shown to the user

[2010] What happens: The device renders "login.html" and displays it to the user, providing fields where the user can enter their authentication information.

[2011] Step 3:

[2012] The user enters their My Number card information and password and presses the send button.

[2013] Input: Information to be entered on the authentication screen

[2014] Output: Authentication information sent to the server

[2015] Specific operations: The user holds their My Number card over the reader, enters the PIN code, and presses the send button.

[2016] Step 4:

[2017] The server checks the received authentication information against a user database, and if authentication is successful, starts a user session.

[2018] Input: Credentials from the user

[2019] Output: Authentication result and session start

[2020] Specific behavior: The server checks the authentication information against "users_db" and, if successful, generates a session ID and loads the profile information.

[2021] Step 5:

[2022] The server uses artificial intelligence to generate a greeting message and sends it to the terminal.

[2023] Input: Session information after authentication is complete

[2024] Output: Greeting message

[2025] Specific behavior: Use a generative AI model (e.g., ChatGPT) to generate a message saying "Hello, how can I help you?" and send it to the device.

[2026] Step 6:

[2027] The terminal displays a chat screen and provides a field where the user can enter the content of the consultation.

[2028] Input: Greeting message from the server

[2029] Output: The chat screen that the user sees

[2030] Specific behavior: The device displays "chat.html" containing a greeting message and an input field.

[2031] Step 7:

[2032] The user inputs the consultation content by text or voice and presses the send button.

[2033] Input: Enter the consultation details

[2034] Output: Consultation content sent to the server

[2035] Specific operation: The user enters the content of the consultation into the text field and presses the send button, or they can input it by voice. In the case of voice, it is converted into text using voice recognition technology.

[2036] Step 8:

[2037] The server analyzes the consultation content received and uses artificial intelligence to generate the next necessary questions and hearing items.

[2038] Input: User's inquiry

[2039] Output: Next question or hearing item

[2040] Specific operation: The server analyzes the consultation content received using a natural language processing engine and generates the next question using a generative AI model (e.g., ChatGPT).

[2041] Step 9:

[2042] The server uses a generative AI model to generate relevant administrative information based on the user's questions or inquiries, and sends it to the terminal.

[2043] Input: Questions and inquiries from users

[2044] Output:Administrative information

[2045] Specific operation: The server uses a generative AI model (e.g., BERT) to generate relevant web page links, a list of required documents, procedural details, etc., and sends them to the terminal.

[2046] Step 10:

[2047] The terminal displays the generated information on the chat screen.

[2048] Input: Administrative information from the server

[2049] Output: Administrative information displayed to the user

[2050] Specific operation: The device renders "chat.html" containing administrative information and displays it on the chat screen.

[2051] Step 11:

[2052] The user prepares the necessary documents and uploads them via the terminal.

[2053] Input: Required documents

[2054] Output: Digital document sent to the server

[2055] Specific operation: The user scans a document and presses the send button using the device's upload function.

[2056] Step 12:

[2057] The server stores the received documents and performs digital signatures and automatic checks.

[2058] Input: Uploaded digital document

[2059] Output: Confirmation message or correction request notification

[2060] Specific operation: The server saves the document in a database, automatically checks its contents, and if there are any errors, sends a notification to the user to correct them.

[2061] Step 13:

[2062] The server notifies the appropriate staff of accepted applications and tracks their progress.

[2063] Input: Application details

[2064] Output: Progress

[2065] Specific operation: The server notifies the application details to the progress management system, tracks the progress, and notifies the relevant staff of the necessary information.

[2066] Step 14:

[2067] If the server detects any changes in the progress, it generates a notification for the user using the AI ​​model and sends it to the device.

[2068] Input: Progress Change

[2069] Output: Progress notification

[2070] Specific operation: Using a generative AI model (e.g., ChatGPT), a message notifying of progress changes (e.g., "Your application has been accepted. The current progress is ____") is generated and sent to the device.

[2071] Step 15:

[2072] The device displays progress updates to the user.

[2073] Input: Progress notification from the server

[2074] Output: Progress displayed to the user

[2075] Specific behavior: The device renders "progress.html" containing the progress and displays it to the user.

[2076] (Application example 1)

[2077] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2078] Conventional government services have faced challenges, such as users being restricted by time and location, making it difficult to provide 24-hour service. Waiting times at the counter are also common, necessitating greater efficiency. Furthermore, there are limited ways for users to accurately obtain the information they need. Meanwhile, there are also issues with elderly people and those unfamiliar with technology, such as difficulty completing electronic application procedures.

[2079] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2080] In this invention, the server includes a user authentication means, a means for analyzing the content of the user's consultation using artificial intelligence and generating an appropriate response, and a means for automatically providing appropriate administrative service information in response to a question from the user, thereby enabling users to efficiently obtain the information and procedures they need 24 hours a day.

[2081] "User authentication means" refers to a means for identifying and authenticating a user, and examples include facial recognition technology and My Number card reading functions.

[2082] "Generative AI" refers to AI that uses a generative AI model to generate appropriate responses based on user input.

[2083] The "response generation means" is a system component that analyzes the content of the user's consultation and generates an appropriate response based on that analysis.

[2084] The "administrative service information providing means" is a system function that automatically provides information on related administrative services in response to a user's question.

[2085] The "means for completing the application procedure online" is a system function that allows users to upload the necessary documents and complete the application procedure online.

[2086] The "progress status notification means" is a system function for checking the application content and notifying the user of the progress status.

[2087] "Facial recognition technology" is a technology that uses a camera to recognize a user's face and authenticate the user based on this.

[2088] "Real-time response generation means" is a system function that uses a generative AI model to generate a response based on user input in real time.

[2089] A "robot display" is a display device mounted on a robot that visually provides information to the user.

[2090] "Speech recognition technology" is a technology that converts a user's voice into text and analyzes it.

[2091] "Means for learning past consultation history" is a system function that accumulates past consultation details and user interactions and optimizes future responses based on that information.

[2092] This invention is a system that allows users to consult about or apply for government services 24 hours a day. This system includes a user authentication means, a response generation means using generative artificial intelligence, a government service information provision means, an online application procedure support means, and a progress notification means.

[2093] Initial Authentication and User Authentication

[2094] Program processing:

[2095] When the system starts up, the server initializes the user database and log database and loads various settings. When a user accesses the system, it generates a user authentication screen and sends it to the terminal. The terminal displays the authentication screen and provides a screen where the user can enter information such as facial recognition technology and My Number card information. The user enters the necessary authentication information on the authentication screen and presses the send button. The server receives the authentication information from the user, compares it with the database, and if authentication is successful, starts the user session. At this time, it loads the user's profile information and prepares for the next process.

[2096] Starting a conversation and listening to the details of your consultation

[2097] Program processing:

[2098] After authentication, the server generates a greeting message (e.g., "Hello, what would you like to discuss?") using the generative AI model and sends it to the device. The device displays a chat screen and provides a field to receive input from the user. The user inputs the content of the consultation using text or voice. If voice recognition technology is used, the voice data is converted into text. The server analyzes the input consultation content and then generates the necessary questions and hearing items using the generative AI model. Specifically, it automatically generates appropriate questions based on the consultation content and sends them back to the device.

[2099] Automated responses and appropriate information

[2100] Program processing:

[2101] The server uses a generative AI model to generate relevant government service information based on the user's questions and inquiries. This information includes links to relevant web pages, lists of required documents, and detailed procedures. The device displays the generated information on the chat screen. The user can review the information provided and enter further questions as needed. The server responds to the user's additional questions and references past consultation history and user profile data to generate the most appropriate response.

[2102] Guidance and assistance with application procedures

[2103] Program processing:

[2104] Based on the user's inquiry, the server uses a generative AI model to generate detailed information about the applicable application procedure. A list of the required documents and procedural steps is generated and sent to the device. The device displays the documents and procedures required for the application procedure, helping the user to easily proceed with the procedure. The user checks the provided procedural information and prepares the necessary documents. At this time, a function to upload digital documents is also provided. When uploading the required documents, the server automatically completes the required information and digital signatures.

[2105] Complete and confirm your online application

[2106] Program processing:

[2107] The server receives documents uploaded by users, stores them in a database, and automatically checks the contents of the documents. If there are any errors, it notifies the user and prompts them to make corrections. The terminal provides an interface for checking the upload screen and completed documents. The user scans or photographs the necessary documents, uploads them to the terminal, and proceeds with the procedure.

[2108] Progress notification and follow-up

[2109] Program processing:

[2110] The server notifies the responsible employee of the accepted application and tracks its progress. If there is a change in the progress, a notification is generated by the AI ​​model and sent to the user's device. The device displays the latest progress to the user. The user can ask additional questions as needed to check the progress.

[2111] As a concrete example, this system is used in robots installed in brick-and-mortar stores such as city halls. When citizens visit the office, they are authenticated using facial recognition technology, and a generative AI model is used to accept and respond to inquiries in real time. For example, if a user types in "Can you tell me about renewing my passport?", the system generates a response such as "Here is the necessary procedural information. Please see the link:..."

[2112] Example prompt sentence:

[2113] User: What about renewing my passport?

[2114] System: Please refer to this link for passport renewal: [LINK]

[2115] In order to specifically implement the invention, it is necessary to build a system in which various hardware and software work together. The main hardware used includes a robot with a camera, a My Number card reader, a scanner, etc., and the software used includes a generative AI model (e.g., GPT-2), voice recognition technology, and face recognition technology (e.g., the face_recognition library).

[2116] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2117] Step 1:

[2118] When the system starts up, the server initializes the user database and log database and loads various settings. When a terminal accesses the server, the server generates a user authentication screen and sends it to the terminal. The user database stores pre-registered user information, and the log database records past access history and operation logs. This puts the system into a ready state.

[2119] Step 2:

[2120] The device displays the user authentication screen sent from the server. The user is instructed to stand in front of the facial recognition camera, and the system performs facial recognition. A My Number card reader may be used to enter the required authentication information. The input information (face image and My Number card data) is sent to the server.

[2121] Step 3:

[2122] The server receives the authentication information sent from the device and checks it against a user database. It uses facial recognition technology to compare the user's facial image with those in the database. At the same time, it checks the data on the My Number card. If authentication is successful, the server starts a user session and loads the user's profile information. It then sends an authentication success message to the device.

[2123] Step 4:

[2124] After successful authentication, the server uses a generative AI model to generate a greeting message (e.g., "Hello, how can I help you?") and sends it to the device. The greeting message is an important first step in an automated response.

[2125] Step 5:

[2126] The device displays the greeting message sent from the server on the chat screen. The user inputs the content of the consultation by text or voice. In the case of voice input, the device uses voice recognition technology to convert the voice data into text and send it to the server.

[2127] Step 6:

[2128] The server receives the text of the consultation sent by the user and analyzes the content using a generative AI model. Specifically, the generative AI model analyzes the input text and automatically generates the next necessary questions and hearing items. The generated questions and hearing items are then sent back to the device.

[2129] Step 7:

[2130] The terminal displays the questions and hearing items sent from the server on the chat screen and waits for further input from the user. The user inputs ...

Claims

1. User authentication means; A means for analyzing the content of a user's consultation using a generative artificial intelligence and generating an appropriate response; A means for automatically providing appropriate administrative service information in response to a user's question; A means for users to upload required documents and complete the application process online; A means to review your application and keep you informed of its progress; A system including:

2. 10. The system of claim 1, further comprising means for converting and analyzing a user's voice input into text using speech recognition technology.

3. 2. The system according to claim 1, further comprising means for learning past consultation history and optimizing responses to users.

Images