system

Abstract

We provide the system. [Solution] A means of providing a virtual window projected onto a display device in the home using virtual reality or augmented reality technology, A means of using a predictive model that identifies the administrative service selected by the user and predicts the necessary information or materials, A means of presenting the aforementioned predicted information and materials to the user and receiving information provided by the user, A means of verifying the provided information in light of laws and regulations and determining whether it meets the necessary conditions for the business, If the above conditions are met, means for transmitting to the institutional system to complete processing, A means of presenting and verifying business documents via a virtual counter through a display device worn by the user, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of the chatbot's character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In conventional administrative procedures, users have to go directly to the local government window to conduct procedures, which is inconvenient and time-consuming. This problem is particularly serious for the elderly who have difficulty moving physically and for users whose local government window is far away. Furthermore, because the documents and information required for administrative procedures are complex, many users have difficulty with the procedures. The purpose of this invention is to solve these problems and enable users to conduct administrative procedures more simply and quickly.

Means for Solving the Problems

[0005] This invention provides a system that enables users to perform administrative procedures from home by offering a virtual service window within the home using virtual reality or augmented reality technology. Based on the procedure selected by the user, this system uses an automated generation model to predict and present the necessary documents and information. Furthermore, a legal compliance agent verifies the information entered by the user and determines whether it complies with the relevant laws and regulations of the local government, thereby ensuring the accuracy of the procedure. As a result, users can complete procedures without leaving their homes.

[0006] "Virtual reality or augmented reality technology" is a technology that uses computer-generated images and sounds to overlay a virtual space onto the real world.

[0007] A "virtual service counter" is a user interface that uses computer technology to mimic a physical government office counter, providing a means for users to complete administrative procedures from the comfort of their homes.

[0008] An "automatic generation model" is an algorithm or program that automatically generates and provides necessary documents and information based on historical data and existing information.

[0009] A "legal and regulatory compliance agent" is a system or program that verifies and determines whether the entered information complies with relevant laws and regulations.

[0010] A "local government system" is a computer system operated by local governments such as cities, towns, and villages, which manages various types of data related to residents and processes administrative services. [Brief explanation of the drawing]

[0011] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3]This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14] This is a sequence diagram showing the processing flow of the data processing system in Application Example 2, which combines an emotion engine. [Modes for carrying out the invention]

[0012] Hereinafter, an example of an embodiment of the system relating to the technology of this disclosure will be described with reference to the attached drawings.

[0013] First, let's explain the terminology used in the following explanation.

[0014] In the following embodiments, the labeled processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0015] In the following embodiments, the labeled RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0016] In the following embodiments, the labeled storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.

[0017] In the following embodiments, the labeled communication I / F (Interface) is an interface including a communication processor and an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark), and the like.

[0018] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0019] [First Embodiment]

[0020] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0021] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0022] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0023] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0024] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0025] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0026] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0027] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0028] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0029] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0030] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0031] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0032] This invention provides a system that allows users to perform administrative procedures directly from their homes by offering a virtual service counter using virtual reality or augmented reality technology. This system consists of three elements: a server, a terminal, and a user, each of which functions as follows.

[0033] The server's functions include receiving requests from users and automatically generating necessary documents and information using a generation AI model. It references past application data and the user's personal information to predict and send data to the terminal. In addition, the entered information is verified by a legal compliance agent, and the suitability of the processing is determined based on the local government's regulations.

[0034] The terminal's function is to project a virtual window into the user's home using virtual reality or augmented reality technology. The terminal displays information sent from the server, allowing the user to easily input and modify that information. Furthermore, it displays a completion notification to the user when processing is complete.

[0035] The user's operation begins by launching the terminal and displaying the virtual service window. The user selects the required administrative service from the displayed options and reviews and enters the provided documents and information. For example, if the user selects the "change of address" procedure, they enter the new address information and wait for confirmation from the server as needed. Finally, they confirm the completion of the procedure on the virtual service window and finish the process.

[0036] As a concrete example, consider the case where a user requests a copy of their resident registration certificate. When the user opens a virtual portal on their terminal and selects "Request a copy of resident registration certificate," the server generates the necessary information and sends it to the terminal. The user enters the address to which the resident registration certificate should be sent, and once all the information is confirmed, the server completes the procedure and sends a completion notification. In this way, the present invention provides an environment in which users can easily perform administrative procedures at home without having to go to a government office.

[0037] The following describes the processing flow.

[0038] Step 1:

[0039] The user operates a device to activate a virtual interface, which then projects a virtual reality or augmented reality interface onto the wall of their home.

[0040] Step 2:

[0041] The user selects the necessary procedure from the administrative service options provided at the virtual counter. For example, they might choose "Change of Address."

[0042] Step 3:

[0043] The device detects the user's selection and sends that information to the server as a request.

[0044] Step 4:

[0045] The server activates a generation AI model based on the received request, analyzing past application data and user-related information to predict the necessary documents and information.

[0046] Step 5:

[0047] The server automatically generates predicted documents and information, and sends the generated data to the terminal.

[0048] Step 6:

[0049] The terminal displays documents and information received from the server on a virtual screen, presenting them in a user-friendly format.

[0050] Step 7:

[0051] The user reviews the application documents displayed in the virtual window and enters or corrects the necessary information.

[0052] Step 8:

[0053] The terminal sends the information entered by the user to the server.

[0054] Step 9:

[0055] The server uses a legal compliance agent to verify the entered information and check that everything complies with laws and regulations.

[0056] Step 10:

[0057] The server sends the verified information to the local government's system to complete the procedure.

[0058] Step 11:

[0059] The server sends a notification to the terminal indicating that the procedure is complete.

[0060] Step 12:

[0061] The terminal displays a completion notification on the virtual portal, allowing the user to confirm that the procedure has been completed.

[0062] (Example 1)

[0063] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0064] The current situation, where users must spend time visiting public institutions for administrative procedures, is inefficient and burdensome for many people. Furthermore, the effort and confusion involved in obtaining and filling out the necessary documents are also problematic. In particular, since it is difficult for users to guarantee the accuracy of documents based on legal regulations, there is a need for a system that supports efficient and accurate administrative procedures.

[0065] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0066] In this invention, the server includes means for providing a virtual portal using virtual reality or augmented reality technology, means for automatically generating necessary documents using a generative AI model, and means for verifying the accuracy of information based on laws and regulations. This makes it possible for users to easily complete administrative procedures from home.

[0067] "Virtual reality technology" is a technology that allows users to experience a computer-generated three-dimensional virtual environment as if it were reality.

[0068] Augmented reality technology is a technology that overlays digital information onto the real environment, providing a new visual experience by merging the real and digital worlds.

[0069] A "generative AI model" is a type of artificial intelligence that learns from large amounts of data and automatically generates various kinds of data and information, and is used in fields such as natural language processing and image generation.

[0070] A "virtual service window" is an electronic service window interface that is projected onto any location, such as within the home, using virtual reality or augmented reality technology.

[0071] The "legal regulation compliance coefficient" is a coefficient or function used to implement rules based on legal regulations and to verify and determine whether the input information conforms to those regulations.

[0072] A "user" is an individual or organization that carries out administrative procedures through this system and inputs and transmits information using an operating terminal.

[0073] This invention is a system that enables users to perform administrative procedures from within their homes using virtual reality or augmented reality technology. The system consists of three elements: a server, a terminal, and a user, each of which functions as follows:

[0074] server

[0075] When the server receives a request from the user's terminal, it uses a generative AI model to automatically generate the necessary documents and information. It performs highly accurate data processing while referencing past application history and the user's personal information. The generated information is then checked for compliance with regulations using a legal compliance coefficient. This ensures that the documents and guidelines the user needs are provided accurately and efficiently. For example, the AI ​​model can utilize a general-purpose natural language processing engine. A possible prompt might be, "Generate the documents required for a specific administrative procedure."

[0076] terminal

[0077] The terminal projects a virtual counter using virtual reality or augmented reality technology into the home, providing a user interface. It displays information sent from the server and provides an environment that is easy for the user to operate. When the user performs a procedure, the terminal accepts information input and corrections and notifies the user when the process is completed. The terminal can use general VR / AR devices. Through the terminal's operating interface, the user can proceed with administrative procedures without stress.

[0078] User

[0079] Users activate their device at home and select the necessary service through a virtual portal. For example, they can initiate a procedure such as "issuance of a copy of their resident registration certificate." After confirming the displayed information and entering the required details, the user waits for the server to complete the process and then checks for a completion notification. This series of operations reduces the burden on the user and allows them to complete the procedure quickly and accurately.

[0080] This system allows users to easily complete administrative procedures from the comfort of their homes, significantly reducing the need to visit public institutions.

[0081] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0082] Step 1:

[0083] The user activates the device and displays a virtual portal. A list of available administrative services is displayed on the screen. The user selects the desired procedure from these options. The user's selection is the only input. Based on the selection, the device sends a request to the server. Specifically, the user taps an icon on the screen, such as "Change Address."

[0084] Step 2:

[0085] The server receives a request from the terminal. The input is the procedure information selected by the user. Using a generative AI model, it automatically generates the necessary documents and information. In this process, the server retrieves past application history and personal information from the database, processes and calculates the data, and outputs precise prediction results. Specifically, the server calls the AI ​​model and provides the prompt message "Please generate the documents required for address change" as input.

[0086] Step 3:

[0087] The server verifies the generated information using a legal compliance coefficient. The input is the document output by the generation AI model. It checks whether it complies with legal regulations and, if so, returns the information to the terminal. Specifically, the server uses a rule-based engine to evaluate whether the items in the document match the regulations.

[0088] Step 4:

[0089] The terminal receives information sent from the server and displays it to the user. The input is generated information from the server. The user reviews the information and makes additional inputs as needed. For example, this might involve making corrections such as entering a new address. Specifically, the user types the new address into the input field on the screen.

[0090] Step 5:

[0091] The terminal resends the information entered by the user to the server. This input is new information from the user. The server performs a final check and then completes the process. Specifically, when the "Send" button is pressed, the terminal bundles the data into packets and sends them to the server.

[0092] Step 6:

[0093] The server confirms that the procedure is complete and notifies the user of the result. The output is a notification message confirming the completion of the procedure. Specifically, the server records the completion status in the database and sends a notification to the terminal.

[0094] This series of steps allows users to complete administrative procedures safely from the comfort of their homes, saving them time and effort.

[0095] (Application Example 1)

[0096] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0097] In modern urban life, residents are required to receive administrative services quickly and efficiently. However, traditional administrative procedures require residents to visit government offices in person, which is time-consuming and laborious. Furthermore, the time required to verify necessary documents and information is burdensome for users. In particular, when residents apply for building permits or ask tax-related questions, a large amount of documentation and procedures are required, causing delays. Therefore, the purpose of this invention is to solve these problems and improve the living environment.

[0098] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0099] In this invention, the server includes means for providing a virtual window projected onto a display device in the home using virtual reality or augmented reality technology; means for using a predictive model that identifies the administrative service selected by the user and predicts the necessary information or materials; and means for presenting and confirming service materials via the virtual window through a display device worn by the user. This enables the user to receive administrative services quickly and efficiently from home.

[0100] "Virtual reality" is a technology that uses computer technology to create a virtual environment different from reality and allows users to experience it.

[0101] Augmented reality is a technology that overlays digital information onto the real world, allowing users to experience both reality and the virtual world simultaneously.

[0102] A "display device" is a device used to provide information to a user visually, and includes screens and monitors.

[0103] A "virtual service window" is an interface that uses virtual reality or augmented reality to provide users with access to administrative services.

[0104] "Administrative services" refer to various procedures that local governments and government agencies perform for residents, including, for example, building permit applications and tax-related processing.

[0105] A "predictive model" refers to an algorithm that uses machine learning and artificial intelligence technologies to predict future events and necessary information.

[0106] "Wearable display devices" refer to visual devices worn by users, including smart glasses and head-mounted displays.

[0107] "Business documents" refer to various documents and information required when carrying out administrative procedures.

[0108] The system for realizing this invention mainly consists of three components: a server, a terminal, and a user.

[0109] When the server receives a request from a user terminal, it uses a generative AI model to predict and create the necessary information and materials. This includes a process in which the predictive model utilizes historical data and the user's personal information to automatically generate specific and relevant materials. The server also uses a regulatory compliance agent to automatically verify whether the information provided by the user complies with current laws and regulations. After this verification is complete, the server sends the content that meets the requirements to the institutional system, completing the task.

[0110] The terminal uses virtual reality or augmented reality technology to project a virtual service counter into the user's home through a wearable display device. This allows users to access the virtual counter directly from home, select the necessary administrative services, and proceed with the procedures. The terminal also displays information transmitted from the server, providing an interface that allows users to easily provide and confirm information.

[0111] The user first starts up their terminal and launches a virtual portal, then selects the desired administrative service from the displayed options. For example, if they want to apply for a building permit, they can check the necessary documents and information related to the building generated on the server and enter new information as needed. This makes it possible to complete procedures that previously took a long time much faster.

[0112] As a concrete example, consider a case where a user wants to build a new house. When the user selects "Building Permit Application" in the virtual portal, the server generates and presents the necessary documents. The user reviews these documents and enters the appropriate information. The server verifies the legal compliance of this information and can notify the user that the permit process is complete.

[0113] An example of a prompt to input into the generating AI model is, "Based on the user's past building permit history, please generate the necessary documents for a new permit."

[0114] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0115] Step 1:

[0116] The user activates the terminal and displays a virtual service counter. Using virtual reality or augmented reality technology, the counter is projected onto a display device in the user's home. The user enters a command to activate the terminal as input, and the virtual service counter is visualized as output. During this process, the terminal prepares the user interface and presents the user with a list of selectable administrative services.

[0117] Step 2:

[0118] The user selects a specific administrative service from a list displayed in a virtual window. The input here is the user's selection of the service. The output is a signal requesting the necessary information and materials corresponding to the selected service. The terminal sends this signal to the server.

[0119] Step 3:

[0120] The server receives requests from terminals and uses a generative AI model to predict and create necessary information and materials. The input consists of the selected type of task and related user history data. The server performs data calculations based on this information to generate the necessary materials and information. The generated materials are then sent to the terminal as output.

[0121] Step 4:

[0122] The terminal receives and displays information sent from the server, providing it to the user. The input consists of informational data from the server. The terminal interprets this data and outputs it to a display device to provide the user with visual information. The user reviews the information as needed and prepares to provide further input.

[0123] Step 5:

[0124] The user enters the necessary information into the terminal, and this information is sent to the server. The input consists of new information entered by the user into the terminal. The terminal sends this information to the server, which then prepares to process it.

[0125] Step 6:

[0126] The server uses a regulatory compliance agent to verify information sent by the user and determines whether it meets the requirements for the business. The input is user data. The server checks this data with the regulatory agent and determines compliance. The output is the compliance determination result.

[0127] Step 7:

[0128] If the conditions are met, the server sends the information to the institutional system and completes the process. The input is user information for which legal compliance verification has been completed. The output is a processing completion notification generated in the institutional system and returned to the terminal. The user is notified that the process is complete, and the procedure ends.

[0129] This series of processes will allow users to quickly complete administrative procedures from the comfort of their homes.

[0130] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0131] This invention provides a virtual service window using virtual reality or augmented reality technology, and is a system that improves user convenience and satisfaction by combining an emotion engine when users perform administrative procedures from home. The system consists of three main elements: a server, a terminal, and a user, each of which functions as follows.

[0132] As a server function, the server receives requests from users and automatically generates necessary documents and information through a generative AI model. Based on the user's emotional state provided by the emotion engine, the server adjusts the information and interface it provides. For example, if a user indicates anxiety, the server will take action such as adding more detailed explanations.

[0133] The device's function is to project a virtual window onto a wall in the user's home using virtual reality or augmented reality technology. The device receives data from a server and displays it clearly to the user. It also analyzes the user's voice tone and facial expressions using an emotion engine and transmits this information to the server in real time. The device adjusts to display feedback appropriate to the user's emotions.

[0134] The user's operation begins with launching the terminal and displaying a virtual service window. The user then selects an administrative service, reviews the displayed information, and enters the necessary details. The emotion engine analyzes the user's voice and facial expressions, and the server uses this information to adjust how it provides information. For example, if a user is going through the "passport renewal" procedure and expresses anxiety about something they don't understand, the system will quickly provide detailed explanations and support.

[0135] This function allows the present invention to reduce the burden of administrative procedures on users and improve the quality of services.

[0136] The following describes the processing flow.

[0137] Step 1:

[0138] The user operates a device to activate a virtual interface, which then projects a virtual reality or augmented reality interface onto a wall in the home.

[0139] Step 2:

[0140] The user selects the necessary procedure from the administrative service options provided at the virtual counter. For example, they might choose "Change of Address."

[0141] Step 3:

[0142] The device detects the user's selection and sends that information to the server as a request.

[0143] Step 4:

[0144] The server activates a generation AI model based on the received request, analyzing past application data and user information to predict and generate the necessary documents.

[0145] Step 5:

[0146] The server sends the generated document to the terminal and simultaneously prepares to start the emotion engine to receive the user's emotion recognition results.

[0147] Step 6:

[0148] The terminal displays documents received from the server in a virtual window. During this process, an emotion engine analyzes the user's voice tone and facial expressions in real time.

[0149] Step 7:

[0150] The user reviews the information displayed in the virtual window and enters or corrects any necessary information. If the user's emotions indicate anxiety or confusion, the emotion engine sends that information to the server.

[0151] Step 8:

[0152] Based on the results from the emotion engine, the server adjusts the tone and content of the information provided and adds more detailed support.

[0153] Step 9:

[0154] The terminal receives updated information from the server and presents it to the user in an easy-to-understand format.

[0155] Step 10:

[0156] Once the user has reviewed all the information and completed the input, the terminal will send the final application data to the server.

[0157] Step 11:

[0158] The server verifies the entered information using a legal compliance agent and, if necessary, transmits it to the local government system to complete the procedure.

[0159] Step 12:

[0160] The server sends a notification to the terminal indicating that the procedure is complete.

[0161] Step 13:

[0162] The terminal displays a completion notification on the virtual portal, allowing the user to confirm that the procedure has been successfully completed.

[0163] (Example 2)

[0164] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0165] Modern administrative procedures often require users to perform them in person at a service counter, with limited options for remote participation from home. This results in time-consuming and laborious processes for users, and can cause anxiety and confusion if the procedures are unclear. Furthermore, traditional systems often fail to provide information that takes into account the user's emotional state, leading to a decline in the quality of the user experience.

[0166] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0167] In this invention, the server includes means for providing a virtual window displayed on a vertical surface within the home using virtual reality or augmented reality technology, means for generating information necessary for administrative procedures selected by the user using a generative AI model, and means for analyzing the user's emotional state using an emotion analysis engine and dynamically adjusting the presentation of information. This enables users to perform administrative procedures quickly and securely from home, reducing the psychological burden involved.

[0168] "Virtual reality technology" is a technology that uses computer technology to create a virtual environment that does not exist in reality, allowing users to experience things within that environment.

[0169] Augmented reality technology is a technique that overlays virtual information onto real-world images, providing users with additional information in real time.

[0170] A "virtual service counter" is an interface created on a screen using virtual reality or augmented reality technology, and functions as a platform for conducting administrative procedures remotely.

[0171] A "generative AI model" is a program that uses artificial intelligence to automatically generate the information and documents necessary for a specific procedure.

[0172] An "emotion analysis engine" is a technology that analyzes the user's voice and facial expressions to understand their emotional state and adjusts the information presented based on the results.

[0173] "Administrative body systems" refer to information processing systems used by public institutions that perform the necessary processing to complete administrative procedures.

[0174] This invention is a system that provides a virtual service counter using virtual reality or augmented reality technology in a home environment, enabling users to smoothly carry out administrative procedures from their homes.

[0175] The server is remotely located and includes a computer system for running generative AI models. Specifically, it uses Python and TENSORFLOW® to build artificial intelligence models that automatically generate document templates in response to user requests. This generative AI model generates the necessary documents when the user selects a procedure. An example of a prompt message is, "Please generate the documents required for passport renewal."

[0176] The terminal is a device installed in the user's home and has a display function that uses virtual reality technology. Specifically, it projects a virtual screen onto a wall in the home using a dedicated headset or projector. The terminal visually presents information obtained from the server and generated documents to the user. In addition, it uses a built-in camera and microphone to analyze the user's voice and facial expressions with an emotion analysis engine and sends this data to the server to understand the user's emotional state. Based on this analysis result, the server easily adjusts the information display.

[0177] Users can operate a virtual service counter via their terminal and select the administrative services they need. For example, if a user selects "passport renewal," the necessary information will be displayed, and they can proceed with the procedure effectively and with peace of mind by entering the required information. This entire process contributes to reducing the burden of procedures by providing information tailored to the user's emotions.

[0178] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0179] Step 1:

[0180] The user activates the device and displays the virtual service window interface on the wall inside their home. This visually presents the options for administrative services. When the user selects the "passport renewal" procedure, that information is sent to the server via the device.

[0181] Step 2:

[0182] The server analyzes the request received from the user and provides the appropriate prompt message as input to the generating AI model. Using the prompt "Generate the documents required for passport renewal," the AI ​​model automatically generates the necessary document templates. The output of this process is document data as templates.

[0183] Step 3:

[0184] The server sends the generated document template to the terminal. The terminal receives this template data and presents it visually in an easy-to-understand format for the user. Specifically, it provides an interface through which the user can confirm and input the necessary information.

[0185] Step 4:

[0186] The device uses its built-in camera and microphone to capture the user's facial expressions and voice. This data is sent to an emotion analysis engine to analyze the user's emotional state. Voice and facial expression data are used as input, and the emotional state analysis results are generated as output.

[0187] Step 5:

[0188] The server receives the sentiment analysis results sent from the terminal and adjusts the format and content of the information presentation. For example, it generates an additional message to reassure the user and sends it back to the terminal. This adjustment improves the quality of the user experience.

[0189] Step 6:

[0190] The user reviews the presented documents and information and completes the required input. After input is complete, the terminal sends all information to the server to arrange for final approval and processing. The server sends the information to the administrative body's system for final processing of the procedure.

[0191] (Application Example 2)

[0192] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0193] In recent years, efforts have been made to enable administrative procedures to be conducted online, but these systems fail to address the emotional states and individual needs of users. As a result, users may experience anxiety and confusion, which hinders the smooth progress of procedures and detracts from the overall user experience. Furthermore, existing systems lack the personalization of face-to-face support, and are limited to providing users with uniform responses.

[0194] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0195] In this invention, the server includes means for analyzing the user's emotional state using an emotion engine and providing more appropriate feedback based on that state, means for adjusting the information and interface provided according to the emotional state, and means for predicting necessary documents or information using an automated generation algorithm. This enables the provision of personalized feedback and information according to the user's emotional state, and is expected to improve usability and satisfaction.

[0196] "Virtual reality" is a technology that uses computer technology to create an artificial environment that can be experienced like the real world, allowing users to interact and move around within that environment.

[0197] Augmented reality is a technology that overlays digital information onto real-world information, providing users with additional information related to their actual environment.

[0198] A "virtual counter" is a system that replicates actual counter services in a virtual environment, allowing users to perform administrative procedures and other tasks from their homes.

[0199] An "emotion engine" is software that analyzes the user's emotional state from their voice and facial expressions, and uses the results to adjust the system's response.

[0200] An "automatic generation algorithm" refers to a set of calculation procedures used to automatically create necessary documents and data from input information, enabling efficient data processing.

[0201] "Laws and regulations" refer to rules or laws enacted by public institutions, which are norms that must be observed in order to maintain social order.

[0202] A "local government system" is an information system used by local governments to manage and operate administrative procedures and citizen services.

[0203] This system consists of three main elements: a server, a terminal, and a user. The server receives requests from users and automatically generates the necessary documents and information using a generative AI model. The user's emotional state is analyzed by an emotion engine, and based on this, the server adjusts the information provided and the interface, and generates feedback that is appropriate to the user's emotions.

[0204] The terminal has the ability to project a virtual service counter into the home space using virtual reality or augmented reality technology. This allows users to complete administrative procedures from home. The terminal receives data from the server and displays it in an easy-to-understand manner for the user. During this process, the terminal analyzes the user's voice and facial expressions using an emotion engine and transmits this information to the server in real time.

[0205] The user first activates the terminal and displays a virtual service window. Next, the user selects the required administrative service, confirms the displayed information, and then enters the necessary details. For example, when performing a "passport renewal" procedure, if the user expresses anxiety about entering the information, the system can quickly provide more detailed explanations, thereby increasing the user's sense of security.

[0206] This feature reduces the burden of administrative procedures for users and improves the quality of service. The generating AI model generates prompt messages to present users with the most relevant information. An example of a specific prompt message would be, "We will begin the passport renewal process. What are your concerns? We will explain the necessary documents and the procedure in detail." This prompt is used to provide information tailored to the user's situation.

[0207] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0208] Step 1:

[0209] The server receives requests from users. The input request data identifies the administrative procedure selected by the user and includes information instructing the necessary processing. This data is then analyzed, and the server requests the generation of the necessary documents and information.

[0210] Step 2:

[0211] The server automatically generates necessary documents and information using a generative AI model. The input is data related to a specific procedure received from the user. Based on this data, the model combines appropriate components to generate the required documents. The output is the generated documents and information.

[0212] Step 3:

[0213] The device projects a virtual window into the home space using virtual reality or augmented reality technology. Input is data transmitted from a server, which the device then displays for the user to visually confirm. Output is the user's interaction with the visualized information.

[0214] Step 4:

[0215] The user selects an administrative service via the terminal, reviews the displayed information, and enters the required details. This entered data, which includes information necessary for the procedure to proceed, is sent to the server.

[0216] Step 5:

[0217] The server uses an emotion engine to analyze the user's voice and facial expressions to identify their emotional state. The input is real-time emotion data obtained from atmosphere analysis sensors, etc. Based on this, the server provides appropriate feedback and returns emotionally adjusted information to the user as output.

[0218] Step 6:

[0219] Based on the emotional state identified by the emotion engine, the server generates and presents prompts to the user. The input in this step consists of the user's emotional state data and details about the procedure. As a result, the user receives appropriate guidance tailored to the situation.

[0220] Step 7:

[0221] Once the above series of processes are successfully completed, the server sends the necessary data to the local government system and completes the process. For the procedural information treated as input, the output is provided as formal procedural data to the local government system, and a notification of completion of the procedure is returned to the user.

[0222] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0223] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0224] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0225] [Second Embodiment]

[0226] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0227] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0228] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0229] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0230] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0231] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0232] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0233] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0234] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0235] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0236] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0237] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0238] This invention provides a system that allows users to perform administrative procedures directly from their homes by offering a virtual service counter using virtual reality or augmented reality technology. This system consists of three elements: a server, a terminal, and a user, each of which functions as follows.

[0239] The server's functions include receiving requests from users and automatically generating necessary documents and information using a generation AI model. It references past application data and the user's personal information to predict and send data to the terminal. In addition, the entered information is verified by a legal compliance agent, and the suitability of the processing is determined based on the local government's regulations.

[0240] The terminal's function is to project a virtual window into the user's home using virtual reality or augmented reality technology. The terminal displays information sent from the server, allowing the user to easily input and modify that information. Furthermore, it displays a completion notification to the user when processing is complete.

[0241] The user's operation begins by launching the terminal and displaying the virtual service window. The user selects the required administrative service from the displayed options and reviews and enters the provided documents and information. For example, if the user selects the "change of address" procedure, they enter the new address information and wait for confirmation from the server as needed. Finally, they confirm the completion of the procedure on the virtual service window and finish the process.

[0242] As a concrete example, consider the case where a user requests a copy of their resident registration certificate. When the user opens a virtual portal on their terminal and selects "Request a copy of resident registration certificate," the server generates the necessary information and sends it to the terminal. The user enters the address to which the resident registration certificate should be sent, and once all the information is confirmed, the server completes the procedure and sends a completion notification. In this way, the present invention provides an environment in which users can easily perform administrative procedures at home without having to go to a government office.

[0243] The following describes the processing flow.

[0244] Step 1:

[0245] The user operates a device to activate a virtual interface, which then projects a virtual reality or augmented reality interface onto the wall of their home.

[0246] Step 2:

[0247] The user selects the necessary procedure from the administrative service options provided at the virtual counter. For example, they might choose "Change of Address."

[0248] Step 3:

[0249] The device detects the user's selection and sends that information to the server as a request.

[0250] Step 4:

[0251] The server activates a generation AI model based on the received request, analyzing past application data and user-related information to predict the necessary documents and information.

[0252] Step 5:

[0253] The server automatically generates predicted documents and information, and sends the generated data to the terminal.

[0254] Step 6:

[0255] The terminal displays documents and information received from the server on a virtual screen, presenting them in a user-friendly format.

[0256] Step 7:

[0257] The user reviews the application documents displayed in the virtual window and enters or corrects the necessary information.

[0258] Step 8:

[0259] The terminal sends the information entered by the user to the server.

[0260] Step 9:

[0261] The server uses a legal compliance agent to verify the entered information and check that everything complies with laws and regulations.

[0262] Step 10:

[0263] The server sends the verified information to the local government's system to complete the procedure.

[0264] Step 11:

[0265] The server sends a notification to the terminal indicating that the procedure is complete.

[0266] Step 12:

[0267] The terminal displays a completion notification on the virtual portal, allowing the user to confirm that the procedure has been completed.

[0268] (Example 1)

[0269] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0270] The current situation, where users must spend time visiting public institutions for administrative procedures, is inefficient and burdensome for many people. Furthermore, the effort and confusion involved in obtaining and filling out the necessary documents are also problematic. In particular, since it is difficult for users to guarantee the accuracy of documents based on legal regulations, there is a need for a system that supports efficient and accurate administrative procedures.

[0271] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0272] In this invention, the server includes means for providing a virtual portal using virtual reality or augmented reality technology, means for automatically generating necessary documents using a generative AI model, and means for verifying the accuracy of information based on laws and regulations. This makes it possible for users to easily complete administrative procedures from home.

[0273] "Virtual reality technology" is a technology that allows users to experience a computer-generated three-dimensional virtual environment as if it were reality.

[0274] Augmented reality technology is a technology that overlays digital information onto the real environment, providing a new visual experience by merging the real and digital worlds.

[0275] A "generative AI model" is a type of artificial intelligence that learns from large amounts of data and automatically generates various kinds of data and information, and is used in fields such as natural language processing and image generation.

[0276] A "virtual service window" is an electronic service window interface that is projected onto any location, such as within the home, using virtual reality or augmented reality technology.

[0277] The "legal regulation compliance coefficient" is a coefficient or function used to implement rules based on legal regulations and to verify and determine whether the input information conforms to those regulations.

[0278] A "user" is an individual or organization that carries out administrative procedures through this system and inputs and transmits information using an operating terminal.

[0279] This invention is a system that enables users to perform administrative procedures from within their homes using virtual reality or augmented reality technology. The system consists of three elements: a server, a terminal, and a user, each of which functions as follows:

[0280] server

[0281] When the server receives a request from the user's terminal, it uses a generative AI model to automatically generate the necessary documents and information. It performs highly accurate data processing while referencing past application history and the user's personal information. The generated information is then checked for compliance with regulations using a legal compliance coefficient. This ensures that the documents and guidelines the user needs are provided accurately and efficiently. For example, the AI ​​model can utilize a general-purpose natural language processing engine. A possible prompt might be, "Generate the documents required for a specific administrative procedure."

[0282] terminal

[0283] The terminal projects a virtual window using virtual reality or augmented reality technology within the home to provide a user interface. It displays the information sent from the server and provides an environment where users can easily perform operations. When the user conducts a procedure, the terminal accepts the input and modification of information and notifies the user of the completed process. General VR / AR devices can be used for the terminal. Through the operation interface of the terminal, the user can proceed with administrative procedures without stress.

[0284] User

[0285] The user starts the terminal at home and selects the required service through the virtual window. For example, procedures such as "Issuance of a copy of the household register" can be initiated. The user checks the displayed information, enters the necessary items, waits for the server to complete the process, and checks the completion notice. Such a series of operations reduces the burden on the user and enables the procedure to be completed quickly and accurately.

[0286] With this system, the user can easily complete administrative procedures within the home, significantly reducing the need to visit public institutions.

[0287] The flow of the specific process in Example 1 will be described using FIG. 11.

[0288] Step 1:

[0289] The user starts the terminal to display the virtual window. Options for available administrative services are displayed on the screen. The user selects the desired procedure from among them. The input is the user's selection. Based on the selection, the terminal sends a request to the server. As a specific operation, the user taps an icon such as "Address change" on the screen.

[0290] Step 2:

[0291] The server receives a request from the terminal. The input is the procedure information selected by the user. Using a generative AI model, it automatically generates the necessary documents and information. In this process, the server retrieves past application history and personal information from the database, processes and calculates the data, and outputs precise prediction results. Specifically, the server calls the AI ​​model and provides the prompt message "Please generate the documents required for address change" as input.

[0292] Step 3:

[0293] The server verifies the generated information using a legal compliance coefficient. The input is the document output by the generation AI model. It checks whether it complies with legal regulations and, if so, returns the information to the terminal. Specifically, the server uses a rule-based engine to evaluate whether the items in the document match the regulations.

[0294] Step 4:

[0295] The terminal receives information sent from the server and displays it to the user. The input is generated information from the server. The user reviews the information and makes additional inputs as needed. For example, this might involve making corrections such as entering a new address. Specifically, the user types the new address into the input field on the screen.

[0296] Step 5:

[0297] The terminal resends the information entered by the user to the server. This input is new information from the user. The server performs a final check and then completes the process. Specifically, when the "Send" button is pressed, the terminal bundles the data into packets and sends them to the server.

[0298] Step 6:

[0299] The server confirms that the procedure is complete and notifies the user of the result. The output is a notification message confirming the completion of the procedure. Specifically, the server records the completion status in the database and sends a notification to the terminal.

[0300] This series of steps allows users to complete administrative procedures safely from the comfort of their homes, saving them time and effort.

[0301] (Application Example 1)

[0302] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0303] In modern urban life, residents are required to receive administrative services quickly and efficiently. However, traditional administrative procedures require residents to visit government offices in person, which is time-consuming and laborious. Furthermore, the time required to verify necessary documents and information is burdensome for users. In particular, when residents apply for building permits or ask tax-related questions, a large amount of documentation and procedures are required, causing delays. Therefore, the purpose of this invention is to solve these problems and improve the living environment.

[0304] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0305] In this invention, the server includes means for providing a virtual window projected onto a display device in the home using virtual reality or augmented reality technology; means for using a predictive model that identifies the administrative service selected by the user and predicts the necessary information or materials; and means for presenting and confirming service materials via the virtual window through a display device worn by the user. This enables the user to receive administrative services quickly and efficiently from home.

[0306] "Virtual reality" is a technology that uses computer technology to generate a virtual environment different from reality and allows users to experience it.

[0307] "Augmented reality" is a technology that overlays digital information on the real environment for display, enabling users to experience both the real and virtual worlds simultaneously.

[0308] A "display device" is a device for visually providing information to users, including screens and monitors.

[0309] A "virtual window" is an interface for receiving administrative services provided to users using virtual reality or augmented reality.

[0310] "Administrative operations" refer to various procedures carried out by local governments and government agencies for residents, including, for example, building permit applications and tax-related processes.

[0311] A "prediction model" refers to an algorithm for predicting future events and necessary information using machine learning and artificial intelligence technologies.

[0312] A "wearable display device" is a visual device in a form that users can wear, including smart glasses and head-mounted displays.

[0313] "Business documents" refer to various documents and information required when conducting administrative procedures.

[0314] The system for realizing this invention mainly consists of three components: a server, a terminal, and a user.

[0315] When the server receives a request from a user terminal, it uses a generative AI model to predict and create the necessary information and materials. This includes a process in which the predictive model utilizes historical data and the user's personal information to automatically generate specific and relevant materials. The server also uses a regulatory compliance agent to automatically verify whether the information provided by the user complies with current laws and regulations. After this verification is complete, the server sends the content that meets the requirements to the institutional system, completing the task.

[0316] The terminal uses virtual reality or augmented reality technology to project a virtual service counter into the user's home through a wearable display device. This allows users to access the virtual counter directly from home, select the necessary administrative services, and proceed with the procedures. The terminal also displays information transmitted from the server, providing an interface that allows users to easily provide and confirm information.

[0317] The user first starts up their terminal and launches a virtual portal, then selects the desired administrative service from the displayed options. For example, if they want to apply for a building permit, they can check the necessary documents and information related to the building generated on the server and enter new information as needed. This makes it possible to complete procedures that previously took a long time much faster.

[0318] As a concrete example, consider a case where a user wants to build a new house. When the user selects "Building Permit Application" in the virtual portal, the server generates and presents the necessary documents. The user reviews these documents and enters the appropriate information. The server verifies the legal compliance of this information and can notify the user that the permit process is complete.

[0319] An example of a prompt to input into the generating AI model is, "Based on the user's past building permit history, please generate the necessary documents for a new permit."

[0320] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0321] Step 1:

[0322] The user activates the terminal and displays a virtual service counter. Using virtual reality or augmented reality technology, the counter is projected onto a display device in the user's home. The user enters a command to activate the terminal as input, and the virtual service counter is visualized as output. During this process, the terminal prepares the user interface and presents the user with a list of selectable administrative services.

[0323] Step 2:

[0324] The user selects a specific administrative service from a list displayed in a virtual window. The input here is the user's selection of the service. The output is a signal requesting the necessary information and materials corresponding to the selected service. The terminal sends this signal to the server.

[0325] Step 3:

[0326] The server receives requests from terminals and uses a generative AI model to predict and create necessary information and materials. The input consists of the selected type of task and related user history data. The server performs data calculations based on this information to generate the necessary materials and information. The generated materials are then sent to the terminal as output.

[0327] Step 4:

[0328] The terminal receives and displays information sent from the server, providing it to the user. The input consists of informational data from the server. The terminal interprets this data and outputs it to a display device to provide the user with visual information. The user reviews the information as needed and prepares to provide further input.

[0329] Step 5:

[0330] The user enters the necessary information into the terminal, and this information is sent to the server. The input consists of new information entered by the user into the terminal. The terminal sends this information to the server, which then prepares to process it.

[0331] Step 6:

[0332] The server uses a regulatory compliance agent to verify information sent by the user and determines whether it meets the requirements for the business. The input is user data. The server checks this data with the regulatory agent and determines compliance. The output is the compliance determination result.

[0333] Step 7:

[0334] If the conditions are met, the server sends the information to the institutional system and completes the process. The input is user information for which legal compliance verification has been completed. The output is a processing completion notification generated in the institutional system and returned to the terminal. The user is notified that the process is complete, and the procedure ends.

[0335] This series of processes will allow users to quickly complete administrative procedures from the comfort of their homes.

[0336] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0337] This invention provides a virtual service window using virtual reality or augmented reality technology, and is a system that improves user convenience and satisfaction by combining an emotion engine when users perform administrative procedures from home. The system consists of three main elements: a server, a terminal, and a user, each of which functions as follows.

[0338] As a server function, the server receives requests from users and automatically generates necessary documents and information through a generative AI model. Based on the user's emotional state provided by the emotion engine, the server adjusts the information and interface it provides. For example, if a user indicates anxiety, the server will take action such as adding more detailed explanations.

[0339] The device's function is to project a virtual window onto a wall in the user's home using virtual reality or augmented reality technology. The device receives data from a server and displays it clearly to the user. It also analyzes the user's voice tone and facial expressions using an emotion engine and transmits this information to the server in real time. The device adjusts to display feedback appropriate to the user's emotions.

[0340] The user's operation begins with launching the terminal and displaying a virtual service window. The user then selects an administrative service, reviews the displayed information, and enters the necessary details. The emotion engine analyzes the user's voice and facial expressions, and the server uses this information to adjust how it provides information. For example, if a user is going through the "passport renewal" procedure and expresses anxiety about something they don't understand, the system will quickly provide detailed explanations and support.

[0341] This function allows the present invention to reduce the burden of administrative procedures on users and improve the quality of services.

[0342] The following describes the processing flow.

[0343] Step 1:

[0344] The user operates a device to activate a virtual interface, which then projects a virtual reality or augmented reality interface onto a wall in the home.

[0345] Step 2:

[0346] The user selects the necessary procedure from the administrative service options provided at the virtual counter. For example, they might choose "Change of Address."

[0347] Step 3:

[0348] The device detects the user's selection and sends that information to the server as a request.

[0349] Step 4:

[0350] The server activates a generation AI model based on the received request, analyzing past application data and user information to predict and generate the necessary documents.

[0351] Step 5:

[0352] The server sends the generated document to the terminal and simultaneously prepares to start the emotion engine to receive the user's emotion recognition results.

[0353] Step 6:

[0354] The terminal displays documents received from the server in a virtual window. During this process, an emotion engine analyzes the user's voice tone and facial expressions in real time.

[0355] Step 7:

[0356] The user reviews the information displayed in the virtual window and enters or corrects any necessary information. If the user's emotions indicate anxiety or confusion, the emotion engine sends that information to the server.

[0357] Step 8:

[0358] Based on the results from the emotion engine, the server adjusts the tone and content of the information provided and adds more detailed support.

[0359] Step 9:

[0360] The terminal receives updated information from the server and presents it to the user in an easy-to-understand format.

[0361] Step 10:

[0362] Once the user has reviewed all the information and completed the input, the terminal will send the final application data to the server.

[0363] Step 11:

[0364] The server verifies the entered information using a legal compliance agent and, if necessary, transmits it to the local government system to complete the procedure.

[0365] Step 12:

[0366] The server sends a notification to the terminal indicating that the procedure is complete.

[0367] Step 13:

[0368] The terminal displays a completion notification on the virtual portal, allowing the user to confirm that the procedure has been successfully completed.

[0369] (Example 2)

[0370] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0371] Modern administrative procedures often require users to perform them in person at a service counter, with limited options for remote participation from home. This results in time-consuming and laborious processes for users, and can cause anxiety and confusion if the procedures are unclear. Furthermore, traditional systems often fail to provide information that takes into account the user's emotional state, leading to a decline in the quality of the user experience.

[0372] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0373] In this invention, the server includes means for providing a virtual window displayed on a vertical surface within the home using virtual reality or augmented reality technology, means for generating information necessary for administrative procedures selected by the user using a generative AI model, and means for analyzing the user's emotional state using an emotion analysis engine and dynamically adjusting the presentation of information. This enables users to perform administrative procedures quickly and securely from home, reducing the psychological burden involved.

[0374] "Virtual reality technology" is a technology that uses computer technology to create a virtual environment that does not exist in reality, allowing users to experience things within that environment.

[0375] Augmented reality technology is a technique that overlays virtual information onto real-world images, providing users with additional information in real time.

[0376] A "virtual service counter" is an interface created on a screen using virtual reality or augmented reality technology, and functions as a platform for conducting administrative procedures remotely.

[0377] A "generative AI model" is a program that uses artificial intelligence to automatically generate the information and documents necessary for a specific procedure.

[0378] An "emotion analysis engine" is a technology that analyzes the user's voice and facial expressions to understand their emotional state and adjusts the information presented based on the results.

[0379] "Administrative body systems" refer to information processing systems used by public institutions that perform the necessary processing to complete administrative procedures.

[0380] This invention is a system that provides a virtual service counter using virtual reality or augmented reality technology in a home environment, enabling users to smoothly carry out administrative procedures from their homes.

[0381] The server is remotely located and includes a computer system for running generative AI models. Specifically, it uses Python and TensorFlow to build artificial intelligence models that automatically generate document templates in response to user requests. This generative AI model generates the necessary documents when the user selects a procedure. An example of a prompt message is, "Please generate the documents required for passport renewal."

[0382] The terminal is a device installed in the user's home and has a display function that uses virtual reality technology. Specifically, it projects a virtual screen onto a wall in the home using a dedicated headset or projector. The terminal visually presents information obtained from the server and generated documents to the user. In addition, it uses a built-in camera and microphone to analyze the user's voice and facial expressions with an emotion analysis engine and sends this data to the server to understand the user's emotional state. Based on this analysis result, the server easily adjusts the information display.

[0383] Users can operate a virtual service counter via their terminal and select the administrative services they need. For example, if a user selects "passport renewal," the necessary information will be displayed, and they can proceed with the procedure effectively and with peace of mind by entering the required information. This entire process contributes to reducing the burden of procedures by providing information tailored to the user's emotions.

[0384] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0385] Step 1:

[0386] The user activates the device and displays the virtual service window interface on the wall inside their home. This visually presents the options for administrative services. When the user selects the "passport renewal" procedure, that information is sent to the server via the device.

[0387] Step 2:

[0388] The server analyzes the request received from the user and provides the appropriate prompt message as input to the generating AI model. Using the prompt "Generate the documents required for passport renewal," the AI ​​model automatically generates the necessary document templates. The output of this process is document data as templates.

[0389] Step 3:

[0390] The server sends the generated document template to the terminal. The terminal receives this template data and presents it visually in an easy-to-understand format for the user. Specifically, it provides an interface through which the user can confirm and input the necessary information.

[0391] Step 4:

[0392] The device uses its built-in camera and microphone to capture the user's facial expressions and voice. This data is sent to an emotion analysis engine to analyze the user's emotional state. Voice and facial expression data are used as input, and the emotional state analysis results are generated as output.

[0393] Step 5:

[0394] The server receives the sentiment analysis results sent from the terminal and adjusts the format and content of the information presentation. For example, it generates an additional message to reassure the user and sends it back to the terminal. This adjustment improves the quality of the user experience.

[0395] Step 6:

[0396] The user reviews the presented documents and information and completes the required input. After input is complete, the terminal sends all information to the server to arrange for final approval and processing. The server sends the information to the administrative body's system for final processing of the procedure.

[0397] (Application Example 2)

[0398] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0399] In recent years, efforts have been made to enable administrative procedures to be conducted online, but these systems fail to address the emotional states and individual needs of users. As a result, users may experience anxiety and confusion, which hinders the smooth progress of procedures and detracts from the overall user experience. Furthermore, existing systems lack the personalization of face-to-face support, and are limited to providing users with uniform responses.

[0400] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0401] In this invention, the server includes means for analyzing the user's emotional state using an emotion engine and providing more appropriate feedback based on that state, means for adjusting the information and interface provided according to the emotional state, and means for predicting necessary documents or information using an automated generation algorithm. This enables the provision of personalized feedback and information according to the user's emotional state, and is expected to improve usability and satisfaction.

[0402] "Virtual reality" is a technology that uses computer technology to create an artificial environment that can be experienced like the real world, allowing users to interact and move around within that environment.

[0403] Augmented reality is a technology that overlays digital information onto real-world information, providing users with additional information related to their actual environment.

[0404] A "virtual counter" is a system that replicates actual counter services in a virtual environment, allowing users to perform administrative procedures and other tasks from their homes.

[0405] An "emotion engine" is software that analyzes the user's emotional state from their voice and facial expressions, and uses the results to adjust the system's response.

[0406] An "automatic generation algorithm" refers to a set of calculation procedures used to automatically create necessary documents and data from input information, enabling efficient data processing.

[0407] "Laws and regulations" refer to rules or laws enacted by public institutions, which are norms that must be observed in order to maintain social order.

[0408] A "local government system" is an information system used by local governments to manage and operate administrative procedures and citizen services.

[0409] This system consists of three main elements: a server, a terminal, and a user. The server receives requests from users and automatically generates the necessary documents and information using a generative AI model. The user's emotional state is analyzed by an emotion engine, and based on this, the server adjusts the information provided and the interface, and generates feedback that is appropriate to the user's emotions.

[0410] The terminal has the ability to project a virtual service counter into the home space using virtual reality or augmented reality technology. This allows users to complete administrative procedures from home. The terminal receives data from the server and displays it in an easy-to-understand manner for the user. During this process, the terminal analyzes the user's voice and facial expressions using an emotion engine and transmits this information to the server in real time.

[0411] The user first activates the terminal and displays a virtual service window. Next, the user selects the required administrative service, confirms the displayed information, and then enters the necessary details. For example, when performing a "passport renewal" procedure, if the user expresses anxiety about entering the information, the system can quickly provide more detailed explanations, thereby increasing the user's sense of security.

[0412] This feature reduces the burden of administrative procedures for users and improves the quality of service. The generating AI model generates prompt messages to present users with the most relevant information. An example of a specific prompt message would be, "We will begin the passport renewal process. What are your concerns? We will explain the necessary documents and the procedure in detail." This prompt is used to provide information tailored to the user's situation.

[0413] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0414] Step 1:

[0415] The server receives requests from users. The input request data identifies the administrative procedure selected by the user and includes information instructing the necessary processing. This data is then analyzed, and the server requests the generation of the necessary documents and information.

[0416] Step 2:

[0417] The server automatically generates necessary documents and information using a generative AI model. The input is data related to a specific procedure received from the user. Based on this data, the model combines appropriate components to generate the required documents. The output is the generated documents and information.

[0418] Step 3:

[0419] The device projects a virtual window into the home space using virtual reality or augmented reality technology. Input is data transmitted from a server, which the device then displays for the user to visually confirm. Output is the user's interaction with the visualized information.

[0420] Step 4:

[0421] The user selects an administrative service via the terminal, reviews the displayed information, and enters the required details. This entered data, which includes information necessary for the procedure to proceed, is sent to the server.

[0422] Step 5:

[0423] The server uses an emotion engine to analyze the user's voice and facial expressions to identify their emotional state. The input is real-time emotion data obtained from atmosphere analysis sensors, etc. Based on this, the server provides appropriate feedback and returns emotionally adjusted information to the user as output.

[0424] Step 6:

[0425] Based on the emotional state identified by the emotion engine, the server generates and presents prompts to the user. The input in this step consists of the user's emotional state data and details about the procedure. As a result, the user receives appropriate guidance tailored to the situation.

[0426] Step 7:

[0427] Once the above series of processes are successfully completed, the server sends the necessary data to the local government system and completes the process. For the procedural information treated as input, the output is provided as formal procedural data to the local government system, and a notification of completion of the procedure is returned to the user.

[0428] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0429] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0430] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0431] [Third Embodiment]

[0432] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0433] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0434] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0435] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0436] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0437] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0438] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0439] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0440] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0441] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0442] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0443] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0444] This invention provides a system that allows users to perform administrative procedures directly from their homes by offering a virtual service counter using virtual reality or augmented reality technology. This system consists of three elements: a server, a terminal, and a user, each of which functions as follows.

[0445] The server's functions include receiving requests from users and automatically generating necessary documents and information using a generation AI model. It references past application data and the user's personal information to predict and send data to the terminal. In addition, the entered information is verified by a legal compliance agent, and the suitability of the processing is determined based on the local government's regulations.

[0446] The terminal's function is to project a virtual window into the user's home using virtual reality or augmented reality technology. The terminal displays information sent from the server, allowing the user to easily input and modify that information. Furthermore, it displays a completion notification to the user when processing is complete.

[0447] The user's operation begins by launching the terminal and displaying the virtual service window. The user selects the required administrative service from the displayed options and reviews and enters the provided documents and information. For example, if the user selects the "change of address" procedure, they enter the new address information and wait for confirmation from the server as needed. Finally, they confirm the completion of the procedure on the virtual service window and finish the process.

[0448] As a concrete example, consider the case where a user requests a copy of their resident registration certificate. When the user opens a virtual portal on their terminal and selects "Request a copy of resident registration certificate," the server generates the necessary information and sends it to the terminal. The user enters the address to which the resident registration certificate should be sent, and once all the information is confirmed, the server completes the procedure and sends a completion notification. In this way, the present invention provides an environment in which users can easily perform administrative procedures at home without having to go to a government office.

[0449] The following describes the processing flow.

[0450] Step 1:

[0451] The user operates a device to activate a virtual interface, which then projects a virtual reality or augmented reality interface onto the wall of their home.

[0452] Step 2:

[0453] The user selects the necessary procedure from the administrative service options provided at the virtual counter. For example, they might choose "Change of Address."

[0454] Step 3:

[0455] The device detects the user's selection and sends that information to the server as a request.

[0456] Step 4:

[0457] The server activates a generation AI model based on the received request, analyzing past application data and user-related information to predict the necessary documents and information.

[0458] Step 5:

[0459] The server automatically generates predicted documents and information, and sends the generated data to the terminal.

[0460] Step 6:

[0461] The terminal displays documents and information received from the server on a virtual screen, presenting them in a user-friendly format.

[0462] Step 7:

[0463] The user reviews the application documents displayed in the virtual window and enters or corrects the necessary information.

[0464] Step 8:

[0465] The terminal sends the information entered by the user to the server.

[0466] Step 9:

[0467] The server uses a legal compliance agent to verify the entered information and check that everything complies with laws and regulations.

[0468] Step 10:

[0469] The server sends the verified information to the local government's system to complete the procedure.

[0470] Step 11:

[0471] The server sends a notification to the terminal indicating that the procedure is complete.

[0472] Step 12:

[0473] The terminal displays a completion notification on the virtual portal, allowing the user to confirm that the procedure has been completed.

[0474] (Example 1)

[0475] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0476] The current situation, where users must spend time visiting public institutions for administrative procedures, is inefficient and burdensome for many people. Furthermore, the effort and confusion involved in obtaining and filling out the necessary documents are also problematic. In particular, since it is difficult for users to guarantee the accuracy of documents based on legal regulations, there is a need for a system that supports efficient and accurate administrative procedures.

[0477] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0478] In this invention, the server includes means for providing a virtual portal using virtual reality or augmented reality technology, means for automatically generating necessary documents using a generative AI model, and means for verifying the accuracy of information based on laws and regulations. This makes it possible for users to easily complete administrative procedures from home.

[0479] "Virtual reality technology" is a technology that allows users to experience a computer-generated three-dimensional virtual environment as if it were reality.

[0480] Augmented reality technology is a technology that overlays digital information onto the real environment, providing a new visual experience by merging the real and digital worlds.

[0481] A "generative AI model" is a type of artificial intelligence that learns from large amounts of data and automatically generates various kinds of data and information, and is used in fields such as natural language processing and image generation.

[0482] A "virtual service window" is an electronic service window interface that is projected onto any location, such as within the home, using virtual reality or augmented reality technology.

[0483] The "legal regulation compliance coefficient" is a coefficient or function used to implement rules based on legal regulations and to verify and determine whether the input information conforms to those regulations.

[0484] A "user" is an individual or organization that carries out administrative procedures through this system and inputs and transmits information using an operating terminal.

[0485] This invention is a system that enables users to perform administrative procedures from within their homes using virtual reality or augmented reality technology. The system consists of three elements: a server, a terminal, and a user, each of which functions as follows:

[0486] server

[0487] When the server receives a request from the user's terminal, it uses a generative AI model to automatically generate the necessary documents and information. It performs highly accurate data processing while referencing past application history and the user's personal information. The generated information is then checked for compliance with regulations using a legal compliance coefficient. This ensures that the documents and guidelines the user needs are provided accurately and efficiently. For example, the AI ​​model can utilize a general-purpose natural language processing engine. A possible prompt might be, "Generate the documents required for a specific administrative procedure."

[0488] terminal

[0489] The terminal projects a virtual counter using virtual reality or augmented reality technology into the home, providing a user interface. It displays information sent from the server and provides an environment that is easy for the user to operate. When the user performs a procedure, the terminal accepts information input and corrections and notifies the user when the process is completed. The terminal can use general VR / AR devices. Through the terminal's operating interface, the user can proceed with administrative procedures without stress.

[0490] User

[0491] Users activate their device at home and select the necessary service through a virtual portal. For example, they can initiate a procedure such as "issuance of a copy of their resident registration certificate." After confirming the displayed information and entering the required details, the user waits for the server to complete the process and then checks for a completion notification. This series of operations reduces the burden on the user and allows them to complete the procedure quickly and accurately.

[0492] This system allows users to easily complete administrative procedures from the comfort of their homes, significantly reducing the need to visit public institutions.

[0493] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0494] Step 1:

[0495] The user activates the device and displays a virtual portal. A list of available administrative services is displayed on the screen. The user selects the desired procedure from these options. The user's selection is the only input. Based on the selection, the device sends a request to the server. Specifically, the user taps an icon on the screen, such as "Change Address."

[0496] Step 2:

[0497] The server receives a request from the terminal. The input is the procedure information selected by the user. Using a generative AI model, it automatically generates the necessary documents and information. In this process, the server retrieves past application history and personal information from the database, processes and calculates the data, and outputs precise prediction results. Specifically, the server calls the AI ​​model and provides the prompt message "Please generate the documents required for address change" as input.

[0498] Step 3:

[0499] The server verifies the generated information using a legal compliance coefficient. The input is the document output by the generation AI model. It checks whether it complies with legal regulations and, if so, returns the information to the terminal. Specifically, the server uses a rule-based engine to evaluate whether the items in the document match the regulations.

[0500] Step 4:

[0501] The terminal receives information sent from the server and displays it to the user. The input is generated information from the server. The user reviews the information and makes additional inputs as needed. For example, this might involve making corrections such as entering a new address. Specifically, the user types the new address into the input field on the screen.

[0502] Step 5:

[0503] The terminal resends the information entered by the user to the server. This input is new information from the user. The server performs a final check and then completes the process. Specifically, when the "Send" button is pressed, the terminal bundles the data into packets and sends them to the server.

[0504] Step 6:

[0505] The server confirms that the procedure is complete and notifies the user of the result. The output is a notification message confirming the completion of the procedure. Specifically, the server records the completion status in the database and sends a notification to the terminal.

[0506] This series of steps allows users to complete administrative procedures safely from the comfort of their homes, saving them time and effort.

[0507] (Application Example 1)

[0508] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0509] In modern urban life, residents are required to receive administrative services quickly and efficiently. However, traditional administrative procedures require residents to visit government offices in person, which is time-consuming and laborious. Furthermore, the time required to verify necessary documents and information is burdensome for users. In particular, when residents apply for building permits or ask tax-related questions, a large amount of documentation and procedures are required, causing delays. Therefore, the purpose of this invention is to solve these problems and improve the living environment.

[0510] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0511] In this invention, the server includes means for providing a virtual window projected onto a display device in the home using virtual reality or augmented reality technology; means for using a predictive model that identifies the administrative service selected by the user and predicts the necessary information or materials; and means for presenting and confirming service materials via the virtual window through a display device worn by the user. This enables the user to receive administrative services quickly and efficiently from home.

[0512] "Virtual reality" is a technology that uses computer technology to create a virtual environment different from reality and allows users to experience it.

[0513] Augmented reality is a technology that overlays digital information onto the real world, allowing users to experience both reality and the virtual world simultaneously.

[0514] A "display device" is a device used to provide information to a user visually, and includes screens and monitors.

[0515] A "virtual service window" is an interface that uses virtual reality or augmented reality to provide users with access to administrative services.

[0516] "Administrative services" refer to various procedures that local governments and government agencies perform for residents, including, for example, building permit applications and tax-related processing.

[0517] A "predictive model" refers to an algorithm that uses machine learning and artificial intelligence technologies to predict future events and necessary information.

[0518] "Wearable display devices" refer to visual devices worn by users, including smart glasses and head-mounted displays.

[0519] "Business documents" refer to various documents and information required when carrying out administrative procedures.

[0520] The system for realizing this invention mainly consists of three components: a server, a terminal, and a user.

[0521] When the server receives a request from a user terminal, it uses a generative AI model to predict and create the necessary information and materials. This includes a process in which the predictive model utilizes historical data and the user's personal information to automatically generate specific and relevant materials. The server also uses a regulatory compliance agent to automatically verify whether the information provided by the user complies with current laws and regulations. After this verification is complete, the server sends the content that meets the requirements to the institutional system, completing the task.

[0522] The terminal uses virtual reality or augmented reality technology to project a virtual service counter into the user's home through a wearable display device. This allows users to access the virtual counter directly from home, select the necessary administrative services, and proceed with the procedures. The terminal also displays information transmitted from the server, providing an interface that allows users to easily provide and confirm information.

[0523] The user first starts up their terminal and launches a virtual portal, then selects the desired administrative service from the displayed options. For example, if they want to apply for a building permit, they can check the necessary documents and information related to the building generated on the server and enter new information as needed. This makes it possible to complete procedures that previously took a long time much faster.

[0524] As a concrete example, consider a case where a user wants to build a new house. When the user selects "Building Permit Application" in the virtual portal, the server generates and presents the necessary documents. The user reviews these documents and enters the appropriate information. The server verifies the legal compliance of this information and can notify the user that the permit process is complete.

[0525] An example of a prompt to input into the generating AI model is, "Based on the user's past building permit history, please generate the necessary documents for a new permit."

[0526] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0527] Step 1:

[0528] The user activates the terminal and displays a virtual service counter. Using virtual reality or augmented reality technology, the counter is projected onto a display device in the user's home. The user enters a command to activate the terminal as input, and the virtual service counter is visualized as output. During this process, the terminal prepares the user interface and presents the user with a list of selectable administrative services.

[0529] Step 2:

[0530] The user selects a specific administrative service from a list displayed in a virtual window. The input here is the user's selection of the service. The output is a signal requesting the necessary information and materials corresponding to the selected service. The terminal sends this signal to the server.

[0531] Step 3:

[0532] The server receives requests from terminals and uses a generative AI model to predict and create necessary information and materials. The input consists of the selected type of task and related user history data. The server performs data calculations based on this information to generate the necessary materials and information. The generated materials are then sent to the terminal as output.

[0533] Step 4:

[0534] The terminal receives and displays information sent from the server, providing it to the user. The input consists of informational data from the server. The terminal interprets this data and outputs it to a display device to provide the user with visual information. The user reviews the information as needed and prepares to provide further input.

[0535] Step 5:

[0536] The user enters the necessary information into the terminal, and this information is sent to the server. The input consists of new information entered by the user into the terminal. The terminal sends this information to the server, which then prepares to process it.

[0537] Step 6:

[0538] The server uses a regulatory compliance agent to verify information sent by the user and determines whether it meets the requirements for the business. The input is user data. The server checks this data with the regulatory agent and determines compliance. The output is the compliance determination result.

[0539] Step 7:

[0540] If the conditions are met, the server sends the information to the institutional system and completes the process. The input is user information for which legal compliance verification has been completed. The output is a processing completion notification generated in the institutional system and returned to the terminal. The user is notified that the process is complete, and the procedure ends.

[0541] This series of processes will allow users to quickly complete administrative procedures from the comfort of their homes.

[0542] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0543] This invention provides a virtual service window using virtual reality or augmented reality technology, and is a system that improves user convenience and satisfaction by combining an emotion engine when users perform administrative procedures from home. The system consists of three main elements: a server, a terminal, and a user, each of which functions as follows.

[0544] As a server function, the server receives requests from users and automatically generates necessary documents and information through a generative AI model. Based on the user's emotional state provided by the emotion engine, the server adjusts the information and interface it provides. For example, if a user indicates anxiety, the server will take action such as adding more detailed explanations.

[0545] The device's function is to project a virtual window onto a wall in the user's home using virtual reality or augmented reality technology. The device receives data from a server and displays it clearly to the user. It also analyzes the user's voice tone and facial expressions using an emotion engine and transmits this information to the server in real time. The device adjusts to display feedback appropriate to the user's emotions.

[0546] The user's operation begins with launching the terminal and displaying a virtual service window. The user then selects an administrative service, reviews the displayed information, and enters the necessary details. The emotion engine analyzes the user's voice and facial expressions, and the server uses this information to adjust how it provides information. For example, if a user is going through the "passport renewal" procedure and expresses anxiety about something they don't understand, the system will quickly provide detailed explanations and support.

[0547] This function allows the present invention to reduce the burden of administrative procedures on users and improve the quality of services.

[0548] The following describes the processing flow.

[0549] Step 1:

[0550] The user operates a device to activate a virtual interface, which then projects a virtual reality or augmented reality interface onto a wall in the home.

[0551] Step 2:

[0552] The user selects the necessary procedure from the administrative service options provided at the virtual counter. For example, they might choose "Change of Address."

[0553] Step 3:

[0554] The device detects the user's selection and sends that information to the server as a request.

[0555] Step 4:

[0556] The server activates a generation AI model based on the received request, analyzing past application data and user information to predict and generate the necessary documents.

[0557] Step 5:

[0558] The server sends the generated document to the terminal and simultaneously prepares to start the emotion engine to receive the user's emotion recognition results.

[0559] Step 6:

[0560] The terminal displays documents received from the server in a virtual window. During this process, an emotion engine analyzes the user's voice tone and facial expressions in real time.

[0561] Step 7:

[0562] The user reviews the information displayed in the virtual window and enters or corrects any necessary information. If the user's emotions indicate anxiety or confusion, the emotion engine sends that information to the server.

[0563] Step 8:

[0564] Based on the results from the emotion engine, the server adjusts the tone and content of the information provided and adds more detailed support.

[0565] Step 9:

[0566] The terminal receives updated information from the server and presents it to the user in an easy-to-understand format.

[0567] Step 10:

[0568] Once the user has reviewed all the information and completed the input, the terminal will send the final application data to the server.

[0569] Step 11:

[0570] The server verifies the entered information using a legal compliance agent and, if necessary, transmits it to the local government system to complete the procedure.

[0571] Step 12:

[0572] The server sends a notification to the terminal indicating that the procedure is complete.

[0573] Step 13:

[0574] The terminal displays a completion notification on the virtual portal, allowing the user to confirm that the procedure has been successfully completed.

[0575] (Example 2)

[0576] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0577] Modern administrative procedures often require users to perform them in person at a service counter, with limited options for remote participation from home. This results in time-consuming and laborious processes for users, and can cause anxiety and confusion if the procedures are unclear. Furthermore, traditional systems often fail to provide information that takes into account the user's emotional state, leading to a decline in the quality of the user experience.

[0578] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0579] In this invention, the server includes means for providing a virtual window displayed on a vertical surface within the home using virtual reality or augmented reality technology, means for generating information necessary for administrative procedures selected by the user using a generative AI model, and means for analyzing the user's emotional state using an emotion analysis engine and dynamically adjusting the presentation of information. This enables users to perform administrative procedures quickly and securely from home, reducing the psychological burden involved.

[0580] "Virtual reality technology" is a technology that uses computer technology to create a virtual environment that does not exist in reality, allowing users to experience things within that environment.

[0581] Augmented reality technology is a technique that overlays virtual information onto real-world images, providing users with additional information in real time.

[0582] A "virtual service counter" is an interface created on a screen using virtual reality or augmented reality technology, and functions as a platform for conducting administrative procedures remotely.

[0583] A "generative AI model" is a program that uses artificial intelligence to automatically generate the information and documents necessary for a specific procedure.

[0584] An "emotion analysis engine" is a technology that analyzes the user's voice and facial expressions to understand their emotional state and adjusts the information presented based on the results.

[0585] "Administrative body systems" refer to information processing systems used by public institutions that perform the necessary processing to complete administrative procedures.

[0586] This invention is a system that provides a virtual service counter using virtual reality or augmented reality technology in a home environment, enabling users to smoothly carry out administrative procedures from their homes.

[0587] The server is remotely located and includes a computer system for running generative AI models. Specifically, it uses Python and TensorFlow to build artificial intelligence models that automatically generate document templates in response to user requests. This generative AI model generates the necessary documents when the user selects a procedure. An example of a prompt message is, "Please generate the documents required for passport renewal."

[0588] The terminal is a device installed in the user's home and has a display function that uses virtual reality technology. Specifically, it projects a virtual screen onto a wall in the home using a dedicated headset or projector. The terminal visually presents information obtained from the server and generated documents to the user. In addition, it uses a built-in camera and microphone to analyze the user's voice and facial expressions with an emotion analysis engine and sends this data to the server to understand the user's emotional state. Based on this analysis result, the server easily adjusts the information display.

[0589] Users can operate a virtual service counter via their terminal and select the administrative services they need. For example, if a user selects "passport renewal," the necessary information will be displayed, and they can proceed with the procedure effectively and with peace of mind by entering the required information. This entire process contributes to reducing the burden of procedures by providing information tailored to the user's emotions.

[0590] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0591] Step 1:

[0592] The user activates the device and displays the virtual service window interface on the wall inside their home. This visually presents the options for administrative services. When the user selects the "passport renewal" procedure, that information is sent to the server via the device.

[0593] Step 2:

[0594] The server analyzes the request received from the user and provides the appropriate prompt message as input to the generating AI model. Using the prompt "Generate the documents required for passport renewal," the AI ​​model automatically generates the necessary document templates. The output of this process is document data as templates.

[0595] Step 3:

[0596] The server sends the generated document template to the terminal. The terminal receives this template data and presents it visually in an easy-to-understand format for the user. Specifically, it provides an interface through which the user can confirm and input the necessary information.

[0597] Step 4:

[0598] The device uses its built-in camera and microphone to capture the user's facial expressions and voice. This data is sent to an emotion analysis engine to analyze the user's emotional state. Voice and facial expression data are used as input, and the emotional state analysis results are generated as output.

[0599] Step 5:

[0600] The server receives the sentiment analysis results sent from the terminal and adjusts the format and content of the information presentation. For example, it generates an additional message to reassure the user and sends it back to the terminal. This adjustment improves the quality of the user experience.

[0601] Step 6:

[0602] The user reviews the presented documents and information and completes the required input. After input is complete, the terminal sends all information to the server to arrange for final approval and processing. The server sends the information to the administrative body's system for final processing of the procedure.

[0603] (Application Example 2)

[0604] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0605] In recent years, efforts have been made to enable administrative procedures to be conducted online, but these systems fail to address the emotional states and individual needs of users. As a result, users may experience anxiety and confusion, which hinders the smooth progress of procedures and detracts from the overall user experience. Furthermore, existing systems lack the personalization of face-to-face support, and are limited to providing users with uniform responses.

[0606] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0607] In this invention, the server includes means for analyzing the user's emotional state using an emotion engine and providing more appropriate feedback based on that state, means for adjusting the information and interface provided according to the emotional state, and means for predicting necessary documents or information using an automated generation algorithm. This enables the provision of personalized feedback and information according to the user's emotional state, and is expected to improve usability and satisfaction.

[0608] "Virtual reality" is a technology that uses computer technology to create an artificial environment that can be experienced like the real world, allowing users to interact and move around within that environment.

[0609] Augmented reality is a technology that overlays digital information onto real-world information, providing users with additional information related to their actual environment.

[0610] A "virtual counter" is a system that replicates actual counter services in a virtual environment, allowing users to perform administrative procedures and other tasks from their homes.

[0611] An "emotion engine" is software that analyzes the user's emotional state from their voice and facial expressions, and uses the results to adjust the system's response.

[0612] An "automatic generation algorithm" refers to a set of calculation procedures used to automatically create necessary documents and data from input information, enabling efficient data processing.

[0613] "Laws and regulations" refer to rules or laws enacted by public institutions, which are norms that must be observed in order to maintain social order.

[0614] A "local government system" is an information system used by local governments to manage and operate administrative procedures and citizen services.

[0615] This system consists of three main elements: a server, a terminal, and a user. The server receives requests from users and automatically generates the necessary documents and information using a generative AI model. The user's emotional state is analyzed by an emotion engine, and based on this, the server adjusts the information provided and the interface, and generates feedback that is appropriate to the user's emotions.

[0616] The terminal has the ability to project a virtual service counter into the home space using virtual reality or augmented reality technology. This allows users to complete administrative procedures from home. The terminal receives data from the server and displays it in an easy-to-understand manner for the user. During this process, the terminal analyzes the user's voice and facial expressions using an emotion engine and transmits this information to the server in real time.

[0617] The user first activates the terminal and displays a virtual service window. Next, the user selects the required administrative service, confirms the displayed information, and then enters the necessary details. For example, when performing a "passport renewal" procedure, if the user expresses anxiety about entering the information, the system can quickly provide more detailed explanations, thereby increasing the user's sense of security.

[0618] This feature reduces the burden of administrative procedures for users and improves the quality of service. The generating AI model generates prompt messages to present users with the most relevant information. An example of a specific prompt message would be, "We will begin the passport renewal process. What are your concerns? We will explain the necessary documents and the procedure in detail." This prompt is used to provide information tailored to the user's situation.

[0619] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0620] Step 1:

[0621] The server receives requests from users. The input request data identifies the administrative procedure selected by the user and includes information instructing the necessary processing. This data is then analyzed, and the server requests the generation of the necessary documents and information.

[0622] Step 2:

[0623] The server automatically generates necessary documents and information using a generative AI model. The input is data related to a specific procedure received from the user. Based on this data, the model combines appropriate components to generate the required documents. The output is the generated documents and information.

[0624] Step 3:

[0625] The device projects a virtual window into the home space using virtual reality or augmented reality technology. Input is data transmitted from a server, which the device then displays for the user to visually confirm. Output is the user's interaction with the visualized information.

[0626] Step 4:

[0627] The user selects an administrative service via the terminal, reviews the displayed information, and enters the required details. This entered data, which includes information necessary for the procedure to proceed, is sent to the server.

[0628] Step 5:

[0629] The server uses an emotion engine to analyze the user's voice and facial expressions to identify their emotional state. The input is real-time emotion data obtained from atmosphere analysis sensors, etc. Based on this, the server provides appropriate feedback and returns emotionally adjusted information to the user as output.

[0630] Step 6:

[0631] Based on the emotional state identified by the emotion engine, the server generates and presents prompts to the user. The input in this step consists of the user's emotional state data and details about the procedure. As a result, the user receives appropriate guidance tailored to the situation.

[0632] Step 7:

[0633] Once the above series of processes are successfully completed, the server sends the necessary data to the local government system and completes the process. For the procedural information treated as input, the output is provided as formal procedural data to the local government system, and a notification of completion of the procedure is returned to the user.

[0634] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0635] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0636] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0637] [Fourth Embodiment]

[0638] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0639] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0640] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0641] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0642] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0643] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0644] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0645] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0646] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0647] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0648] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0649] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0650] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0651] This invention provides a system that allows users to perform administrative procedures directly from their homes by offering a virtual service counter using virtual reality or augmented reality technology. This system consists of three elements: a server, a terminal, and a user, each of which functions as follows.

[0652] The server's functions include receiving requests from users and automatically generating necessary documents and information using a generation AI model. It references past application data and the user's personal information to predict and send data to the terminal. In addition, the entered information is verified by a legal compliance agent, and the suitability of the processing is determined based on the local government's regulations.

[0653] The terminal's function is to project a virtual window into the user's home using virtual reality or augmented reality technology. The terminal displays information sent from the server, allowing the user to easily input and modify that information. Furthermore, it displays a completion notification to the user when processing is complete.

[0654] The user's operation begins by launching the terminal and displaying the virtual service window. The user selects the required administrative service from the displayed options and reviews and enters the provided documents and information. For example, if the user selects the "change of address" procedure, they enter the new address information and wait for confirmation from the server as needed. Finally, they confirm the completion of the procedure on the virtual service window and finish the process.

[0655] As a concrete example, consider the case where a user requests a copy of their resident registration certificate. When the user opens a virtual portal on their terminal and selects "Request a copy of resident registration certificate," the server generates the necessary information and sends it to the terminal. The user enters the address to which the resident registration certificate should be sent, and once all the information is confirmed, the server completes the procedure and sends a completion notification. In this way, the present invention provides an environment in which users can easily perform administrative procedures at home without having to go to a government office.

[0656] The following describes the processing flow.

[0657] Step 1:

[0658] The user operates a device to activate a virtual interface, which then projects a virtual reality or augmented reality interface onto the wall of their home.

[0659] Step 2:

[0660] The user selects the necessary procedure from the administrative service options provided at the virtual counter. For example, they might choose "Change of Address."

[0661] Step 3:

[0662] The device detects the user's selection and sends that information to the server as a request.

[0663] Step 4:

[0664] The server activates a generation AI model based on the received request, analyzing past application data and user-related information to predict the necessary documents and information.

[0665] Step 5:

[0666] The server automatically generates predicted documents and information, and sends the generated data to the terminal.

[0667] Step 6:

[0668] The terminal displays documents and information received from the server on a virtual screen, presenting them in a user-friendly format.

[0669] Step 7:

[0670] The user reviews the application documents displayed in the virtual window and enters or corrects the necessary information.

[0671] Step 8:

[0672] The terminal sends the information entered by the user to the server.

[0673] Step 9:

[0674] The server uses a legal compliance agent to verify the entered information and check that everything complies with laws and regulations.

[0675] Step 10:

[0676] The server sends the verified information to the local government's system to complete the procedure.

[0677] Step 11:

[0678] The server sends a notification to the terminal indicating that the procedure is complete.

[0679] Step 12:

[0680] The terminal displays a completion notification on the virtual portal, allowing the user to confirm that the procedure has been completed.

[0681] (Example 1)

[0682] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0683] The current situation, where users must spend time visiting public institutions for administrative procedures, is inefficient and burdensome for many people. Furthermore, the effort and confusion involved in obtaining and filling out the necessary documents are also problematic. In particular, since it is difficult for users to guarantee the accuracy of documents based on legal regulations, there is a need for a system that supports efficient and accurate administrative procedures.

[0684] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0685] In this invention, the server includes means for providing a virtual portal using virtual reality or augmented reality technology, means for automatically generating necessary documents using a generative AI model, and means for verifying the accuracy of information based on laws and regulations. This makes it possible for users to easily complete administrative procedures from home.

[0686] "Virtual reality technology" is a technology that allows users to experience a computer-generated three-dimensional virtual environment as if it were reality.

[0687] Augmented reality technology is a technology that overlays digital information onto the real environment, providing a new visual experience by merging the real and digital worlds.

[0688] A "generative AI model" is a type of artificial intelligence that learns from large amounts of data and automatically generates various kinds of data and information, and is used in fields such as natural language processing and image generation.

[0689] A "virtual service window" is an electronic service window interface that is projected onto any location, such as within the home, using virtual reality or augmented reality technology.

[0690] The "legal regulation compliance coefficient" is a coefficient or function used to implement rules based on legal regulations and to verify and determine whether the input information conforms to those regulations.

[0691] A "user" is an individual or organization that carries out administrative procedures through this system and inputs and transmits information using an operating terminal.

[0692] This invention is a system that enables users to perform administrative procedures from within their homes using virtual reality or augmented reality technology. The system consists of three elements: a server, a terminal, and a user, each of which functions as follows:

[0693] server

[0694] When the server receives a request from the user's terminal, it uses a generative AI model to automatically generate the necessary documents and information. It performs highly accurate data processing while referencing past application history and the user's personal information. The generated information is then checked for compliance with regulations using a legal compliance coefficient. This ensures that the documents and guidelines the user needs are provided accurately and efficiently. For example, the AI ​​model can utilize a general-purpose natural language processing engine. A possible prompt might be, "Generate the documents required for a specific administrative procedure."

[0695] terminal

[0696] The terminal projects a virtual counter using virtual reality or augmented reality technology into the home, providing a user interface. It displays information sent from the server and provides an environment that is easy for the user to operate. When the user performs a procedure, the terminal accepts information input and corrections and notifies the user when the process is completed. The terminal can use general VR / AR devices. Through the terminal's operating interface, the user can proceed with administrative procedures without stress.

[0697] User

[0698] Users activate their device at home and select the necessary service through a virtual portal. For example, they can initiate a procedure such as "issuance of a copy of their resident registration certificate." After confirming the displayed information and entering the required details, the user waits for the server to complete the process and then checks for a completion notification. This series of operations reduces the burden on the user and allows them to complete the procedure quickly and accurately.

[0699] This system allows users to easily complete administrative procedures from the comfort of their homes, significantly reducing the need to visit public institutions.

[0700] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0701] Step 1:

[0702] The user activates the device and displays a virtual portal. A list of available administrative services is displayed on the screen. The user selects the desired procedure from these options. The user's selection is the only input. Based on the selection, the device sends a request to the server. Specifically, the user taps an icon on the screen, such as "Change Address."

[0703] Step 2:

[0704] The server receives a request from the terminal. The input is the procedure information selected by the user. Using a generative AI model, it automatically generates the necessary documents and information. In this process, the server retrieves past application history and personal information from the database, processes and calculates the data, and outputs precise prediction results. Specifically, the server calls the AI ​​model and provides the prompt message "Please generate the documents required for address change" as input.

[0705] Step 3:

[0706] The server verifies the generated information using a legal compliance coefficient. The input is the document output by the generation AI model. It checks whether it complies with legal regulations and, if so, returns the information to the terminal. Specifically, the server uses a rule-based engine to evaluate whether the items in the document match the regulations.

[0707] Step 4:

[0708] The terminal receives information sent from the server and displays it to the user. The input is generated information from the server. The user reviews the information and makes additional inputs as needed. For example, this might involve making corrections such as entering a new address. Specifically, the user types the new address into the input field on the screen.

[0709] Step 5:

[0710] The terminal resends the information entered by the user to the server. This input is new information from the user. The server performs a final check and then completes the process. Specifically, when the "Send" button is pressed, the terminal bundles the data into packets and sends them to the server.

[0711] Step 6:

[0712] The server confirms that the procedure is complete and notifies the user of the result. The output is a notification message confirming the completion of the procedure. Specifically, the server records the completion status in the database and sends a notification to the terminal.

[0713] This series of steps allows users to complete administrative procedures safely from the comfort of their homes, saving them time and effort.

[0714] (Application Example 1)

[0715] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0716] In modern urban life, residents are required to receive administrative services quickly and efficiently. However, traditional administrative procedures require residents to visit government offices in person, which is time-consuming and laborious. Furthermore, the time required to verify necessary documents and information is burdensome for users. In particular, when residents apply for building permits or ask tax-related questions, a large amount of documentation and procedures are required, causing delays. Therefore, the purpose of this invention is to solve these problems and improve the living environment.

[0717] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0718] In this invention, the server includes means for providing a virtual window projected onto a display device in the home using virtual reality or augmented reality technology; means for using a predictive model that identifies the administrative service selected by the user and predicts the necessary information or materials; and means for presenting and confirming service materials via the virtual window through a display device worn by the user. This enables the user to receive administrative services quickly and efficiently from home.

[0719] "Virtual reality" is a technology that uses computer technology to create a virtual environment different from reality and allows users to experience it.

[0720] Augmented reality is a technology that overlays digital information onto the real world, allowing users to experience both reality and the virtual world simultaneously.

[0721] A "display device" is a device used to provide information to a user visually, and includes screens and monitors.

[0722] A "virtual service window" is an interface that uses virtual reality or augmented reality to provide users with access to administrative services.

[0723] "Administrative services" refer to various procedures that local governments and government agencies perform for residents, including, for example, building permit applications and tax-related processing.

[0724] A "predictive model" refers to an algorithm that uses machine learning and artificial intelligence technologies to predict future events and necessary information.

[0725] "Wearable display devices" refer to visual devices worn by users, including smart glasses and head-mounted displays.

[0726] "Business documents" refer to various documents and information required when carrying out administrative procedures.

[0727] The system for realizing this invention mainly consists of three components: a server, a terminal, and a user.

[0728] When the server receives a request from a user terminal, it uses a generative AI model to predict and create the necessary information and materials. This includes a process in which the predictive model utilizes historical data and the user's personal information to automatically generate specific and relevant materials. The server also uses a regulatory compliance agent to automatically verify whether the information provided by the user complies with current laws and regulations. After this verification is complete, the server sends the content that meets the requirements to the institutional system, completing the task.

[0729] The terminal uses virtual reality or augmented reality technology to project a virtual service counter into the user's home through a wearable display device. This allows users to access the virtual counter directly from home, select the necessary administrative services, and proceed with the procedures. The terminal also displays information transmitted from the server, providing an interface that allows users to easily provide and confirm information.

[0730] The user first starts up their terminal and launches a virtual portal, then selects the desired administrative service from the displayed options. For example, if they want to apply for a building permit, they can check the necessary documents and information related to the building generated on the server and enter new information as needed. This makes it possible to complete procedures that previously took a long time much faster.

[0731] As a concrete example, consider a case where a user wants to build a new house. When the user selects "Building Permit Application" in the virtual portal, the server generates and presents the necessary documents. The user reviews these documents and enters the appropriate information. The server verifies the legal compliance of this information and can notify the user that the permit process is complete.

[0732] An example of a prompt to input into the generating AI model is, "Based on the user's past building permit history, please generate the necessary documents for a new permit."

[0733] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0734] Step 1:

[0735] The user activates the terminal and displays a virtual service counter. Using virtual reality or augmented reality technology, the counter is projected onto a display device in the user's home. The user enters a command to activate the terminal as input, and the virtual service counter is visualized as output. During this process, the terminal prepares the user interface and presents the user with a list of selectable administrative services.

[0736] Step 2:

[0737] The user selects a specific administrative service from a list displayed in a virtual window. The input here is the user's selection of the service. The output is a signal requesting the necessary information and materials corresponding to the selected service. The terminal sends this signal to the server.

[0738] Step 3:

[0739] The server receives requests from terminals and uses a generative AI model to predict and create necessary information and materials. The input consists of the selected type of task and related user history data. The server performs data calculations based on this information to generate the necessary materials and information. The generated materials are then sent to the terminal as output.

[0740] Step 4:

[0741] The terminal receives and displays information sent from the server, providing it to the user. The input consists of informational data from the server. The terminal interprets this data and outputs it to a display device to provide the user with visual information. The user reviews the information as needed and prepares to provide further input.

[0742] Step 5:

[0743] The user enters the necessary information into the terminal, and this information is sent to the server. The input consists of new information entered by the user into the terminal. The terminal sends this information to the server, which then prepares to process it.

[0744] Step 6:

[0745] The server uses a regulatory compliance agent to verify information sent by the user and determines whether it meets the requirements for the business. The input is user data. The server checks this data with the regulatory agent and determines compliance. The output is the compliance determination result.

[0746] Step 7:

[0747] If the conditions are met, the server sends the information to the institutional system and completes the process. The input is user information for which legal compliance verification has been completed. The output is a processing completion notification generated in the institutional system and returned to the terminal. The user is notified that the process is complete, and the procedure ends.

[0748] This series of processes will allow users to quickly complete administrative procedures from the comfort of their homes.

[0749] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0750] This invention provides a virtual service window using virtual reality or augmented reality technology, and is a system that improves user convenience and satisfaction by combining an emotion engine when users perform administrative procedures from home. The system consists of three main elements: a server, a terminal, and a user, each of which functions as follows.

[0751] As a server function, the server receives requests from users and automatically generates necessary documents and information through a generative AI model. Based on the user's emotional state provided by the emotion engine, the server adjusts the information and interface it provides. For example, if a user indicates anxiety, the server will take action such as adding more detailed explanations.

[0752] The device's function is to project a virtual window onto a wall in the user's home using virtual reality or augmented reality technology. The device receives data from a server and displays it clearly to the user. It also analyzes the user's voice tone and facial expressions using an emotion engine and transmits this information to the server in real time. The device adjusts to display feedback appropriate to the user's emotions.

[0753] The user's operation begins with launching the terminal and displaying a virtual service window. The user then selects an administrative service, reviews the displayed information, and enters the necessary details. The emotion engine analyzes the user's voice and facial expressions, and the server uses this information to adjust how it provides information. For example, if a user is going through the "passport renewal" procedure and expresses anxiety about something they don't understand, the system will quickly provide detailed explanations and support.

[0754] This function allows the present invention to reduce the burden of administrative procedures on users and improve the quality of services.

[0755] The following describes the processing flow.

[0756] Step 1:

[0757] The user operates a device to activate a virtual interface, which then projects a virtual reality or augmented reality interface onto a wall in the home.

[0758] Step 2:

[0759] The user selects the necessary procedure from the administrative service options provided at the virtual counter. For example, they might choose "Change of Address."

[0760] Step 3:

[0761] The device detects the user's selection and sends that information to the server as a request.

[0762] Step 4:

[0763] The server activates a generation AI model based on the received request, analyzing past application data and user information to predict and generate the necessary documents.

[0764] Step 5:

[0765] The server sends the generated document to the terminal and simultaneously prepares to start the emotion engine to receive the user's emotion recognition results.

[0766] Step 6:

[0767] The terminal displays documents received from the server in a virtual window. During this process, an emotion engine analyzes the user's voice tone and facial expressions in real time.

[0768] Step 7:

[0769] The user reviews the information displayed in the virtual window and enters or corrects any necessary information. If the user's emotions indicate anxiety or confusion, the emotion engine sends that information to the server.

[0770] Step 8:

[0771] Based on the results from the emotion engine, the server adjusts the tone and content of the information provided and adds more detailed support.

[0772] Step 9:

[0773] The terminal receives updated information from the server and presents it to the user in an easy-to-understand format.

[0774] Step 10:

[0775] Once the user has reviewed all the information and completed the input, the terminal will send the final application data to the server.

[0776] Step 11:

[0777] The server verifies the entered information using a legal compliance agent and, if necessary, transmits it to the local government system to complete the procedure.

[0778] Step 12:

[0779] The server sends a notification to the terminal indicating that the procedure is complete.

[0780] Step 13:

[0781] The terminal displays a completion notification on the virtual portal, allowing the user to confirm that the procedure has been successfully completed.

[0782] (Example 2)

[0783] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0784] Modern administrative procedures often require users to perform them in person at a service counter, with limited options for remote participation from home. This results in time-consuming and laborious processes for users, and can cause anxiety and confusion if the procedures are unclear. Furthermore, traditional systems often fail to provide information that takes into account the user's emotional state, leading to a decline in the quality of the user experience.

[0785] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0786] In this invention, the server includes means for providing a virtual window displayed on a vertical surface within the home using virtual reality or augmented reality technology, means for generating information necessary for administrative procedures selected by the user using a generative AI model, and means for analyzing the user's emotional state using an emotion analysis engine and dynamically adjusting the presentation of information. This enables users to perform administrative procedures quickly and securely from home, reducing the psychological burden involved.

[0787] "Virtual reality technology" is a technology that uses computer technology to create a virtual environment that does not exist in reality, allowing users to experience things within that environment.

[0788] Augmented reality technology is a technique that overlays virtual information onto real-world images, providing users with additional information in real time.

[0789] A "virtual service counter" is an interface created on a screen using virtual reality or augmented reality technology, and functions as a platform for conducting administrative procedures remotely.

[0790] A "generative AI model" is a program that uses artificial intelligence to automatically generate the information and documents necessary for a specific procedure.

[0791] An "emotion analysis engine" is a technology that analyzes the user's voice and facial expressions to understand their emotional state and adjusts the information presented based on the results.

[0792] "Administrative body systems" refer to information processing systems used by public institutions that perform the necessary processing to complete administrative procedures.

[0793] This invention is a system that provides a virtual service counter using virtual reality or augmented reality technology in a home environment, enabling users to smoothly carry out administrative procedures from their homes.

[0794] The server is remotely located and includes a computer system for running generative AI models. Specifically, it uses Python and TensorFlow to build artificial intelligence models that automatically generate document templates in response to user requests. This generative AI model generates the necessary documents when the user selects a procedure. An example of a prompt message is, "Please generate the documents required for passport renewal."

[0795] The terminal is a device installed in the user's home and has a display function that uses virtual reality technology. Specifically, it projects a virtual screen onto a wall in the home using a dedicated headset or projector. The terminal visually presents information obtained from the server and generated documents to the user. In addition, it uses a built-in camera and microphone to analyze the user's voice and facial expressions with an emotion analysis engine and sends this data to the server to understand the user's emotional state. Based on this analysis result, the server easily adjusts the information display.

[0796] Users can operate a virtual service counter via their terminal and select the administrative services they need. For example, if a user selects "passport renewal," the necessary information will be displayed, and they can proceed with the procedure effectively and with peace of mind by entering the required information. This entire process contributes to reducing the burden of procedures by providing information tailored to the user's emotions.

[0797] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0798] Step 1:

[0799] The user activates the device and displays the virtual service window interface on the wall inside their home. This visually presents the options for administrative services. When the user selects the "passport renewal" procedure, that information is sent to the server via the device.

[0800] Step 2:

[0801] The server analyzes the request received from the user and provides the appropriate prompt message as input to the generating AI model. Using the prompt "Generate the documents required for passport renewal," the AI ​​model automatically generates the necessary document templates. The output of this process is document data as templates.

[0802] Step 3:

[0803] The server sends the generated document template to the terminal. The terminal receives this template data and presents it visually in an easy-to-understand format for the user. Specifically, it provides an interface through which the user can confirm and input the necessary information.

[0804] Step 4:

[0805] The device uses its built-in camera and microphone to capture the user's facial expressions and voice. This data is sent to an emotion analysis engine to analyze the user's emotional state. Voice and facial expression data are used as input, and the emotional state analysis results are generated as output.

[0806] Step 5:

[0807] The server receives the sentiment analysis results sent from the terminal and adjusts the format and content of the information presentation. For example, it generates an additional message to reassure the user and sends it back to the terminal. This adjustment improves the quality of the user experience.

[0808] Step 6:

[0809] The user reviews the presented documents and information and completes the required input. After input is complete, the terminal sends all information to the server to arrange for final approval and processing. The server sends the information to the administrative body's system for final processing of the procedure.

[0810] (Application Example 2)

[0811] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0812] In recent years, efforts have been made to enable administrative procedures to be conducted online, but these systems fail to address the emotional states and individual needs of users. As a result, users may experience anxiety and confusion, which hinders the smooth progress of procedures and detracts from the overall user experience. Furthermore, existing systems lack the personalization of face-to-face support, and are limited to providing users with uniform responses.

[0813] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0814] In this invention, the server includes means for analyzing the user's emotional state using an emotion engine and providing more appropriate feedback based on that state, means for adjusting the information and interface provided according to the emotional state, and means for predicting necessary documents or information using an automated generation algorithm. This enables the provision of personalized feedback and information according to the user's emotional state, and is expected to improve usability and satisfaction.

[0815] "Virtual reality" is a technology that uses computer technology to create an artificial environment that can be experienced like the real world, allowing users to interact and move around within that environment.

[0816] Augmented reality is a technology that overlays digital information onto real-world information, providing users with additional information related to their actual environment.

[0817] A "virtual counter" is a system that replicates actual counter services in a virtual environment, allowing users to perform administrative procedures and other tasks from their homes.

[0818] An "emotion engine" is software that analyzes the user's emotional state from their voice and facial expressions, and uses the results to adjust the system's response.

[0819] An "automatic generation algorithm" refers to a set of calculation procedures used to automatically create necessary documents and data from input information, enabling efficient data processing.

[0820] "Laws and regulations" refer to rules or laws enacted by public institutions, which are norms that must be observed in order to maintain social order.

[0821] A "local government system" is an information system used by local governments to manage and operate administrative procedures and citizen services.

[0822] This system consists of three main elements: a server, a terminal, and a user. The server receives requests from users and automatically generates the necessary documents and information using a generative AI model. The user's emotional state is analyzed by an emotion engine, and based on this, the server adjusts the information provided and the interface, and generates feedback that is appropriate to the user's emotions.

[0823] The terminal has the ability to project a virtual service counter into the home space using virtual reality or augmented reality technology. This allows users to complete administrative procedures from home. The terminal receives data from the server and displays it in an easy-to-understand manner for the user. During this process, the terminal analyzes the user's voice and facial expressions using an emotion engine and transmits this information to the server in real time.

[0824] The user first activates the terminal and displays a virtual service window. Next, the user selects the required administrative service, confirms the displayed information, and then enters the necessary details. For example, when performing a "passport renewal" procedure, if the user expresses anxiety about entering the information, the system can quickly provide more detailed explanations, thereby increasing the user's sense of security.

[0825] This feature reduces the burden of administrative procedures for users and improves the quality of service. The generating AI model generates prompt messages to present users with the most relevant information. An example of a specific prompt message would be, "We will begin the passport renewal process. What are your concerns? We will explain the necessary documents and the procedure in detail." This prompt is used to provide information tailored to the user's situation.

[0826] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0827] Step 1:

[0828] The server receives requests from users. The input request data identifies the administrative procedure selected by the user and includes information instructing the necessary processing. This data is then analyzed, and the server requests the generation of the necessary documents and information.

[0829] Step 2:

[0830] The server automatically generates necessary documents and information using a generative AI model. The input is data related to a specific procedure received from the user. Based on this data, the model combines appropriate components to generate the required documents. The output is the generated documents and information.

[0831] Step 3:

[0832] The device projects a virtual window into the home space using virtual reality or augmented reality technology. Input is data transmitted from a server, which the device then displays for the user to visually confirm. Output is the user's interaction with the visualized information.

[0833] Step 4:

[0834] The user selects an administrative service via the terminal, reviews the displayed information, and enters the required details. This entered data, which includes information necessary for the procedure to proceed, is sent to the server.

[0835] Step 5:

[0836] The server uses an emotion engine to analyze the user's voice and facial expressions to identify their emotional state. The input is real-time emotion data obtained from atmosphere analysis sensors, etc. Based on this, the server provides appropriate feedback and returns emotionally adjusted information to the user as output.

[0837] Step 6:

[0838] Based on the emotional state identified by the emotion engine, the server generates and presents prompts to the user. The input in this step consists of the user's emotional state data and details about the procedure. As a result, the user receives appropriate guidance tailored to the situation.

[0839] Step 7:

[0840] Once the above series of processes are successfully completed, the server sends the necessary data to the local government system and completes the process. For the procedural information treated as input, the output is provided as formal procedural data to the local government system, and a notification of completion of the procedure is returned to the user.

[0841] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0842] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0843] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0844] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0845] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0846] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0847] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0848] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0849] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0850] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0851] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0852] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0853] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0854] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0855] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0856] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0857] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0858] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0859] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0860] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0861] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0862] The following is further disclosed regarding the embodiments described above.

[0863] (Claim 1)

[0864] A means of providing a virtual window projected onto a wall in a home using virtual reality or augmented reality technology,

[0865] A means of using an automated generation model that identifies the administrative procedure selected by the user and predicts the necessary documents or information,

[0866] A means of presenting the aforementioned predicted information and documents to the user and receiving user input,

[0867] A means for verifying the input information in light of legal regulations and determining whether the necessary conditions for the procedure are met,

[0868] If the above conditions are met, a means of transmitting the information to the local government system to complete the process,

[0869] A system that includes this.

[0870] (Claim 2)

[0871] The system according to claim 1, wherein the verification means based on the aforementioned legal regulations are performed by a legal regulation compliance agent of the local government.

[0872] (Claim 3)

[0873] The system according to claim 1, wherein the information and documents presented by the virtual counter are customized using the user's past application data and personal information.

[0874] "Example 1"

[0875] (Claim 1)

[0876] A means of providing a virtual window projected onto a display device in the home using virtual reality or augmented reality technology,

[0877] A means of using a generative AI model that identifies the procedure selected by the user and predicts the necessary documents or information,

[0878] A means for presenting the predicted information or documents to the user and receiving user input,

[0879] A means for verifying the input information in light of legal regulations and determining whether the necessary conditions for the procedure are met,

[0880] If the above conditions are met, means for transmitting to a public institution system to complete the processing,

[0881] A method by which a generation AI model automatically generates documents based on the user's past operation history and personal information,

[0882] A system that includes this.

[0883] (Claim 2)

[0884] The system according to claim 1, wherein the verification means based on the aforementioned legal regulations is performed by a legal regulation compliance coefficient of a public institution.

[0885] (Claim 3)

[0886] The system according to claim 1, wherein the information and documents provided by the virtual window are adjusted using the user's past operation history and personal information.

[0887] "Application Example 1"

[0888] (Claim 1)

[0889] A means of providing a virtual window projected onto a display device in the home using virtual reality or augmented reality technology,

[0890] A means of using a predictive model that identifies the administrative service selected by the user and predicts the necessary information or materials,

[0891] A means of presenting the aforementioned predicted information and materials to the user and receiving information provided by the user,

[0892] A means of verifying the provided information in light of laws and regulations and determining whether it meets the necessary conditions for the business,

[0893] If the above conditions are met, means for transmitting to the institutional system to complete processing,

[0894] A means of presenting and verifying business documents via a virtual counter through a display device worn by the user,

[0895] A system that includes this.

[0896] (Claim 2)

[0897] The system according to claim 1, wherein the verification means based on the aforementioned laws and regulations are performed by the agency's legal compliance agent.

[0898] (Claim 3)

[0899] The system according to claim 1, wherein the information and materials presented by the virtual counter are adjusted using the user's past business data and personal information.

[0900] "Example 2 of combining an emotion engine"

[0901] (Claim 1)

[0902] A means of providing a virtual window displayed on a vertical surface within a home using virtual reality or augmented reality technology,

[0903] A means of using a model that identifies the administrative procedure selected by the user and generates the necessary documents or information,

[0904] A means of presenting the generated information and documents to the user and receiving user input,

[0905] A means for verifying the input information in light of the law and determining whether the requirements necessary for the procedure are met,

[0906] If the above requirements are met, a means for transmitting the data to the administrative body's system to complete the processing,

[0907] A means for analyzing the emotional state of users and adjusting the presentation of information based on the analysis results,

[0908] A system that includes this.

[0909] (Claim 2)

[0910] The system according to claim 1, wherein the verification means based on the aforementioned laws and regulations is performed by a legal compliance agent of an administrative body.

[0911] (Claim 3)

[0912] The system according to claim 1, wherein the information and documents presented by the virtual counter are customized based on the user's emotional state.

[0913] "Application example 2 when combining with an emotional engine"

[0914] (Claim 1)

[0915] A means of providing a virtual window projected into a home space using virtual reality or augmented reality technology,

[0916] A means of using an automated generation algorithm that identifies the administrative task selected by the user and predicts the necessary documents or information,

[0917] A means for presenting the predicted information or documents to the user and receiving user input,

[0918] A means of verifying the input information in light of laws and regulations and determining whether it meets the necessary conditions for the business,

[0919] If the above conditions are met, a means of transmitting the information to the local government system to complete the process,

[0920] A means of analyzing the user's emotional state using an emotion engine and providing more appropriate feedback based on that state,

[0921] Means for adjusting the information and interface provided in accordance with the aforementioned emotional state,

[0922] A system that includes this.

[0923] (Claim 2)

[0924] The system according to claim 1, wherein the verification means based on the aforementioned laws and regulations are performed by a local government law compliance agent and take into account data from an emotion engine.

[0925] (Claim 3)

[0926] The system according to claim 1, wherein the information and documents presented by the virtual counter are customized using the user's past application records and personal data, and further adjusted according to the user's emotional state. [Explanation of symbols]

[0927] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means of providing a virtual window projected onto a display device in the home using virtual reality or augmented reality technology, A means of using a predictive model that identifies the administrative service selected by the user and predicts the necessary information or materials, A means of presenting the aforementioned predicted information and materials to the user and receiving information provided by the user, A means of verifying the provided information in light of laws and regulations and determining whether it meets the necessary conditions for the business, If the above conditions are met, means for transmitting to the institutional system to complete processing, A means of presenting and verifying business documents via a virtual counter through a display device worn by the user, A system that includes this.

2. The system according to claim 1, wherein the verification means based on the aforementioned laws and regulations is performed by the agency's legal compliance agent.

3. The system according to claim 1, wherein the information and materials presented by the virtual counter are adjusted using the user's past business data and personal information.

Images