system

Abstract

We provide the system. [Solution] A data input means for inputting attribute information from the user, A data management means that holds the aforementioned attribute information and accesses a database that stores information on each administrative system, A search means that searches for the relevant administrative system based on the attribute information and generates a list of candidates, A guidance generation means that generates information on how to use and the procedures for each administrative system from the aforementioned candidate list, Information presentation means for presenting information generated by the guidance generation means to the user, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] It is to solve the situation where general users are unaware of the existence of various supports and subsidy systems provided by the government, or where the usage methods and procedures are complicated and time-consuming. Also, it is necessary to enable users to easily find a system suitable for themselves and quickly start the procedures.

Means for Solving the Problems

[0005] This invention provides a system that allows users to efficiently access suitable programs by incorporating a data input means for acquiring attribute information from users and a search means for searching for administrative support and subsidy programs in a database based on that information. Furthermore, it provides an information presentation means that selects candidate administrative programs and generates guidance generation means for explaining the usage methods and procedures of each program in an easy-to-understand manner. The invention also includes a feedback reception means that allows users to provide feedback after the information is presented, further improving convenience. In addition, by incorporating an automatic update means that periodically updates information to keep the database of each program up-to-date, the invention can always provide services based on the latest information.

[0006] A "data input method" is an interface that allows a user to input their attribute information into the system.

[0007] A "data management system" is a function that securely stores attribute information entered by users and uses that information to access information about administrative systems.

[0008] A "database" is a system that stores information about various administrative systems and structurally maintains information for searching for the appropriate system based on the user's attribute information.

[0009] The "search method" is a function that searches for relevant administrative system information within the database based on user attribute information received by the data management method, and generates a list of candidates.

[0010] The "information generation method" is a function that generates information on how to use and the procedures for administrative systems selected by the search method, and creates information to explain them to the user in an easy-to-understand manner.

[0011] An "information presentation means" is an interface for displaying information generated by a guidance generation means in a format that is easy for the user to understand.

[0012] A "feedback receiving mechanism" is a function that accepts opinions and requests from users regarding information presented through an information presentation mechanism.

[0013] An "automatic update mechanism" refers to a process or function for periodically updating administrative system information stored in a database with newer information. [Brief explanation of the drawing]

[0014] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13]It is a sequence diagram showing the processing flow of the data processing system in Embodiment 2 when the emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when the emotion engine is combined.

Modes for Carrying Out the Invention

[0015] Hereinafter, an example of an embodiment of the system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be one arithmetic unit or a combination of a plurality of arithmetic units. Also, the processor may be one type of arithmetic unit or a combination of a plurality of types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0018] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0019] In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.

[0020] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0022] [First Embodiment]

[0023] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0024] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0027] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0030] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0034] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0035] This invention is a system designed to allow users to easily access administrative systems, and it mainly consists of a user terminal, a server, and a database. Users input their personal information via the terminal. Input is usually done through a dedicated user interface, and the items include age, address, occupation, income, and family structure. The input information is transmitted from the terminal to the server.

[0036] To process the received information, the server first connects to a database to search for relevant administrative system information. The database contains the latest administrative system information and its associated conditions and requirements. The server identifies systems that match the user's attribute information and generates a list of those systems.

[0037] Next, the server generates information necessary for using each system and the procedures involved, based on the generated list of systems. This information generation includes, for example, required documents, application procedures, and submission destinations. The generated information is sent to the terminal in a user-friendly format and displayed on the user interface.

[0038] As a concrete example, a user living in a rural area and planning a new business can enter their information into the terminal, and the server will recommend programs such as the "Subsidy for Entrepreneurship Support for Regional Revitalization" and the "Young Entrepreneur Support Program." Then, they will be given detailed instructions on the necessary documents (e.g., business plan and identification) and the application process. This entire process allows users to quickly find the program best suited to them and reduces the burden of the application process.

[0039] Furthermore, this system features an automatic update function, regularly updating the system information in the database to always provide users with the latest information. This allows users to appropriately utilize support and subsidy programs that are relevant to the times. By utilizing the feedback function, the system can accept requests for additional information and suggestions for improvement from users, which will be used to improve the quality of the service.

[0040] The following describes the processing flow.

[0041] Step 1:

[0042] The user enters attribute information through the terminal's interface. Input fields include age, address, occupation, income, family structure, and interest categories. Once input is complete, the terminal sends this information to the server.

[0043] Step 2:

[0044] The server receives attribute information sent by the user. After receiving the information, the server accesses the database and generates a search query for administrative systems that match the user's criteria. This query is constructed to identify systems in the database that are most likely to match the user's attributes.

[0045] Step 3:

[0046] The server uses the generated search query to search the database. As a result of the search, a list of institutions containing the appropriate administrative institution information is extracted. The list includes a summary of each institution.

[0047] Step 4:

[0048] Based on the list of programs obtained as search results, the server generates detailed information on how to use each program and the procedures involved. This information includes specific details such as the documents required for application, procedures, and contact information.

[0049] Step 5:

[0050] The server sends the generated detailed information to the terminal. The terminal displays this information to the user in an easy-to-understand format through the user interface. For each system, the necessary procedures and preparations are visually shown.

[0051] Step 6:

[0052] Users review the information presented through their device and provide feedback as needed. This feedback can include requests for further information or suggestions for system improvements. Once feedback is entered on the device, it is sent to the server for processing.

[0053] Step 7:

[0054] The server performs a process that automatically updates the database information periodically. By collecting the latest administrative information and replacing the information in the database, it keeps users with the most up-to-date information.

[0055] (Example 1)

[0056] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0057] Individuals wishing to utilize public services often spend considerable time and effort finding and using the services that best suit their needs. Furthermore, insufficient updates to information regarding these services pose a risk of users making decisions based on outdated information. To address these challenges, there is a need for a system that provides appropriate and timely service guidance and consistently delivers the latest information.

[0058] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0059] In this invention, the server includes an information input means for inputting attribute information from a user, an information management device that holds the attribute information and stores information on each public system, and a selection device that searches for the relevant public system based on the attribute information and generates a candidate list. This allows users to quickly and easily find a public system that suits them and to obtain accurate usage methods and procedural information for that system in the latest format.

[0060] "Information input means" refers to a device or interface for a user to input their own attribute information.

[0061] An "information management device" is a device that holds user attribute information and stores and manages information for various public systems.

[0062] A "selection device" is a device that searches for relevant public institutions based on the user's attribute information and generates a list of candidates.

[0063] A "guide generation device" is a device that creates detailed information on how to use each public system and the procedures involved from the generated list of candidates.

[0064] An "information display device" is a device that presents generated guidance information to the user and displays it in a format that the user can easily understand.

[0065] A "response receiving device" is a device that collects user feedback based on the information presented and uses it to improve the system.

[0066] An "automatic update device" is a device that periodically updates information related to each public system within the information management system, keeping it always up-to-date.

[0067] A "generative AI model" is an artificial intelligence model that optimizes generated guidance information using prompt text and provides it in the most beneficial format for the user.

[0068] This invention is a system that streamlines the use of information in public institutions, and is mainly composed of servers, terminals, and databases.

[0069] Users input their personal information through the terminal's user interface. Specifically, they fill in information such as age, address, occupation, income, and family structure on a form used as an information input method. This information is sent from the terminal to the server. The server functions as an information management device, storing and managing the received data.

[0070] Subsequently, the server uses a selection device to access the database based on the user's attribute information and search for relevant public systems. The systems found through the search are then used by a guidance generation device to create information on how to use each system and the procedures involved, which are then presented to the user.

[0071] The generated information is transmitted to the terminal via an information display device and presented to the user on the user interface. To enhance user convenience, the information is organized in an easy-to-read format.

[0072] The system has an automatic update mechanism that periodically updates the database information within the information management device, ensuring that users are always provided with the latest system information. Furthermore, a generation AI model is used to optimize guidance information and create prompt messages.

[0073] For example, if a user enters "I want to start a new business" into the terminal, the server will search for "Subsidies for Entrepreneurship Support for Regional Revitalization" and "Programs to Support Young Entrepreneurs" and present the information appropriately. An example of a prompt message would be, "Please tell me about suitable public programs for starting a new business."

[0074] This system allows users to find the system best suited to their needs and proceed with the process efficiently.

[0075] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0076] Step 1:

[0077] The user enters their attribute information into the terminal's user interface. This input data includes age, address, occupation, income, and family structure. The terminal receives this input and organizes the data in an initial format. The entered data is then temporarily stored locally in preparation for transmission to the server.

[0078] Step 2:

[0079] The terminal sends attribute information entered by the user to the server. To maintain data integrity during transmission, a secure communication protocol (e.g., HTTPS) is used to ensure the data arrives at the server untampered. The input data is temporarily stored for processing on the server side.

[0080] Step 3:

[0081] The server accesses the database based on the received attribute information and performs a search. The database used here contains the latest information on public systems. The server uses SQL queries and other methods to extract matching systems based on user attributes and outputs them as a candidate list.

[0082] Step 4:

[0083] The server uses a guidance generation device to create detailed information on how to use the service, based on the extracted system information. The generated data includes a list of required documents, application procedures, and submission addresses. Furthermore, an AI generation model is used to optimize this guidance information into prompt messages.

[0084] Step 5:

[0085] The generated guidance information and prompt messages are transferred from the server to the terminal. The information is formatted and displayed on the terminal screen in a format that is easy for the user to understand (e.g., step-by-step instructions, checklist format). The terminal plays the role of providing the final information to the user.

[0086] Step 6:

[0087] Users review the guidance information displayed on their terminals and proceed with the necessary procedures. Furthermore, user feedback is collected through a response reception device to improve system quality. This feedback is then sent to the server as improvement suggestions and stored for future updates.

[0088] (Application Example 1)

[0089] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0090] There is a challenge in reducing the burden of complex procedures and information searches that users face when using administrative systems, and enabling them to obtain necessary system information in a simple way using voice recognition technology. In particular, there is a need to realize a system that supports users in comfortably obtaining system information at home.

[0091] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0092] In this invention, the server includes data input means for inputting attribute information from a user, data management means for holding the attribute information and accessing a data storage that stores information on each public system, information retrieval means for searching for the relevant public system based on the attribute information and generating a candidate list, and voice input means for automatically acquiring information from the user using voice recognition technology. As a result, the user can easily acquire necessary administrative system information and obtain appropriate procedural information through voice input.

[0093] A "user" is an individual or group that uses this system to input their attribute information and obtain administrative system information.

[0094] "Attribute information" refers to personal identifying information related to a user's age, address, occupation, income, and family structure.

[0095] "Data input means" refers to an interface for users to input their attribute information into the system, such as a keyboard or voice input device.

[0096] A "data management system" is a mechanism that holds user attribute information and has the function of accessing data storage related to public systems.

[0097] "Data storage" refers to databases and other information storage means used to store and update information related to various public institutions.

[0098] An "information retrieval tool" is a mechanism that has the function of searching for relevant public institutions and generating a list of candidates based on the user's attribute information.

[0099] A "guide generation mechanism" is a system that creates information on how to use each public system and the procedures involved from the generated candidate list.

[0100] An "information presentation means" is an interface that visually or audibly presents information created by a guidance generation means to the user.

[0101] "Voice input means" refers to technologies that acquire information using the user's voice, such as voice recognition software or microphone devices.

[0102] A "feedback collection mechanism" is a system for collecting feedback from users and using it to improve the system.

[0103] An "automatic update mechanism" is a process for regularly keeping public system information stored in a data repository up to date.

[0104] This invention is a system for users to efficiently obtain administrative system information using voice input, and is composed of multiple hardware and software components. The server receives attribute information transmitted from the user terminal and accesses a data storage based on it. This data storage contains the latest public system information, and the server searches this information to identify a system suitable for the user and generates a list of candidates.

[0105] As a means of voice input, the terminal is equipped with speech recognition technology, and uses Google® Cloud Speech-to-Text API and other tools to convert the user's voice into text data. The converted text is sent to the server as attribute information. The server processes user information via a REST API written in Python and implements logic for searching public system information. In addition, the public system information has an automatic update mechanism that updates periodically, and the overall operation of the system is optimized using frameworks such as Flask and Django.

[0106] Through this system, users can input their information by voice and obtain information about the system. Information is presented visually through the user interface, and voice guidance is also available as needed. Especially when used in the home, the interface built into consumer robots is utilized to enable natural interaction with the user.

[0107] For example, if a user requests information about grants for studying abroad via voice inquiry, the system will search for relevant programs and guide them through a list of potential grants and application procedures. This flow reduces the burden of complex procedures for the user.

[0108] An example of a prompt message for the generating AI model is, "Based on the user's voice attribute information, search for the most suitable support system and generate guidance information for it."

[0109] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0110] Step 1:

[0111] The user inputs their attribute information into the device using the speech recognition function. The data entered as speech is converted into text data using the Google Cloud Speech-to-Text API by the device's voice input method, and then formatted as attribute information. This allows the system to obtain the user's basic information.

[0112] Step 2:

[0113] The terminal sends attribute information, converted into text data, to the server. The server receives this information and prepares to access public system information stored in the data storage using data management means. The received data is converted into a specific format as attribute information within the server. This prepares the user information necessary for the subsequent search process.

[0114] Step 3:

[0115] The server searches the data storage based on attribute information to find the relevant public institutions. The information retrieval tool uses a Python library to execute SQL queries and extract institution data that meets the criteria. The extracted results are formatted into an appropriate format and compiled into a candidate list. This candidate list serves as the basic information to be presented to the user.

[0116] Step 4:

[0117] Based on the generated candidate list, the server moves to the stage of detailing the usage methods and procedures for each public system through the guidance generation mechanism. Using a template engine, the information based on the candidate list is formatted for the user. Document and procedural information is supplemented here, completing the guidance information.

[0118] Step 5:

[0119] The completed guidance information is transmitted from the server to the terminal. The terminal visually displays the information on the user interface via an information display device. Voice guidance is also available as an option, utilizing speech synthesis technology to convert the generated text information into speech and present it. This allows users to ultimately obtain information on administrative systems that are relevant to them and use it to guide their subsequent actions.

[0120] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0121] This invention is a system incorporating an emotion engine to enable users to obtain appropriate administrative information according to their emotional state. The system comprises a user terminal, a server, a database, and an emotion engine.

[0122] The user enters their attribute information using a terminal, and this information is sent to the server. Based on the received information, the server accesses a database and searches for administrative systems that match the user's attributes. The resulting candidate systems are converted into detailed usage instructions and procedural information, and presented to the user.

[0123] In addition to this process, an emotion engine operates on the user's device. The emotion engine analyzes the user's emotions based on user input information and operation history, taking into account other data such as facial expressions and voice tone. The results of the emotion analysis are sent to the server, and the information and interface presented are dynamically adjusted according to the user's emotions. For example, if the user is feeling stressed, the interface tone can be made gentler, or information can be presented step by step to improve user convenience.

[0124] For example, if the emotion engine determines that a user has the emotion of "unstable income and looking for applicable welfare programs, but feeling anxious about the procedures," the server will respond accordingly by prioritizing the display of programs with relatively simple procedures or providing helpful guidance explaining the procedures. The system can also collect user feedback information and use it to improve the system. When feedback is received, special guidance and support information will be provided based on the user's emotion data to further enhance the user experience.

[0125] Furthermore, the database's automatic update function ensures it always operates based on the latest administrative system information. This allows users to obtain timely information that keeps pace with current trends. As a whole, the system enables it to provide users with a more personalized administrative system information service.

[0126] The following describes the processing flow.

[0127] Step 1:

[0128] The user enters attribute information such as age, address, occupation, income, and family structure through the terminal's interface. Once the input is complete, the terminal sends that information to the server.

[0129] Step 2:

[0130] The server queries the database based on attribute information received from the terminal to search for the relevant administrative system. During the search, it generates a list of the most suitable systems using conditions that match the user's attributes.

[0131] Step 3:

[0132] Based on the generated list of programs, the server creates information on the specific usage methods and procedures for each program. This information includes required documents, application procedures, deadlines, and more.

[0133] Step 4:

[0134] The emotion engine built into the device analyzes the user's emotional state using user input information, facial recognition, voice analysis, and operation history. It identifies the level of emotions the user is experiencing, such as anxiety or stress.

[0135] Step 5:

[0136] The emotion engine's analysis results are sent to the server, which then adjusts the style and content of the information presented to the user based on those results. For example, if the emotion is negative, the server might adjust the information by explaining it more carefully or providing detailed step-by-step instructions.

[0137] Step 6:

[0138] The server sends the adjusted information back to the terminal and presents it to the user in an easy-to-understand format. The display on the terminal includes changes in color and font that respond to emotions.

[0139] Step 7:

[0140] Users can review the presented information and provide feedback from their device if necessary. This feedback includes requests for additional information and suggestions for improving the user interface. This feedback information is also analyzed on the server and used to improve the system.

[0141] Step 8:

[0142] The server uses an automatic update function to keep the administrative system information in the database up to date. This ensures that users are always provided with the most current information.

[0143] (Example 2)

[0144] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0145] Users who wish to utilize administrative systems often find it difficult to find a system that suits their needs or to understand complex procedural information. Furthermore, conventional systems do not provide information tailored to the user's emotional state, sometimes resulting in an inefficient user experience. This invention aims to solve these problems.

[0146] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0147] In this invention, the server includes data input means for acquiring attribute information from a user; data management means for accessing information storage means that holds the attribute information and records information about each system; search means for searching for the appropriate system based on the attribute information and generating selection candidates; guidance generation means for generating usage methods and procedural information for each system from the selection candidates; information presentation means for presenting the information generated by the guidance generation means to the user; emotion analysis means for analyzing the user's emotional information; and information adjustment means for dynamically adjusting the presented information based on the results obtained by the emotion analysis means. This enables a more efficient and personalized user experience by searching for an appropriate administrative system based on the user's attribute information and providing information that corresponds to the user's emotional state.

[0148] "Data input means" refers to a means of obtaining attribute information from a user, and includes an interface that allows the user to easily input information.

[0149] A "data management system" is a means of holding attribute information received from users and providing functions for accessing recorded information.

[0150] An "information storage means" is a means equipped with the function of recording and managing information related to each system, and is capable of maintaining up-to-date information at all times.

[0151] A "search tool" is a means that has the function of searching for related systems and generating selection candidates based on acquired attribute information.

[0152] A "guidance generation method" is a means of generating information on how to use and the procedures for the selected candidate systems, and presenting it to users in an easy-to-understand manner.

[0153] An "information presentation means" is a means that plays a role in effectively presenting generated information to the user.

[0154] An "emotion analysis tool" is a means of analyzing a user's emotional information, and has the function of identifying the user's emotional state by analyzing facial expressions, voice tone, etc.

[0155] An "information adjustment tool" is a tool that has the function of dynamically adjusting the content and format of the information presented based on the results of sentiment analysis.

[0156] An "automatic update mechanism" is a means that has the function of periodically updating the information of each system in an information storage mechanism to the latest state.

[0157] A "feedback receiving method" is a means of receiving user responses after information has been presented and using them to improve the system.

[0158] This invention is a system for providing administrative information tailored to the user and improving the user experience. The system comprises a user terminal, a server, information storage means, and sentiment analysis means.

[0159] Users input attribute information via a terminal, including age and income status. The terminal transmits the entered information to a server via a data management system, which then accesses an information storage system based on that data. This information storage system holds the latest regulatory information, and appropriate regulatory information can be quickly retrieved using a search system.

[0160] An emotion analysis system operates on the user's terminal, analyzing input information, facial expressions, and voice tone in real time. The results of the emotion analysis are sent to a server, and an information adjustment system dynamically adjusts the information provided based on this analysis. For example, if the analysis indicates that the user is feeling anxious, the procedural information will be presented step by step in a clearer and more user-friendly format.

[0161] For example, if the emotion engine determines that a user has an unstable income and is looking for applicable welfare programs but is unsure about the procedures, the server will take this into consideration and prioritize displaying programs that are easy to apply for and appropriate. It will also provide helpful guidance and support to the user throughout the process.

[0162] By using a generative AI model, information based on the user's emotions and attributes is generated through prompt messages, resulting in a user experience optimized for individual situations. A concrete example of a prompt message is: "If the user's emotional state is determined to be 'stressed,' list simple administrative procedures and generate explanatory text in a gentle tone." This system enables users to utilize these systems efficiently and stress-free.

[0163] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0164] Step 1:

[0165] The user enters attribute information using a terminal. This input includes personal data such as age, region, and income status. The terminal collects this attribute information and sends it to the server using a secure protocol. The entered data becomes the basic data necessary for subsequent processing by the server.

[0166] Step 2:

[0167] The server stores attribute information received from the terminal in a data management system. Based on this data, the server accesses an information storage system and searches for relevant institutional information. In this process, the attribute information is compared with the database in the information storage system to identify institutional information with a high degree of relevance. The output is a list of candidate institutional systems that are suitable for the user.

[0168] Step 3:

[0169] The server generates detailed usage instructions and procedural information from the candidate schemes found through the search. This guidance generation mechanism extracts relevant documents and organizes information to create information in a user-friendly format. The output is detailed information explaining how to use the scheme and the procedures involved.

[0170] Step 4:

[0171] An emotion analysis system operates on the user's device, analyzing the user's facial expressions, voice tone, and input information. Based on this data, the device calculates the user's emotional state and sends the result to the server. The output of this processing step is data representing the user's emotional state.

[0172] Step 5:

[0173] The server dynamically adjusts the generated institutional information based on the output of the emotion analysis device. The information adjustment device changes the way information is presented and the content of it according to the user's emotions. For example, if the user is feeling stressed, the procedure steps are arranged in a gentler format. This output is customized institutional information that matches the user's current situation.

[0174] Step 6:

[0175] Users view the presented information and provide feedback to the server via their terminal regarding their understanding and use of that information. The server collects the input feedback information and stores it as material for system improvement. This feedback process contributes to improving the user experience and the system.

[0176] (Application Example 2)

[0177] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0178] When obtaining information about administrative systems using portable information terminals such as smartphones or robots, failing to consider the user's emotional state can lead to misunderstandings and hinder the smooth execution of procedures. Furthermore, users experiencing anxiety or stress require more flexible and considerate information presentation. However, current systems have limitations in providing information that considers user emotions, resulting in an inability to optimize the user experience.

[0179] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0180] In this invention, the server includes data input means for inputting user attribute information, emotion recognition means for analyzing the user's emotional state, and dynamic information adjustment means for dynamically adjusting information based on the emotional information analyzed by the emotion recognition means. This makes it possible to provide appropriate and flexible information according to the user's emotional state.

[0181] "Data input means" refers to a device or program for receiving attribute information from a user.

[0182] "Data management means" refers to a device or program that holds user attribute information and accesses a database to handle information related to administrative systems.

[0183] A "search tool" is a device or program that finds administrative systems relevant to a user based on attribute information and generates a list of candidates.

[0184] A "guide generation means" is a device or program for creating information on how to use and the procedures for each administrative system from a list of candidates.

[0185] "Information presentation means" refers to a device or program that displays or provides information created by the guidance generation means to the user.

[0186] "Emotion recognition means" refers to a device or program for analyzing a user's emotional state and acquiring that information.

[0187] A "dynamic information adjustment means" is a device or program that changes the information presented according to the situation based on emotional information analyzed by an emotion recognition means.

[0188] The system for realizing this invention includes a user terminal, a server, a database, and an emotion recognition engine. The user terminal takes the form of a smartphone or tablet and accepts user input. Specifically, it uses a camera and microphone to acquire facial expressions and voice tone. This data is analyzed by the emotion recognition engine to determine the user's emotional state.

[0189] The server receives attribute information and sentiment data sent by the user. The server incorporates data management mechanisms, which are responsible for accessing databases to retrieve information related to administrative systems. It is possible to use cloud-based sentiment recognition algorithms such as Azure Cognitive Services. Furthermore, the server is equipped with dynamic information adjustment mechanisms, which adjust the way information is presented according to the user's emotional state.

[0190] If a user is experiencing particular stress, the system can change the tone of the interface and provide more detailed, step-by-step instructions. For example, if the system identifies that a user is experiencing an unstable income and is looking for applicable welfare programs but is anxious about the procedures, it will prioritize displaying programs with simpler procedures and provide helpful guidance.

[0191] This system can continuously improve its service by utilizing user feedback. An example of a prompt message submitted to the generation AI model would be, "Generate a reassuring guide when the user is feeling anxious."

[0192] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0193] Step 1:

[0194] Users input attribute information through their terminals. This input information is sent to the server as the user's personal data. This attribute information later serves as basic data for determining suitability for administrative systems.

[0195] Step 2:

[0196] The device uses its camera and microphone to capture the user's facial expressions and voice tone. This data is sent in real time to an emotion recognition engine, where the user's emotional state is analyzed. In this process, the data is converted into numerical indicators representing the user's emotions and sent to the server.

[0197] Step 3:

[0198] The server receives attribute information and sentiment data sent by the user. Using data management tools, it retrieves administrative system information from the database that matches the user's attributes. In this process, it generates database queries based on the attribute information and creates a list of candidate administrative systems.

[0199] Step 4:

[0200] A dynamic information adjustment mechanism within the server adjusts the acquired administrative system information based on analyzed sentiment data. Specifically, if the sentiment indicates stress or anxiety, the way the information is presented and the tone of the interface are changed to make it more approachable.

[0201] Step 5:

[0202] The server sends the processed information to the terminal, and the terminal presents the information to the user in an appropriate format. This information may be provided as text or audio guidance.

[0203] Step 6:

[0204] Users can provide feedback on the information presented. The device collects this feedback and sends it to the server. This information will later be used as data to improve the service.

[0205] Step 7:

[0206] The server performs data analysis based on collected feedback and sentiment data to tune and improve the overall information delivery process of the system. This enables more personalized administrative information services.

[0207] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0208] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0209] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0210] [Second Embodiment]

[0211] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0212] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0213] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0214] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0215] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0216] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0217] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0218] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0219] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0220] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0221] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0222] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0223] This invention is a system designed to allow users to easily access administrative systems, and it mainly consists of a user terminal, a server, and a database. Users input their personal information via the terminal. Input is usually done through a dedicated user interface, and the items include age, address, occupation, income, and family structure. The input information is transmitted from the terminal to the server.

[0224] To process the received information, the server first connects to a database to search for relevant administrative system information. The database contains the latest administrative system information and its associated conditions and requirements. The server identifies systems that match the user's attribute information and generates a list of those systems.

[0225] Next, the server generates information necessary for using each system and the procedures involved, based on the generated list of systems. This information generation includes, for example, required documents, application procedures, and submission destinations. The generated information is sent to the terminal in a user-friendly format and displayed on the user interface.

[0226] As a concrete example, a user living in a rural area and planning a new business can enter their information into the terminal, and the server will recommend programs such as the "Subsidy for Entrepreneurship Support for Regional Revitalization" and the "Young Entrepreneur Support Program." Then, they will be given detailed instructions on the necessary documents (e.g., business plan and identification) and the application process. This entire process allows users to quickly find the program best suited to them and reduces the burden of the application process.

[0227] Furthermore, this system features an automatic update function, regularly updating the system information in the database to always provide users with the latest information. This allows users to appropriately utilize support and subsidy programs that are relevant to the times. By utilizing the feedback function, the system can accept requests for additional information and suggestions for improvement from users, which will be used to improve the quality of the service.

[0228] The following describes the processing flow.

[0229] Step 1:

[0230] The user enters attribute information through the terminal's interface. Input fields include age, address, occupation, income, family structure, and interest categories. Once input is complete, the terminal sends this information to the server.

[0231] Step 2:

[0232] The server receives attribute information sent by the user. After receiving the information, the server accesses the database and generates a search query for administrative systems that match the user's criteria. This query is constructed to identify systems in the database that are most likely to match the user's attributes.

[0233] Step 3:

[0234] The server uses the generated search query to search the database. As a result of the search, a list of institutions containing the appropriate administrative institution information is extracted. The list includes a summary of each institution.

[0235] Step 4:

[0236] Based on the list of programs obtained as search results, the server generates detailed information on how to use each program and the procedures involved. This information includes specific details such as the documents required for application, procedures, and contact information.

[0237] Step 5:

[0238] The server sends the generated detailed information to the terminal. The terminal displays this information to the user in an easy-to-understand format through the user interface. For each system, the necessary procedures and preparations are visually shown.

[0239] Step 6:

[0240] Users review the information presented through their device and provide feedback as needed. This feedback can include requests for further information or suggestions for system improvements. Once feedback is entered on the device, it is sent to the server for processing.

[0241] Step 7:

[0242] The server performs a process that automatically updates the database information periodically. By collecting the latest administrative information and replacing the information in the database, it keeps users with the most up-to-date information.

[0243] (Example 1)

[0244] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0245] Individuals wishing to utilize public services often spend considerable time and effort finding and using the services that best suit their needs. Furthermore, insufficient updates to information regarding these services pose a risk of users making decisions based on outdated information. To address these challenges, there is a need for a system that provides appropriate and timely service guidance and consistently delivers the latest information.

[0246] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0247] In this invention, the server includes an information input means for inputting attribute information from a user, an information management device that holds the attribute information and stores information on each public system, and a selection device that searches for the relevant public system based on the attribute information and generates a candidate list. This allows users to quickly and easily find a public system that suits them and to obtain accurate usage methods and procedural information for that system in the latest format.

[0248] "Information input means" refers to a device or interface for a user to input their own attribute information.

[0249] An "information management device" is a device that holds user attribute information and stores and manages information for various public systems.

[0250] A "selection device" is a device that searches for relevant public institutions based on the user's attribute information and generates a list of candidates.

[0251] A "guide generation device" is a device that creates detailed information on how to use each public system and the procedures involved from the generated list of candidates.

[0252] An "information display device" is a device that presents generated guidance information to the user and displays it in a format that the user can easily understand.

[0253] A "response receiving device" is a device that collects user feedback based on the information presented and uses it to improve the system.

[0254] An "automatic update device" is a device that periodically updates information related to each public system within the information management system, keeping it always up-to-date.

[0255] A "generative AI model" is an artificial intelligence model that optimizes generated guidance information using prompt text and provides it in the most beneficial format for the user.

[0256] This invention is a system that streamlines the use of information in public institutions, and is mainly composed of servers, terminals, and databases.

[0257] Users input their personal information through the terminal's user interface. Specifically, they fill in information such as age, address, occupation, income, and family structure on a form used as an information input method. This information is sent from the terminal to the server. The server functions as an information management device, storing and managing the received data.

[0258] Subsequently, the server uses a selection device to access the database based on the user's attribute information and search for relevant public systems. The systems found through the search are then used by a guidance generation device to create information on how to use each system and the procedures involved, which are then presented to the user.

[0259] The generated information is transmitted to the terminal via an information display device and presented to the user on the user interface. To enhance user convenience, the information is organized in an easy-to-read format.

[0260] The system has an automatic update mechanism that periodically updates the database information within the information management device, ensuring that users are always provided with the latest system information. Furthermore, a generation AI model is used to optimize guidance information and create prompt messages.

[0261] For example, if a user enters "I want to start a new business" into the terminal, the server will search for "Subsidies for Entrepreneurship Support for Regional Revitalization" and "Programs to Support Young Entrepreneurs" and present the information appropriately. An example of a prompt message would be, "Please tell me about suitable public programs for starting a new business."

[0262] This system allows users to find the system best suited to their needs and proceed with the process efficiently.

[0263] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0264] Step 1:

[0265] The user enters their attribute information into the terminal's user interface. This input data includes age, address, occupation, income, and family structure. The terminal receives this input and organizes the data in an initial format. The entered data is then temporarily stored locally in preparation for transmission to the server.

[0266] Step 2:

[0267] The terminal sends attribute information entered by the user to the server. To maintain data integrity during transmission, a secure communication protocol (e.g., HTTPS) is used to ensure the data arrives at the server untampered. The input data is temporarily stored for processing on the server side.

[0268] Step 3:

[0269] The server accesses the database based on the received attribute information and performs a search. The database used here contains the latest information on public systems. The server uses SQL queries and other methods to extract matching systems based on user attributes and outputs them as a candidate list.

[0270] Step 4:

[0271] The server uses a guidance generation device to create detailed information on how to use the service, based on the extracted system information. The generated data includes a list of required documents, application procedures, and submission addresses. Furthermore, an AI generation model is used to optimize this guidance information into prompt messages.

[0272] Step 5:

[0273] The generated guidance information and prompt messages are transferred from the server to the terminal. The information is formatted and displayed on the terminal screen in a format that is easy for the user to understand (e.g., step-by-step instructions, checklist format). The terminal plays the role of providing the final information to the user.

[0274] Step 6:

[0275] Users review the guidance information displayed on their terminals and proceed with the necessary procedures. Furthermore, user feedback is collected through a response reception device to improve system quality. This feedback is then sent to the server as improvement suggestions and stored for future updates.

[0276] (Application Example 1)

[0277] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0278] There is a challenge in reducing the burden of complex procedures and information searches that users face when using administrative systems, and enabling them to obtain necessary system information in a simple way using voice recognition technology. In particular, there is a need to realize a system that supports users in comfortably obtaining system information at home.

[0279] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0280] In this invention, the server includes data input means for inputting attribute information from a user, data management means for holding the attribute information and accessing a data storage that stores information on each public system, information retrieval means for searching for the relevant public system based on the attribute information and generating a candidate list, and voice input means for automatically acquiring information from the user using voice recognition technology. As a result, the user can easily acquire necessary administrative system information and obtain appropriate procedural information through voice input.

[0281] A "user" is an individual or group that uses this system to input their attribute information and obtain administrative system information.

[0282] "Attribute information" refers to personal identifying information related to a user's age, address, occupation, income, and family structure.

[0283] "Data input means" refers to an interface for users to input their attribute information into the system, such as a keyboard or voice input device.

[0284] The "data management means" is a mechanism that holds user attribute information and has the function of accessing data storage related to public systems.

[0285] The "data storage" is a database or other information storage means for storing and updating information related to each public system.

[0286] The "information search means" is a mechanism that has the function of searching for corresponding public systems based on user attribute information and generating a candidate list.

[0287] The "guidance generation means" is a mechanism that creates usage methods and procedure information for each public system from the generated candidate list.

[0288] The "information presentation means" is an interface that visually or audibly presents the information created by the guidance generation means to the user.

[0289] The "voice input means" is a technology that acquires information using the user's voice, such as voice recognition software or a microphone device.

[0290] The "feedback reception means" is a mechanism that collects feedback provided by the user and uses it for system improvement.

[0291] The "automatic update means" is a process for keeping the public system information stored in the data storage up-to-date periodically.

[0292] This invention is a system for a user to efficiently obtain administrative system information using voice input, and is composed of a plurality of hardware and software components. The server receives the attribute information transmitted from the user terminal and accesses the data storage based on it. The latest public system information is stored in this data storage, and the server searches these information to identify the systems suitable for the user and generates a candidate list.

[0293] As a means of voice input, the terminal is equipped with speech recognition technology, and uses the Google Cloud Speech-to-Text API and other tools to convert the user's voice into text data. The converted text is sent to the server as attribute information. The server processes the user information via a REST API written in Python and implements logic for searching public system information. In addition, there is an automatic update mechanism for public system information that is updated periodically, and the overall operation of the system is optimized using frameworks such as Flask and Django.

[0294] Through this system, users can input their information by voice and obtain information about the system. Information is presented visually through the user interface, and voice guidance is also available as needed. Especially when used in the home, the interface built into consumer robots is utilized to enable natural interaction with the user.

[0295] For example, if a user requests information about grants for studying abroad via voice inquiry, the system will search for relevant programs and guide them through a list of potential grants and application procedures. This flow reduces the burden of complex procedures for the user.

[0296] An example of a prompt message for the generating AI model is, "Based on the user's voice attribute information, search for the most suitable support system and generate guidance information for it."

[0297] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0298] Step 1:

[0299] The user inputs their attribute information into the device using the speech recognition function. The data entered as speech is converted into text data using the Google Cloud Speech-to-Text API by the device's voice input method, and then formatted as attribute information. This allows the system to obtain the user's basic information.

[0300] Step 2:

[0301] The terminal sends attribute information, converted into text data, to the server. The server receives this information and prepares to access public system information stored in the data storage using data management means. The received data is converted into a specific format as attribute information within the server. This prepares the user information necessary for the subsequent search process.

[0302] Step 3:

[0303] The server searches the data storage based on attribute information to find the relevant public institutions. The information retrieval tool uses a Python library to execute SQL queries and extract institution data that meets the criteria. The extracted results are formatted into an appropriate format and compiled into a candidate list. This candidate list serves as the basic information to be presented to the user.

[0304] Step 4:

[0305] Based on the generated candidate list, the server moves to the stage of detailing the usage methods and procedures for each public system through the guidance generation mechanism. Using a template engine, the information based on the candidate list is formatted for the user. Document and procedural information is supplemented here, completing the guidance information.

[0306] Step 5:

[0307] The completed guidance information is transmitted from the server to the terminal. The terminal visually displays the information on the user interface via the information presentation means. Voice guidance can also be used as an option, and by utilizing voice synthesis technology, it is possible to convert the generated text information into voice and present it. As a result, the user can finally obtain information on the administrative system suitable for themselves and utilize it for subsequent actions.

[0308] Furthermore, an emotion engine for estimating the user's emotion may be combined. That is, the specific processing unit 290 may estimate the user's emotion using the emotion specific model 59 and perform specific processing using the user's emotion.

[0309] This invention is a system incorporating an emotion engine so that a user can obtain appropriate administrative system information according to their emotional state. The system is configured to include a user terminal, a server, a database, and an emotion engine.

[0310] The user uses the terminal to input their attribute information, and the information is transmitted to the server. The server accesses the database based on the received information and searches for an administrative system that matches the user's attributes. The system candidates obtained as search results are converted into detailed usage methods and procedure information and presented to the user.

[0311] In addition to this process, the emotion engine operates on the user's terminal. The emotion engine analyzes the user's emotion in consideration of other data such as facial expressions and voice tones based on the user's input information and operation history. The result of the emotion analysis is sent to the server, and the presented information and interface are dynamically adjusted according to the user's emotion. For example, when the user is feeling stressed, the tone of the interface can be made gentler, or the information can be presented step by step to improve the user's convenience.

[0312] For example, if the emotion engine determines that a user has the emotion of "unstable income and looking for applicable welfare programs, but feeling anxious about the procedures," the server will respond accordingly by prioritizing the display of programs with relatively simple procedures or providing helpful guidance explaining the procedures. The system can also collect user feedback information and use it to improve the system. When feedback is received, special guidance and support information will be provided based on the user's emotion data to further enhance the user experience.

[0313] Furthermore, the database's automatic update function ensures it always operates based on the latest administrative system information. This allows users to obtain timely information that keeps pace with current trends. As a whole, the system enables it to provide users with a more personalized administrative system information service.

[0314] The following describes the processing flow.

[0315] Step 1:

[0316] The user enters attribute information such as age, address, occupation, income, and family structure through the terminal's interface. Once the input is complete, the terminal sends that information to the server.

[0317] Step 2:

[0318] The server queries the database based on attribute information received from the terminal to search for the relevant administrative system. During the search, it generates a list of the most suitable systems using conditions that match the user's attributes.

[0319] Step 3:

[0320] Based on the generated list of programs, the server creates information on the specific usage methods and procedures for each program. This information includes required documents, application procedures, deadlines, and more.

[0321] Step 4:

[0322] The emotion engine built into the device analyzes the user's emotional state using user input information, facial recognition, voice analysis, and operation history. It identifies the level of emotions the user is experiencing, such as anxiety or stress.

[0323] Step 5:

[0324] The emotion engine's analysis results are sent to the server, which then adjusts the style and content of the information presented to the user based on those results. For example, if the emotion is negative, the server might adjust the information by explaining it more carefully or providing detailed step-by-step instructions.

[0325] Step 6:

[0326] The server sends the adjusted information back to the terminal and presents it to the user in an easy-to-understand format. The display on the terminal includes changes in color and font that respond to emotions.

[0327] Step 7:

[0328] Users can review the presented information and provide feedback from their device if necessary. This feedback includes requests for additional information and suggestions for improving the user interface. This feedback information is also analyzed on the server and used to improve the system.

[0329] Step 8:

[0330] The server uses an automatic update function to keep the administrative system information in the database up to date. This ensures that users are always provided with the most current information.

[0331] (Example 2)

[0332] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0333] Users who wish to utilize administrative systems often find it difficult to find a system that suits their needs or to understand complex procedural information. Furthermore, conventional systems do not provide information tailored to the user's emotional state, sometimes resulting in an inefficient user experience. This invention aims to solve these problems.

[0334] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0335] In this invention, the server includes data input means for acquiring attribute information from a user; data management means for accessing information storage means that holds the attribute information and records information about each system; search means for searching for the appropriate system based on the attribute information and generating selection candidates; guidance generation means for generating usage methods and procedural information for each system from the selection candidates; information presentation means for presenting the information generated by the guidance generation means to the user; emotion analysis means for analyzing the user's emotional information; and information adjustment means for dynamically adjusting the presented information based on the results obtained by the emotion analysis means. This enables a more efficient and personalized user experience by searching for an appropriate administrative system based on the user's attribute information and providing information that corresponds to the user's emotional state.

[0336] "Data input means" refers to a means of obtaining attribute information from a user, and includes an interface that allows the user to easily input information.

[0337] A "data management system" is a means of holding attribute information received from users and providing functions for accessing recorded information.

[0338] An "information storage means" is a means equipped with the function of recording and managing information related to each system, and is capable of maintaining up-to-date information at all times.

[0339] A "search tool" is a means that has the function of searching for related systems and generating selection candidates based on acquired attribute information.

[0340] A "guidance generation method" is a means of generating information on how to use and the procedures for the selected candidate systems, and presenting it to users in an easy-to-understand manner.

[0341] An "information presentation means" is a means that plays a role in effectively presenting generated information to the user.

[0342] An "emotion analysis tool" is a means of analyzing a user's emotional information, and has the function of identifying the user's emotional state by analyzing facial expressions, voice tone, etc.

[0343] An "information adjustment tool" is a tool that has the function of dynamically adjusting the content and format of the information presented based on the results of sentiment analysis.

[0344] An "automatic update mechanism" is a means that has the function of periodically updating the information of each system in an information storage mechanism to the latest state.

[0345] A "feedback receiving method" is a means of receiving user responses after information has been presented and using them to improve the system.

[0346] This invention is a system for providing administrative information tailored to the user and improving the user experience. The system comprises a user terminal, a server, information storage means, and sentiment analysis means.

[0347] Users input attribute information via a terminal, including age and income status. The terminal transmits the entered information to a server via a data management system, which then accesses an information storage system based on that data. This information storage system holds the latest regulatory information, and appropriate regulatory information can be quickly retrieved using a search system.

[0348] An emotion analysis system operates on the user's terminal, analyzing input information, facial expressions, and voice tone in real time. The results of the emotion analysis are sent to a server, and an information adjustment system dynamically adjusts the information provided based on this analysis. For example, if the analysis indicates that the user is feeling anxious, the procedural information will be presented step by step in a clearer and more user-friendly format.

[0349] For example, if the emotion engine determines that a user has an unstable income and is looking for applicable welfare programs but is unsure about the procedures, the server will take this into consideration and prioritize displaying programs that are easy to apply for and appropriate. It will also provide helpful guidance and support to the user throughout the process.

[0350] By using a generative AI model, information based on the user's emotions and attributes is generated through prompt messages, resulting in a user experience optimized for individual situations. A concrete example of a prompt message is: "If the user's emotional state is determined to be 'stressed,' list simple administrative procedures and generate explanatory text in a gentle tone." This system enables users to utilize these systems efficiently and stress-free.

[0351] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0352] Step 1:

[0353] The user enters attribute information using a terminal. This input includes personal data such as age, region, and income status. The terminal collects this attribute information and sends it to the server using a secure protocol. The entered data becomes the basic data necessary for subsequent processing by the server.

[0354] Step 2:

[0355] The server stores attribute information received from the terminal in a data management system. Based on this data, the server accesses an information storage system and searches for relevant institutional information. In this process, the attribute information is compared with the database in the information storage system to identify institutional information with a high degree of relevance. The output is a list of candidate institutional systems that are suitable for the user.

[0356] Step 3:

[0357] The server generates detailed usage instructions and procedural information from the candidate schemes found through the search. This guidance generation mechanism extracts relevant documents and organizes information to create information in a user-friendly format. The output is detailed information explaining how to use the scheme and the procedures involved.

[0358] Step 4:

[0359] An emotion analysis system operates on the user's device, analyzing the user's facial expressions, voice tone, and input information. Based on this data, the device calculates the user's emotional state and sends the result to the server. The output of this processing step is data representing the user's emotional state.

[0360] Step 5:

[0361] The server dynamically adjusts the generated institutional information based on the output of the emotion analysis device. The information adjustment device changes the way information is presented and the content of it according to the user's emotions. For example, if the user is feeling stressed, the procedure steps are arranged in a gentler format. This output is customized institutional information that matches the user's current situation.

[0362] Step 6:

[0363] Users view the presented information and provide feedback to the server via their terminal regarding their understanding and use of that information. The server collects the input feedback information and stores it as material for system improvement. This feedback process contributes to improving the user experience and the system.

[0364] (Application Example 2)

[0365] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0366] When obtaining information about administrative systems using portable information terminals such as smartphones or robots, failing to consider the user's emotional state can lead to misunderstandings and hinder the smooth execution of procedures. Furthermore, users experiencing anxiety or stress require more flexible and considerate information presentation. However, current systems have limitations in providing information that considers user emotions, resulting in an inability to optimize the user experience.

[0367] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0368] In this invention, the server includes data input means for inputting user attribute information, emotion recognition means for analyzing the user's emotional state, and dynamic information adjustment means for dynamically adjusting information based on the emotional information analyzed by the emotion recognition means. This makes it possible to provide appropriate and flexible information according to the user's emotional state.

[0369] "Data input means" refers to a device or program for receiving attribute information from a user.

[0370] "Data management means" refers to a device or program that holds user attribute information and accesses a database to handle information related to administrative systems.

[0371] A "search tool" is a device or program that finds administrative systems relevant to a user based on attribute information and generates a list of candidates.

[0372] A "guide generation means" is a device or program for creating information on how to use and the procedures for each administrative system from a list of candidates.

[0373] "Information presentation means" refers to a device or program that displays or provides information created by the guidance generation means to the user.

[0374] "Emotion recognition means" refers to a device or program for analyzing a user's emotional state and acquiring that information.

[0375] A "dynamic information adjustment means" is a device or program that changes the information presented according to the situation based on emotional information analyzed by an emotion recognition means.

[0376] The system for realizing this invention includes a user terminal, a server, a database, and an emotion recognition engine. The user terminal takes the form of a smartphone or tablet and accepts user input. Specifically, it uses a camera and microphone to acquire facial expressions and voice tone. This data is analyzed by the emotion recognition engine to determine the user's emotional state.

[0377] The server receives attribute information and sentiment data sent by the user. The server has a built-in data management mechanism, which is responsible for accessing the database and retrieving information about administrative systems. It is possible to use cloud-based sentiment recognition algorithms such as Azure Cognitive Services. Furthermore, the server is equipped with a dynamic information adjustment mechanism, which adjusts how information is presented according to the user's emotional state.

[0378] If a user is experiencing particular stress, the system can change the tone of the interface and provide more detailed, step-by-step instructions. For example, if the system identifies that a user is experiencing an unstable income and is looking for applicable welfare programs but is anxious about the procedures, it will prioritize displaying programs with simpler procedures and provide helpful guidance.

[0379] This system can continuously improve its service by utilizing user feedback. An example of a prompt message submitted to the generation AI model would be, "Generate a reassuring guide when the user is feeling anxious."

[0380] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0381] Step 1:

[0382] Users input attribute information through their terminals. This input information is sent to the server as the user's personal data. This attribute information later serves as basic data for determining suitability for administrative systems.

[0383] Step 2:

[0384] The device uses its camera and microphone to capture the user's facial expressions and voice tone. This data is sent in real time to an emotion recognition engine, where the user's emotional state is analyzed. In this process, the data is converted into numerical indicators representing the user's emotions and sent to the server.

[0385] Step 3:

[0386] The server receives attribute information and sentiment data sent by the user. Using data management tools, it retrieves administrative system information from the database that matches the user's attributes. In this process, it generates database queries based on the attribute information and creates a list of candidate administrative systems.

[0387] Step 4:

[0388] A dynamic information adjustment mechanism within the server adjusts the acquired administrative system information based on analyzed sentiment data. Specifically, if the sentiment indicates stress or anxiety, the way the information is presented and the tone of the interface are changed to make it more approachable.

[0389] Step 5:

[0390] The server sends the processed information to the terminal, and the terminal presents the information to the user in an appropriate format. This information may be provided as text or audio guidance.

[0391] Step 6:

[0392] Users can provide feedback on the information presented. The device collects this feedback and sends it to the server. This information will later be used as data to improve the service.

[0393] Step 7:

[0394] The server performs data analysis based on collected feedback and sentiment data to tune and improve the overall information delivery process of the system. This enables more personalized administrative information services.

[0395] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0396] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0397] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0398] [Third Embodiment]

[0399] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0400] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0401] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0402] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0403] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0404] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0405] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0406] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0407] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0408] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0409] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0410] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0411] This invention is a system designed to allow users to easily access administrative systems, and it mainly consists of a user terminal, a server, and a database. Users input their personal information via the terminal. Input is usually done through a dedicated user interface, and the items include age, address, occupation, income, and family structure. The input information is transmitted from the terminal to the server.

[0412] To process the received information, the server first connects to a database to search for relevant administrative system information. The database contains the latest administrative system information and its associated conditions and requirements. The server identifies systems that match the user's attribute information and generates a list of those systems.

[0413] Next, the server generates information necessary for using each system and the procedures involved, based on the generated list of systems. This information generation includes, for example, required documents, application procedures, and submission destinations. The generated information is sent to the terminal in a user-friendly format and displayed on the user interface.

[0414] As a concrete example, a user living in a rural area and planning a new business can enter their information into the terminal, and the server will recommend programs such as the "Subsidy for Entrepreneurship Support for Regional Revitalization" and the "Young Entrepreneur Support Program." Then, they will be given detailed instructions on the necessary documents (e.g., business plan and identification) and the application process. This entire process allows users to quickly find the program best suited to them and reduces the burden of the application process.

[0415] Furthermore, this system features an automatic update function, regularly updating the system information in the database to always provide users with the latest information. This allows users to appropriately utilize support and subsidy programs that are relevant to the times. By utilizing the feedback function, the system can accept requests for additional information and suggestions for improvement from users, which will be used to improve the quality of the service.

[0416] The following describes the processing flow.

[0417] Step 1:

[0418] The user enters attribute information through the terminal's interface. Input fields include age, address, occupation, income, family structure, and interest categories. Once input is complete, the terminal sends this information to the server.

[0419] Step 2:

[0420] The server receives attribute information sent by the user. After receiving the information, the server accesses the database and generates a search query for administrative systems that match the user's criteria. This query is constructed to identify systems in the database that are most likely to match the user's attributes.

[0421] Step 3:

[0422] The server uses the generated search query to search the database. As a result of the search, a list of institutions containing the appropriate administrative institution information is extracted. The list includes a summary of each institution.

[0423] Step 4:

[0424] Based on the list of programs obtained as search results, the server generates detailed information on how to use each program and the procedures involved. This information includes specific details such as the documents required for application, procedures, and contact information.

[0425] Step 5:

[0426] The server sends the generated detailed information to the terminal. The terminal displays this information to the user in an easy-to-understand format through the user interface. For each system, the necessary procedures and preparations are visually shown.

[0427] Step 6:

[0428] Users review the information presented through their device and provide feedback as needed. This feedback can include requests for further information or suggestions for system improvements. Once feedback is entered on the device, it is sent to the server for processing.

[0429] Step 7:

[0430] The server performs a process that automatically updates the database information periodically. By collecting the latest administrative information and replacing the information in the database, it keeps users with the most up-to-date information.

[0431] (Example 1)

[0432] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0433] Individuals wishing to utilize public services often spend considerable time and effort finding and using the services that best suit their needs. Furthermore, insufficient updates to information regarding these services pose a risk of users making decisions based on outdated information. To address these challenges, there is a need for a system that provides appropriate and timely service guidance and consistently delivers the latest information.

[0434] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0435] In this invention, the server includes an information input means for inputting attribute information from a user, an information management device that holds the attribute information and stores information on each public system, and a selection device that searches for the relevant public system based on the attribute information and generates a candidate list. This allows users to quickly and easily find a public system that suits them and to obtain accurate usage methods and procedural information for that system in the latest format.

[0436] "Information input means" refers to a device or interface for a user to input their own attribute information.

[0437] An "information management device" is a device that holds user attribute information and stores and manages information for various public systems.

[0438] A "selection device" is a device that searches for relevant public institutions based on the user's attribute information and generates a list of candidates.

[0439] A "guide generation device" is a device that creates detailed information on how to use each public system and the procedures involved from the generated list of candidates.

[0440] An "information display device" is a device that presents generated guidance information to the user and displays it in a format that the user can easily understand.

[0441] A "response receiving device" is a device that collects user feedback based on the information presented and uses it to improve the system.

[0442] An "automatic update device" is a device that periodically updates information related to each public system within the information management system, keeping it always up-to-date.

[0443] A "generative AI model" is an artificial intelligence model that optimizes generated guidance information using prompt text and provides it in the most beneficial format for the user.

[0444] This invention is a system that streamlines the use of information in public institutions, and is mainly composed of servers, terminals, and databases.

[0445] Users input their personal information through the terminal's user interface. Specifically, they fill in information such as age, address, occupation, income, and family structure on a form used as an information input method. This information is sent from the terminal to the server. The server functions as an information management device, storing and managing the received data.

[0446] Subsequently, the server uses a selection device to access the database based on the user's attribute information and search for relevant public systems. The systems found through the search are then used by a guidance generation device to create information on how to use each system and the procedures involved, which are then presented to the user.

[0447] The generated information is transmitted to the terminal via an information display device and presented to the user on the user interface. To enhance user convenience, the information is organized in an easy-to-read format.

[0448] The system has an automatic update mechanism that periodically updates the database information within the information management device, ensuring that users are always provided with the latest system information. Furthermore, a generation AI model is used to optimize guidance information and create prompt messages.

[0449] For example, if a user enters "I want to start a new business" into the terminal, the server will search for "Subsidies for Entrepreneurship Support for Regional Revitalization" and "Programs to Support Young Entrepreneurs" and present the information appropriately. An example of a prompt message would be, "Please tell me about suitable public programs for starting a new business."

[0450] This system allows users to find the system best suited to their needs and proceed with the process efficiently.

[0451] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0452] Step 1:

[0453] The user enters their attribute information into the terminal's user interface. This input data includes age, address, occupation, income, and family structure. The terminal receives this input and organizes the data in an initial format. The entered data is then temporarily stored locally in preparation for transmission to the server.

[0454] Step 2:

[0455] The terminal sends attribute information entered by the user to the server. To maintain data integrity during transmission, a secure communication protocol (e.g., HTTPS) is used to ensure the data arrives at the server untampered. The input data is temporarily stored for processing on the server side.

[0456] Step 3:

[0457] The server accesses the database based on the received attribute information and performs a search. The database used here contains the latest information on public systems. The server uses SQL queries and other methods to extract matching systems based on user attributes and outputs them as a candidate list.

[0458] Step 4:

[0459] The server uses a guidance generation device to create detailed information on how to use the service, based on the extracted system information. The generated data includes a list of required documents, application procedures, and submission addresses. Furthermore, an AI generation model is used to optimize this guidance information into prompt messages.

[0460] Step 5:

[0461] The generated guidance information and prompt messages are transferred from the server to the terminal. The information is formatted and displayed on the terminal screen in a format that is easy for the user to understand (e.g., step-by-step instructions, checklist format). The terminal plays the role of providing the final information to the user.

[0462] Step 6:

[0463] Users review the guidance information displayed on their terminals and proceed with the necessary procedures. Furthermore, user feedback is collected through a response reception device to improve system quality. This feedback is then sent to the server as improvement suggestions and stored for future updates.

[0464] (Application Example 1)

[0465] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0466] There is a challenge in reducing the burden of complex procedures and information searches that users face when using administrative systems, and enabling them to obtain necessary system information in a simple way using voice recognition technology. In particular, there is a need to realize a system that supports users in comfortably obtaining system information at home.

[0467] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0468] In this invention, the server includes data input means for inputting attribute information from a user, data management means for holding the attribute information and accessing a data storage that stores information on each public system, information retrieval means for searching for the relevant public system based on the attribute information and generating a candidate list, and voice input means for automatically acquiring information from the user using voice recognition technology. As a result, the user can easily acquire necessary administrative system information and obtain appropriate procedural information through voice input.

[0469] A "user" is an individual or group that uses this system to input their attribute information and obtain administrative system information.

[0470] "Attribute information" refers to personal identifying information related to a user's age, address, occupation, income, and family structure.

[0471] "Data input means" refers to an interface for users to input their attribute information into the system, such as a keyboard or voice input device.

[0472] A "data management system" is a mechanism that holds user attribute information and has the function of accessing data storage related to public systems.

[0473] "Data storage" refers to databases and other information storage means used to store and update information related to various public institutions.

[0474] An "information retrieval tool" is a mechanism that has the function of searching for relevant public institutions and generating a list of candidates based on the user's attribute information.

[0475] A "guide generation mechanism" is a system that creates information on how to use each public system and the procedures involved from the generated candidate list.

[0476] An "information presentation means" is an interface that visually or audibly presents information created by a guidance generation means to the user.

[0477] "Voice input means" refers to technologies that acquire information using the user's voice, such as voice recognition software or microphone devices.

[0478] A "feedback collection mechanism" is a system for collecting feedback from users and using it to improve the system.

[0479] An "automatic update mechanism" is a process for regularly keeping public system information stored in a data repository up to date.

[0480] This invention is a system for users to efficiently obtain administrative system information using voice input, and is composed of multiple hardware and software components. The server receives attribute information transmitted from the user terminal and accesses a data storage based on it. This data storage contains the latest public system information, and the server searches this information to identify a system suitable for the user and generates a list of candidates.

[0481] As a means of voice input, the terminal is equipped with speech recognition technology, and uses the Google Cloud Speech-to-Text API and other tools to convert the user's voice into text data. The converted text is sent to the server as attribute information. The server processes the user information via a REST API written in Python and implements logic for searching public system information. In addition, there is an automatic update mechanism for public system information that is updated periodically, and the overall operation of the system is optimized using frameworks such as Flask and Django.

[0482] Through this system, users can input their information by voice and obtain information about the system. Information is presented visually through the user interface, and voice guidance is also available as needed. Especially when used in the home, the interface built into consumer robots is utilized to enable natural interaction with the user.

[0483] For example, if a user requests information about grants for studying abroad via voice inquiry, the system will search for relevant programs and guide them through a list of potential grants and application procedures. This flow reduces the burden of complex procedures for the user.

[0484] An example of a prompt message for the generating AI model is, "Based on the user's voice attribute information, search for the most suitable support system and generate guidance information for it."

[0485] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0486] Step 1:

[0487] The user inputs their attribute information into the device using the speech recognition function. The data entered as speech is converted into text data using the Google Cloud Speech-to-Text API by the device's voice input method, and then formatted as attribute information. This allows the system to obtain the user's basic information.

[0488] Step 2:

[0489] The terminal sends attribute information, converted into text data, to the server. The server receives this information and prepares to access public system information stored in the data storage using data management means. The received data is converted into a specific format as attribute information within the server. This prepares the user information necessary for the subsequent search process.

[0490] Step 3:

[0491] The server searches the data storage based on attribute information to find the relevant public institutions. The information retrieval tool uses a Python library to execute SQL queries and extract institution data that meets the criteria. The extracted results are formatted into an appropriate format and compiled into a candidate list. This candidate list serves as the basic information to be presented to the user.

[0492] Step 4:

[0493] Based on the generated candidate list, the server moves to the stage of detailing the usage methods and procedures for each public system through the guidance generation mechanism. Using a template engine, the information based on the candidate list is formatted for the user. Document and procedural information is supplemented here, completing the guidance information.

[0494] Step 5:

[0495] The completed guidance information is transmitted from the server to the terminal. The terminal visually displays the information on the user interface via an information display device. Voice guidance is also available as an option, utilizing speech synthesis technology to convert the generated text information into speech and present it. This allows users to ultimately obtain information on administrative systems that are relevant to them and use it to guide their subsequent actions.

[0496] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0497] This invention is a system incorporating an emotion engine to enable users to obtain appropriate administrative information according to their emotional state. The system comprises a user terminal, a server, a database, and an emotion engine.

[0498] The user enters their attribute information using a terminal, and this information is sent to the server. Based on the received information, the server accesses a database and searches for administrative systems that match the user's attributes. The resulting candidate systems are converted into detailed usage instructions and procedural information, and presented to the user.

[0499] In addition to this process, an emotion engine operates on the user's device. The emotion engine analyzes the user's emotions based on user input information and operation history, taking into account other data such as facial expressions and voice tone. The results of the emotion analysis are sent to the server, and the information and interface presented are dynamically adjusted according to the user's emotions. For example, if the user is feeling stressed, the interface tone can be made gentler, or information can be presented step by step to improve user convenience.

[0500] For example, if the emotion engine determines that a user has the emotion of "unstable income and looking for applicable welfare programs, but feeling anxious about the procedures," the server will respond accordingly by prioritizing the display of programs with relatively simple procedures or providing helpful guidance explaining the procedures. The system can also collect user feedback information and use it to improve the system. When feedback is received, special guidance and support information will be provided based on the user's emotion data to further enhance the user experience.

[0501] Furthermore, the database's automatic update function ensures it always operates based on the latest administrative system information. This allows users to obtain timely information that keeps pace with current trends. As a whole, the system enables it to provide users with a more personalized administrative system information service.

[0502] The following describes the processing flow.

[0503] Step 1:

[0504] The user enters attribute information such as age, address, occupation, income, and family structure through the terminal's interface. Once the input is complete, the terminal sends that information to the server.

[0505] Step 2:

[0506] The server queries the database based on attribute information received from the terminal to search for the relevant administrative system. During the search, it generates a list of the most suitable systems using conditions that match the user's attributes.

[0507] Step 3:

[0508] Based on the generated list of programs, the server creates information on the specific usage methods and procedures for each program. This information includes required documents, application procedures, deadlines, and more.

[0509] Step 4:

[0510] The emotion engine built into the device analyzes the user's emotional state using user input information, facial recognition, voice analysis, and operation history. It identifies the level of emotions the user is experiencing, such as anxiety or stress.

[0511] Step 5:

[0512] The emotion engine's analysis results are sent to the server, which then adjusts the style and content of the information presented to the user based on those results. For example, if the emotion is negative, the server might adjust the information by explaining it more carefully or providing detailed step-by-step instructions.

[0513] Step 6:

[0514] The server sends the adjusted information back to the terminal and presents it to the user in an easy-to-understand format. The display on the terminal includes changes in color and font that respond to emotions.

[0515] Step 7:

[0516] Users can review the presented information and provide feedback from their device if necessary. This feedback includes requests for additional information and suggestions for improving the user interface. This feedback information is also analyzed on the server and used to improve the system.

[0517] Step 8:

[0518] The server uses an automatic update function to keep the administrative system information in the database up to date. This ensures that users are always provided with the most current information.

[0519] (Example 2)

[0520] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0521] Users who wish to utilize administrative systems often find it difficult to find a system that suits their needs or to understand complex procedural information. Furthermore, conventional systems do not provide information tailored to the user's emotional state, sometimes resulting in an inefficient user experience. This invention aims to solve these problems.

[0522] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0523] In this invention, the server includes data input means for acquiring attribute information from a user; data management means for accessing information storage means that holds the attribute information and records information about each system; search means for searching for the appropriate system based on the attribute information and generating selection candidates; guidance generation means for generating usage methods and procedural information for each system from the selection candidates; information presentation means for presenting the information generated by the guidance generation means to the user; emotion analysis means for analyzing the user's emotional information; and information adjustment means for dynamically adjusting the presented information based on the results obtained by the emotion analysis means. This enables a more efficient and personalized user experience by searching for an appropriate administrative system based on the user's attribute information and providing information that corresponds to the user's emotional state.

[0524] "Data input means" refers to a means of obtaining attribute information from a user, and includes an interface that allows the user to easily input information.

[0525] A "data management system" is a means of holding attribute information received from users and providing functions for accessing recorded information.

[0526] An "information storage means" is a means equipped with the function of recording and managing information related to each system, and is capable of maintaining up-to-date information at all times.

[0527] A "search tool" is a means that has the function of searching for related systems and generating selection candidates based on acquired attribute information.

[0528] A "guidance generation method" is a means of generating information on how to use and the procedures for the selected candidate systems, and presenting it to users in an easy-to-understand manner.

[0529] An "information presentation means" is a means that plays a role in effectively presenting generated information to the user.

[0530] An "emotion analysis tool" is a means of analyzing a user's emotional information, and has the function of identifying the user's emotional state by analyzing facial expressions, voice tone, etc.

[0531] An "information adjustment tool" is a tool that has the function of dynamically adjusting the content and format of the information presented based on the results of sentiment analysis.

[0532] An "automatic update mechanism" is a means that has the function of periodically updating the information of each system in an information storage mechanism to the latest state.

[0533] A "feedback receiving method" is a means of receiving user responses after information has been presented and using them to improve the system.

[0534] This invention is a system for providing administrative information tailored to the user and improving the user experience. The system comprises a user terminal, a server, information storage means, and sentiment analysis means.

[0535] Users input attribute information via a terminal, including age and income status. The terminal transmits the entered information to a server via a data management system, which then accesses an information storage system based on that data. This information storage system holds the latest regulatory information, and appropriate regulatory information can be quickly retrieved using a search system.

[0536] An emotion analysis system operates on the user's terminal, analyzing input information, facial expressions, and voice tone in real time. The results of the emotion analysis are sent to a server, and an information adjustment system dynamically adjusts the information provided based on this analysis. For example, if the analysis indicates that the user is feeling anxious, the procedural information will be presented step by step in a clearer and more user-friendly format.

[0537] For example, if the emotion engine determines that a user has an unstable income and is looking for applicable welfare programs but is unsure about the procedures, the server will take this into consideration and prioritize displaying programs that are easy to apply for and appropriate. It will also provide helpful guidance and support to the user throughout the process.

[0538] By using a generative AI model, information based on the user's emotions and attributes is generated through prompt messages, resulting in a user experience optimized for individual situations. A concrete example of a prompt message is: "If the user's emotional state is determined to be 'stressed,' list simple administrative procedures and generate explanatory text in a gentle tone." This system enables users to utilize these systems efficiently and stress-free.

[0539] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0540] Step 1:

[0541] The user enters attribute information using a terminal. This input includes personal data such as age, region, and income status. The terminal collects this attribute information and sends it to the server using a secure protocol. The entered data becomes the basic data necessary for subsequent processing by the server.

[0542] Step 2:

[0543] The server stores attribute information received from the terminal in a data management system. Based on this data, the server accesses an information storage system and searches for relevant institutional information. In this process, the attribute information is compared with the database in the information storage system to identify institutional information with a high degree of relevance. The output is a list of candidate institutional systems that are suitable for the user.

[0544] Step 3:

[0545] The server generates detailed usage instructions and procedural information from the candidate schemes found through the search. This guidance generation mechanism extracts relevant documents and organizes information to create information in a user-friendly format. The output is detailed information explaining how to use the scheme and the procedures involved.

[0546] Step 4:

[0547] An emotion analysis system operates on the user's device, analyzing the user's facial expressions, voice tone, and input information. Based on this data, the device calculates the user's emotional state and sends the result to the server. The output of this processing step is data representing the user's emotional state.

[0548] Step 5:

[0549] The server dynamically adjusts the generated institutional information based on the output of the emotion analysis device. The information adjustment device changes the way information is presented and the content of it according to the user's emotions. For example, if the user is feeling stressed, the procedure steps are arranged in a gentler format. This output is customized institutional information that matches the user's current situation.

[0550] Step 6:

[0551] Users view the presented information and provide feedback to the server via their terminal regarding their understanding and use of that information. The server collects the input feedback information and stores it as material for system improvement. This feedback process contributes to improving the user experience and the system.

[0552] (Application Example 2)

[0553] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0554] When obtaining information about administrative systems using portable information terminals such as smartphones or robots, failing to consider the user's emotional state can lead to misunderstandings and hinder the smooth execution of procedures. Furthermore, users experiencing anxiety or stress require more flexible and considerate information presentation. However, current systems have limitations in providing information that considers user emotions, resulting in an inability to optimize the user experience.

[0555] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0556] In this invention, the server includes data input means for inputting user attribute information, emotion recognition means for analyzing the user's emotional state, and dynamic information adjustment means for dynamically adjusting information based on the emotional information analyzed by the emotion recognition means. This makes it possible to provide appropriate and flexible information according to the user's emotional state.

[0557] "Data input means" refers to a device or program for receiving attribute information from a user.

[0558] "Data management means" refers to a device or program that holds user attribute information and accesses a database to handle information related to administrative systems.

[0559] A "search tool" is a device or program that finds administrative systems relevant to a user based on attribute information and generates a list of candidates.

[0560] A "guide generation means" is a device or program for creating information on how to use and the procedures for each administrative system from a list of candidates.

[0561] "Information presentation means" refers to a device or program that displays or provides information created by the guidance generation means to the user.

[0562] "Emotion recognition means" refers to a device or program for analyzing a user's emotional state and acquiring that information.

[0563] A "dynamic information adjustment means" is a device or program that changes the information presented according to the situation based on emotional information analyzed by an emotion recognition means.

[0564] The system for realizing this invention includes a user terminal, a server, a database, and an emotion recognition engine. The user terminal takes the form of a smartphone or tablet and accepts user input. Specifically, it uses a camera and microphone to acquire facial expressions and voice tone. This data is analyzed by the emotion recognition engine to determine the user's emotional state.

[0565] The server receives attribute information and sentiment data sent by the user. The server has a built-in data management mechanism, which is responsible for accessing the database and retrieving information about administrative systems. It is possible to use cloud-based sentiment recognition algorithms such as Azure Cognitive Services. Furthermore, the server is equipped with a dynamic information adjustment mechanism, which adjusts how information is presented according to the user's emotional state.

[0566] If a user is experiencing particular stress, the system can change the tone of the interface and provide more detailed, step-by-step instructions. For example, if the system identifies that a user is experiencing an unstable income and is looking for applicable welfare programs but is anxious about the procedures, it will prioritize displaying programs with simpler procedures and provide helpful guidance.

[0567] This system can continuously improve its service by utilizing user feedback. An example of a prompt message submitted to the generation AI model would be, "Generate a reassuring guide when the user is feeling anxious."

[0568] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0569] Step 1:

[0570] Users input attribute information through their terminals. This input information is sent to the server as the user's personal data. This attribute information later serves as basic data for determining suitability for administrative systems.

[0571] Step 2:

[0572] The device uses its camera and microphone to capture the user's facial expressions and voice tone. This data is sent in real time to an emotion recognition engine, where the user's emotional state is analyzed. In this process, the data is converted into numerical indicators representing the user's emotions and sent to the server.

[0573] Step 3:

[0574] The server receives attribute information and sentiment data sent by the user. Using data management tools, it retrieves administrative system information from the database that matches the user's attributes. In this process, it generates database queries based on the attribute information and creates a list of candidate administrative systems.

[0575] Step 4:

[0576] A dynamic information adjustment mechanism within the server adjusts the acquired administrative system information based on analyzed sentiment data. Specifically, if the sentiment indicates stress or anxiety, the way the information is presented and the tone of the interface are changed to make it more approachable.

[0577] Step 5:

[0578] The server sends the processed information to the terminal, and the terminal presents the information to the user in an appropriate format. This information may be provided as text or audio guidance.

[0579] Step 6:

[0580] Users can provide feedback on the information presented. The device collects this feedback and sends it to the server. This information will later be used as data to improve the service.

[0581] Step 7:

[0582] The server performs data analysis based on collected feedback and sentiment data to tune and improve the overall information delivery process of the system. This enables more personalized administrative information services.

[0583] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0584] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0585] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0586] [Fourth Embodiment]

[0587] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0588] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0589] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0590] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0591] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0592] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0593] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0594] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0595] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0596] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0597] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0598] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0599] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0600] This invention is a system designed to allow users to easily access administrative systems, and it mainly consists of a user terminal, a server, and a database. Users input their personal information via the terminal. Input is usually done through a dedicated user interface, and the items include age, address, occupation, income, and family structure. The input information is transmitted from the terminal to the server.

[0601] To process the received information, the server first connects to a database to search for relevant administrative system information. The database contains the latest administrative system information and its associated conditions and requirements. The server identifies systems that match the user's attribute information and generates a list of those systems.

[0602] Next, the server generates information necessary for using each system and the procedures involved, based on the generated list of systems. This information generation includes, for example, required documents, application procedures, and submission destinations. The generated information is sent to the terminal in a user-friendly format and displayed on the user interface.

[0603] As a concrete example, a user living in a rural area and planning a new business can enter their information into the terminal, and the server will recommend programs such as the "Subsidy for Entrepreneurship Support for Regional Revitalization" and the "Young Entrepreneur Support Program." Then, they will be given detailed instructions on the necessary documents (e.g., business plan and identification) and the application process. This entire process allows users to quickly find the program best suited to them and reduces the burden of the application process.

[0604] Furthermore, this system features an automatic update function, regularly updating the system information in the database to always provide users with the latest information. This allows users to appropriately utilize support and subsidy programs that are relevant to the times. By utilizing the feedback function, the system can accept requests for additional information and suggestions for improvement from users, which will be used to improve the quality of the service.

[0605] The following describes the processing flow.

[0606] Step 1:

[0607] The user enters attribute information through the terminal's interface. Input fields include age, address, occupation, income, family structure, and interest categories. Once input is complete, the terminal sends this information to the server.

[0608] Step 2:

[0609] The server receives attribute information sent by the user. After receiving the information, the server accesses the database and generates a search query for administrative systems that match the user's criteria. This query is constructed to identify systems in the database that are most likely to match the user's attributes.

[0610] Step 3:

[0611] The server uses the generated search query to search the database. As a result of the search, a list of institutions containing the appropriate administrative institution information is extracted. The list includes a summary of each institution.

[0612] Step 4:

[0613] Based on the list of programs obtained as search results, the server generates detailed information on how to use each program and the procedures involved. This information includes specific details such as the documents required for application, procedures, and contact information.

[0614] Step 5:

[0615] The server sends the generated detailed information to the terminal. The terminal displays this information to the user in an easy-to-understand format through the user interface. For each system, the necessary procedures and preparations are visually shown.

[0616] Step 6:

[0617] Users review the information presented through their device and provide feedback as needed. This feedback can include requests for further information or suggestions for system improvements. Once feedback is entered on the device, it is sent to the server for processing.

[0618] Step 7:

[0619] The server performs a process that automatically updates the database information periodically. By collecting the latest administrative information and replacing the information in the database, it keeps users with the most up-to-date information.

[0620] (Example 1)

[0621] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0622] Individuals wishing to utilize public services often spend considerable time and effort finding and using the services that best suit their needs. Furthermore, insufficient updates to information regarding these services pose a risk of users making decisions based on outdated information. To address these challenges, there is a need for a system that provides appropriate and timely service guidance and consistently delivers the latest information.

[0623] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0624] In this invention, the server includes an information input means for inputting attribute information from a user, an information management device that holds the attribute information and stores information on each public system, and a selection device that searches for the relevant public system based on the attribute information and generates a candidate list. This allows users to quickly and easily find a public system that suits them and to obtain accurate usage methods and procedural information for that system in the latest format.

[0625] "Information input means" refers to a device or interface for a user to input their own attribute information.

[0626] An "information management device" is a device that holds user attribute information and stores and manages information for various public systems.

[0627] A "selection device" is a device that searches for relevant public institutions based on the user's attribute information and generates a list of candidates.

[0628] A "guide generation device" is a device that creates detailed information on how to use each public system and the procedures involved from the generated list of candidates.

[0629] An "information display device" is a device that presents generated guidance information to the user and displays it in a format that the user can easily understand.

[0630] A "response receiving device" is a device that collects user feedback based on the information presented and uses it to improve the system.

[0631] An "automatic update device" is a device that periodically updates information related to each public system within the information management system, keeping it always up-to-date.

[0632] A "generative AI model" is an artificial intelligence model that optimizes generated guidance information using prompt text and provides it in the most beneficial format for the user.

[0633] This invention is a system that streamlines the use of information in public institutions, and is mainly composed of servers, terminals, and databases.

[0634] Users input their personal information through the terminal's user interface. Specifically, they fill in information such as age, address, occupation, income, and family structure on a form used as an information input method. This information is sent from the terminal to the server. The server functions as an information management device, storing and managing the received data.

[0635] Subsequently, the server uses a selection device to access the database based on the user's attribute information and search for relevant public systems. The systems found through the search are then used by a guidance generation device to create information on how to use each system and the procedures involved, which are then presented to the user.

[0636] The generated information is transmitted to the terminal via an information display device and presented to the user on the user interface. To enhance user convenience, the information is organized in an easy-to-read format.

[0637] The system has an automatic update mechanism that periodically updates the database information within the information management device, ensuring that users are always provided with the latest system information. Furthermore, a generation AI model is used to optimize guidance information and create prompt messages.

[0638] For example, if a user enters "I want to start a new business" into the terminal, the server will search for "Subsidies for Entrepreneurship Support for Regional Revitalization" and "Programs to Support Young Entrepreneurs" and present the information appropriately. An example of a prompt message would be, "Please tell me about suitable public programs for starting a new business."

[0639] This system allows users to find the system best suited to their needs and proceed with the process efficiently.

[0640] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0641] Step 1:

[0642] The user enters their attribute information into the terminal's user interface. This input data includes age, address, occupation, income, and family structure. The terminal receives this input and organizes the data in an initial format. The entered data is then temporarily stored locally in preparation for transmission to the server.

[0643] Step 2:

[0644] The terminal sends attribute information entered by the user to the server. To maintain data integrity during transmission, a secure communication protocol (e.g., HTTPS) is used to ensure the data arrives at the server untampered. The input data is temporarily stored for processing on the server side.

[0645] Step 3:

[0646] The server accesses the database based on the received attribute information and performs a search. The database used here contains the latest information on public systems. The server uses SQL queries and other methods to extract matching systems based on user attributes and outputs them as a candidate list.

[0647] Step 4:

[0648] The server uses a guidance generation device to create detailed information on how to use the service, based on the extracted system information. The generated data includes a list of required documents, application procedures, and submission addresses. Furthermore, an AI generation model is used to optimize this guidance information into prompt messages.

[0649] Step 5:

[0650] The generated guidance information and prompt messages are transferred from the server to the terminal. The information is formatted and displayed on the terminal screen in a format that is easy for the user to understand (e.g., step-by-step instructions, checklist format). The terminal plays the role of providing the final information to the user.

[0651] Step 6:

[0652] Users review the guidance information displayed on their terminals and proceed with the necessary procedures. Furthermore, user feedback is collected through a response reception device to improve system quality. This feedback is then sent to the server as improvement suggestions and stored for future updates.

[0653] (Application Example 1)

[0654] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0655] There is a challenge in reducing the burden of complex procedures and information searches that users face when using administrative systems, and enabling them to obtain necessary system information in a simple way using voice recognition technology. In particular, there is a need to realize a system that supports users in comfortably obtaining system information at home.

[0656] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0657] In this invention, the server includes data input means for inputting attribute information from a user, data management means for holding the attribute information and accessing a data storage that stores information on each public system, information retrieval means for searching for the relevant public system based on the attribute information and generating a candidate list, and voice input means for automatically acquiring information from the user using voice recognition technology. As a result, the user can easily acquire necessary administrative system information and obtain appropriate procedural information through voice input.

[0658] A "user" is an individual or group that uses this system to input their attribute information and obtain administrative system information.

[0659] "Attribute information" refers to personal identifying information related to a user's age, address, occupation, income, and family structure.

[0660] "Data input means" refers to an interface for users to input their attribute information into the system, such as a keyboard or voice input device.

[0661] A "data management system" is a mechanism that holds user attribute information and has the function of accessing data storage related to public systems.

[0662] "Data storage" refers to databases and other information storage means used to store and update information related to various public institutions.

[0663] An "information retrieval tool" is a mechanism that has the function of searching for relevant public institutions and generating a list of candidates based on the user's attribute information.

[0664] A "guide generation mechanism" is a system that creates information on how to use each public system and the procedures involved from the generated candidate list.

[0665] An "information presentation means" is an interface that visually or audibly presents information created by a guidance generation means to the user.

[0666] "Voice input means" refers to technologies that acquire information using the user's voice, such as voice recognition software or microphone devices.

[0667] A "feedback collection mechanism" is a system for collecting feedback from users and using it to improve the system.

[0668] An "automatic update mechanism" is a process for regularly keeping public system information stored in a data repository up to date.

[0669] This invention is a system for users to efficiently obtain administrative system information using voice input, and is composed of multiple hardware and software components. The server receives attribute information transmitted from the user terminal and accesses a data storage based on it. This data storage contains the latest public system information, and the server searches this information to identify a system suitable for the user and generates a list of candidates.

[0670] As a means of voice input, the terminal is equipped with speech recognition technology, and uses the Google Cloud Speech-to-Text API and other tools to convert the user's voice into text data. The converted text is sent to the server as attribute information. The server processes the user information via a REST API written in Python and implements logic for searching public system information. In addition, there is an automatic update mechanism for public system information that is updated periodically, and the overall operation of the system is optimized using frameworks such as Flask and Django.

[0671] Through this system, users can input their information by voice and obtain information about the system. Information is presented visually through the user interface, and voice guidance is also available as needed. Especially when used in the home, the interface built into consumer robots is utilized to enable natural interaction with the user.

[0672] For example, if a user requests information about grants for studying abroad via voice inquiry, the system will search for relevant programs and guide them through a list of potential grants and application procedures. This flow reduces the burden of complex procedures for the user.

[0673] An example of a prompt message for the generating AI model is, "Based on the user's voice attribute information, search for the most suitable support system and generate guidance information for it."

[0674] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0675] Step 1:

[0676] The user inputs their attribute information into the device using the speech recognition function. The data entered as speech is converted into text data using the Google Cloud Speech-to-Text API by the device's voice input method, and then formatted as attribute information. This allows the system to obtain the user's basic information.

[0677] Step 2:

[0678] The terminal sends attribute information, converted into text data, to the server. The server receives this information and prepares to access public system information stored in the data storage using data management means. The received data is converted into a specific format as attribute information within the server. This prepares the user information necessary for the subsequent search process.

[0679] Step 3:

[0680] The server searches the data storage based on attribute information to find the relevant public institutions. The information retrieval tool uses a Python library to execute SQL queries and extract institution data that meets the criteria. The extracted results are formatted into an appropriate format and compiled into a candidate list. This candidate list serves as the basic information to be presented to the user.

[0681] Step 4:

[0682] Based on the generated candidate list, the server moves to the stage of detailing the usage methods and procedures for each public system through the guidance generation mechanism. Using a template engine, the information based on the candidate list is formatted for the user. Document and procedural information is supplemented here, completing the guidance information.

[0683] Step 5:

[0684] The completed guidance information is transmitted from the server to the terminal. The terminal visually displays the information on the user interface via an information display device. Voice guidance is also available as an option, utilizing speech synthesis technology to convert the generated text information into speech and present it. This allows users to ultimately obtain information on administrative systems that are relevant to them and use it to guide their subsequent actions.

[0685] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0686] This invention is a system incorporating an emotion engine to enable users to obtain appropriate administrative information according to their emotional state. The system comprises a user terminal, a server, a database, and an emotion engine.

[0687] The user enters their attribute information using a terminal, and this information is sent to the server. Based on the received information, the server accesses a database and searches for administrative systems that match the user's attributes. The resulting candidate systems are converted into detailed usage instructions and procedural information, and presented to the user.

[0688] In addition to this process, an emotion engine operates on the user's device. The emotion engine analyzes the user's emotions based on user input information and operation history, taking into account other data such as facial expressions and voice tone. The results of the emotion analysis are sent to the server, and the information and interface presented are dynamically adjusted according to the user's emotions. For example, if the user is feeling stressed, the interface tone can be made gentler, or information can be presented step by step to improve user convenience.

[0689] For example, if the emotion engine determines that a user has the emotion of "unstable income and looking for applicable welfare programs, but feeling anxious about the procedures," the server will respond accordingly by prioritizing the display of programs with relatively simple procedures or providing helpful guidance explaining the procedures. The system can also collect user feedback information and use it to improve the system. When feedback is received, special guidance and support information will be provided based on the user's emotion data to further enhance the user experience.

[0690] Furthermore, the database's automatic update function ensures it always operates based on the latest administrative system information. This allows users to obtain timely information that keeps pace with current trends. As a whole, the system enables it to provide users with a more personalized administrative system information service.

[0691] The following describes the processing flow.

[0692] Step 1:

[0693] The user enters attribute information such as age, address, occupation, income, and family structure through the terminal's interface. Once the input is complete, the terminal sends that information to the server.

[0694] Step 2:

[0695] The server queries the database based on attribute information received from the terminal to search for the relevant administrative system. During the search, it generates a list of the most suitable systems using conditions that match the user's attributes.

[0696] Step 3:

[0697] Based on the generated list of programs, the server creates information on the specific usage methods and procedures for each program. This information includes required documents, application procedures, deadlines, and more.

[0698] Step 4:

[0699] The emotion engine built into the device analyzes the user's emotional state using user input information, facial recognition, voice analysis, and operation history. It identifies the level of emotions the user is experiencing, such as anxiety or stress.

[0700] Step 5:

[0701] The emotion engine's analysis results are sent to the server, which then adjusts the style and content of the information presented to the user based on those results. For example, if the emotion is negative, the server might adjust the information by explaining it more carefully or providing detailed step-by-step instructions.

[0702] Step 6:

[0703] The server sends the adjusted information back to the terminal and presents it to the user in an easy-to-understand format. The display on the terminal includes changes in color and font that respond to emotions.

[0704] Step 7:

[0705] Users can review the presented information and provide feedback from their device if necessary. This feedback includes requests for additional information and suggestions for improving the user interface. This feedback information is also analyzed on the server and used to improve the system.

[0706] Step 8:

[0707] The server uses an automatic update function to keep the administrative system information in the database up to date. This ensures that users are always provided with the most current information.

[0708] (Example 2)

[0709] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0710] Users who wish to utilize administrative systems often find it difficult to find a system that suits their needs or to understand complex procedural information. Furthermore, conventional systems do not provide information tailored to the user's emotional state, sometimes resulting in an inefficient user experience. This invention aims to solve these problems.

[0711] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0712] In this invention, the server includes data input means for acquiring attribute information from a user; data management means for accessing information storage means that holds the attribute information and records information about each system; search means for searching for the appropriate system based on the attribute information and generating selection candidates; guidance generation means for generating usage methods and procedural information for each system from the selection candidates; information presentation means for presenting the information generated by the guidance generation means to the user; emotion analysis means for analyzing the user's emotional information; and information adjustment means for dynamically adjusting the presented information based on the results obtained by the emotion analysis means. This enables a more efficient and personalized user experience by searching for an appropriate administrative system based on the user's attribute information and providing information that corresponds to the user's emotional state.

[0713] "Data input means" refers to a means of obtaining attribute information from a user, and includes an interface that allows the user to easily input information.

[0714] A "data management system" is a means of holding attribute information received from users and providing functions for accessing recorded information.

[0715] An "information storage means" is a means equipped with the function of recording and managing information related to each system, and is capable of maintaining up-to-date information at all times.

[0716] A "search tool" is a means that has the function of searching for related systems and generating selection candidates based on acquired attribute information.

[0717] A "guidance generation method" is a means of generating information on how to use and the procedures for the selected candidate systems, and presenting it to users in an easy-to-understand manner.

[0718] An "information presentation means" is a means that plays a role in effectively presenting generated information to the user.

[0719] An "emotion analysis tool" is a means of analyzing a user's emotional information, and has the function of identifying the user's emotional state by analyzing facial expressions, voice tone, etc.

[0720] An "information adjustment tool" is a tool that has the function of dynamically adjusting the content and format of the information presented based on the results of sentiment analysis.

[0721] An "automatic update mechanism" is a means that has the function of periodically updating the information of each system in an information storage mechanism to the latest state.

[0722] A "feedback receiving method" is a means of receiving user responses after information has been presented and using them to improve the system.

[0723] This invention is a system for providing administrative information tailored to the user and improving the user experience. The system comprises a user terminal, a server, information storage means, and sentiment analysis means.

[0724] Users input attribute information via a terminal, including age and income status. The terminal transmits the entered information to a server via a data management system, which then accesses an information storage system based on that data. This information storage system holds the latest regulatory information, and appropriate regulatory information can be quickly retrieved using a search system.

[0725] An emotion analysis system operates on the user's terminal, analyzing input information, facial expressions, and voice tone in real time. The results of the emotion analysis are sent to a server, and an information adjustment system dynamically adjusts the information provided based on this analysis. For example, if the analysis indicates that the user is feeling anxious, the procedural information will be presented step by step in a clearer and more user-friendly format.

[0726] For example, if the emotion engine determines that a user has an unstable income and is looking for applicable welfare programs but is unsure about the procedures, the server will take this into consideration and prioritize displaying programs that are easy to apply for and appropriate. It will also provide helpful guidance and support to the user throughout the process.

[0727] By using a generative AI model, information based on the user's emotions and attributes is generated through prompt messages, resulting in a user experience optimized for individual situations. A concrete example of a prompt message is: "If the user's emotional state is determined to be 'stressed,' list simple administrative procedures and generate explanatory text in a gentle tone." This system enables users to utilize these systems efficiently and stress-free.

[0728] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0729] Step 1:

[0730] The user enters attribute information using a terminal. This input includes personal data such as age, region, and income status. The terminal collects this attribute information and sends it to the server using a secure protocol. The entered data becomes the basic data necessary for subsequent processing by the server.

[0731] Step 2:

[0732] The server stores attribute information received from the terminal in a data management system. Based on this data, the server accesses an information storage system and searches for relevant institutional information. In this process, the attribute information is compared with the database in the information storage system to identify institutional information with a high degree of relevance. The output is a list of candidate institutional systems that are suitable for the user.

[0733] Step 3:

[0734] The server generates detailed usage instructions and procedural information from the candidate schemes found through the search. This guidance generation mechanism extracts relevant documents and organizes information to create information in a user-friendly format. The output is detailed information explaining how to use the scheme and the procedures involved.

[0735] Step 4:

[0736] An emotion analysis system operates on the user's device, analyzing the user's facial expressions, voice tone, and input information. Based on this data, the device calculates the user's emotional state and sends the result to the server. The output of this processing step is data representing the user's emotional state.

[0737] Step 5:

[0738] The server dynamically adjusts the generated institutional information based on the output of the emotion analysis device. The information adjustment device changes the way information is presented and the content of it according to the user's emotions. For example, if the user is feeling stressed, the procedure steps are arranged in a gentler format. This output is customized institutional information that matches the user's current situation.

[0739] Step 6:

[0740] Users view the presented information and provide feedback to the server via their terminal regarding their understanding and use of that information. The server collects the input feedback information and stores it as material for system improvement. This feedback process contributes to improving the user experience and the system.

[0741] (Application Example 2)

[0742] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0743] When obtaining information about administrative systems using portable information terminals such as smartphones or robots, failing to consider the user's emotional state can lead to misunderstandings and hinder the smooth execution of procedures. Furthermore, users experiencing anxiety or stress require more flexible and considerate information presentation. However, current systems have limitations in providing information that considers user emotions, resulting in an inability to optimize the user experience.

[0744] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0745] In this invention, the server includes data input means for inputting user attribute information, emotion recognition means for analyzing the user's emotional state, and dynamic information adjustment means for dynamically adjusting information based on the emotional information analyzed by the emotion recognition means. This makes it possible to provide appropriate and flexible information according to the user's emotional state.

[0746] "Data input means" refers to a device or program for receiving attribute information from a user.

[0747] "Data management means" refers to a device or program that holds user attribute information and accesses a database to handle information related to administrative systems.

[0748] A "search tool" is a device or program that finds administrative systems relevant to a user based on attribute information and generates a list of candidates.

[0749] A "guide generation means" is a device or program for creating information on how to use and the procedures for each administrative system from a list of candidates.

[0750] "Information presentation means" refers to a device or program that displays or provides information created by the guidance generation means to the user.

[0751] "Emotion recognition means" refers to a device or program for analyzing a user's emotional state and acquiring that information.

[0752] A "dynamic information adjustment means" is a device or program that changes the information presented according to the situation based on emotional information analyzed by an emotion recognition means.

[0753] The system for realizing this invention includes a user terminal, a server, a database, and an emotion recognition engine. The user terminal takes the form of a smartphone or tablet and accepts user input. Specifically, it uses a camera and microphone to acquire facial expressions and voice tone. This data is analyzed by the emotion recognition engine to determine the user's emotional state.

[0754] The server receives attribute information and sentiment data sent by the user. The server has a built-in data management mechanism, which is responsible for accessing the database and retrieving information about administrative systems. It is possible to use cloud-based sentiment recognition algorithms such as Azure Cognitive Services. Furthermore, the server is equipped with a dynamic information adjustment mechanism, which adjusts how information is presented according to the user's emotional state.

[0755] If a user is experiencing particular stress, the system can change the tone of the interface and provide more detailed, step-by-step instructions. For example, if the system identifies that a user is experiencing an unstable income and is looking for applicable welfare programs but is anxious about the procedures, it will prioritize displaying programs with simpler procedures and provide helpful guidance.

[0756] This system can continuously improve its service by utilizing user feedback. An example of a prompt message submitted to the generation AI model would be, "Generate a reassuring guide when the user is feeling anxious."

[0757] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0758] Step 1:

[0759] Users input attribute information through their terminals. This input information is sent to the server as the user's personal data. This attribute information later serves as basic data for determining suitability for administrative systems.

[0760] Step 2:

[0761] The device uses its camera and microphone to capture the user's facial expressions and voice tone. This data is sent in real time to an emotion recognition engine, where the user's emotional state is analyzed. In this process, the data is converted into numerical indicators representing the user's emotions and sent to the server.

[0762] Step 3:

[0763] The server receives attribute information and sentiment data sent by the user. Using data management tools, it retrieves administrative system information from the database that matches the user's attributes. In this process, it generates database queries based on the attribute information and creates a list of candidate administrative systems.

[0764] Step 4:

[0765] A dynamic information adjustment mechanism within the server adjusts the acquired administrative system information based on analyzed sentiment data. Specifically, if the sentiment indicates stress or anxiety, the way the information is presented and the tone of the interface are changed to make it more approachable.

[0766] Step 5:

[0767] The server sends the processed information to the terminal, and the terminal presents the information to the user in an appropriate format. This information may be provided as text or audio guidance.

[0768] Step 6:

[0769] Users can provide feedback on the information presented. The device collects this feedback and sends it to the server. This information will later be used as data to improve the service.

[0770] Step 7:

[0771] The server performs data analysis based on collected feedback and sentiment data to tune and improve the overall information delivery process of the system. This enables more personalized administrative information services.

[0772] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0773] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0774] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0775] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0776] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0777] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0778] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0779] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0780] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0781] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0782] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0783] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0784] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0785] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0786] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0787] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0788] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0789] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0790] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0791] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0792] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0793] The following is further disclosed regarding the embodiments described above.

[0794] (Claim 1)

[0795] A data input means for inputting attribute information from the user,

[0796] A data management means that holds the aforementioned attribute information and accesses a database that stores information on each administrative system,

[0797] A search means that searches for the relevant administrative system based on the attribute information and generates a list of candidates,

[0798] A guidance generation means that generates information on how to use and the procedures for each administrative system from the aforementioned candidate list,

[0799] Information presentation means for presenting information generated by the guidance generation means to the user,

[0800] A system that includes this.

[0801] (Claim 2)

[0802] The system according to claim 1, further comprising a feedback receiving means for receiving feedback from a user based on the information presented by the information presentation means.

[0803] (Claim 3)

[0804] The system according to claim 1, further comprising an automatic update means that periodically updates the database in order to maintain the latest information on each administrative system.

[0805] "Example 1"

[0806] (Claim 1)

[0807] An information input means for users to input attribute information,

[0808] An information management device that holds the aforementioned attribute information and stores information on each public system,

[0809] A selection device that searches for relevant public institutions based on the attribute information and generates a list of candidates,

[0810] A guidance generation device that generates information on how to use and the procedures for each public system from the aforementioned candidate list,

[0811] An information presentation device that presents information generated by the aforementioned guidance generation device to the user,

[0812] A response receiving device for collecting user feedback based on the information presented above,

[0813] The aforementioned information management device includes an automatic update device that is updated periodically to ensure the latest information on each public system,

[0814] A system that includes this.

[0815] (Claim 2)

[0816] The system according to claim 1, further comprising an analysis device for analyzing feedback collected by the response receiving device and for improving the quality of service.

[0817] (Claim 3)

[0818] The system according to claim 1, further comprising means for optimizing the generated guidance information using prompt sentences by a generating AI model.

[0819] "Application Example 1"

[0820] (Claim 1)

[0821] A data input means for inputting attribute information from the user,

[0822] A data management means that holds the aforementioned attribute information and accesses a data storage that stores information on each public system,

[0823] An information retrieval means that searches for relevant public institutions based on the aforementioned attribute information and generates a list of candidates,

[0824] A guidance generation means that generates information on how to use and the procedures for each public system from the aforementioned candidate list,

[0825] Information presentation means for presenting information generated by the guidance generation means to the user,

[0826] A voice input method that automatically acquires information from the user using speech recognition technology,

[0827] A system that includes this.

[0828] (Claim 2)

[0829] The system according to claim 1, further comprising a feedback receiving means for receiving feedback from a user based on the information presented by the information presentation means.

[0830] (Claim 3)

[0831] The system according to claim 1, wherein the data storage further comprises an automatic update means that is updated periodically to maintain up-to-date information on each public system.

[0832] "Example 2 of combining an emotion engine"

[0833] (Claim 1)

[0834] A data input method for obtaining attribute information from the user,

[0835] A data management means that has access to an information storage means that holds the aforementioned attribute information and records information about each system,

[0836] A search means that searches for the relevant system based on the attribute information and generates selection candidates,

[0837] A guidance generation means that generates information on how to use each system and the procedures involved from the aforementioned selection candidates,

[0838] Information presentation means for presenting information generated by the guidance generation means to the user,

[0839] A means of sentiment analysis for analyzing user sentiment information,

[0840] Based on the results obtained by the emotion analysis means, an information adjustment means dynamically adjusts the presented information,

[0841] A system that includes this.

[0842] (Claim 2)

[0843] The system according to claim 1, further comprising a feedback receiving means for receiving responses from a user based on the information presented by the information presentation means.

[0844] (Claim 3)

[0845] The system according to claim 1, wherein the information storage means further comprises an automatic update means that is periodically updated in order to maintain the latest information regarding each system.

[0846] "Application example 2 when combining with an emotional engine"

[0847] (Claim 1)

[0848] A data input means for inputting attribute information from the user,

[0849] A data management means that holds the aforementioned attribute information and accesses a database that stores information on each administrative system,

[0850] A search means that searches for the relevant administrative system based on the attribute information and generates a list of candidates,

[0851] A guidance generation means that generates information on how to use and the procedures for each administrative system from the aforementioned candidate list,

[0852] Information presentation means for presenting information generated by the guidance generation means to the user,

[0853] A means of recognizing emotions for analyzing the emotional state of a user,

[0854] A dynamic information adjustment means that dynamically adjusts information based on the emotional information analyzed by the aforementioned emotion recognition means,

[0855] A system that includes this.

[0856] (Claim 2)

[0857] The system according to claim 1, further comprising a feedback receiving means for receiving feedback from a user based on the information presented by the information presentation means.

[0858] (Claim 3)

[0859] The system according to claim 1, further comprising an automatic update means that periodically updates the database in order to maintain the latest information on each administrative system. [Explanation of symbols]

[0860] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A data input means for inputting attribute information from the user, A data management means that holds the aforementioned attribute information and accesses a database that stores information on each administrative system, A search means that searches for the relevant administrative system based on the attribute information and generates a list of candidates, A guidance generation means that generates information on how to use and the procedures for each administrative system from the aforementioned candidate list, Information presentation means for presenting information generated by the guidance generation means to the user, A system that includes this.

2. The system according to claim 1, further comprising a feedback receiving means for receiving feedback from a user based on the information presented by the information presentation means.

3. The system according to claim 1, further comprising an automatic update means that periodically updates the database in order to maintain the latest information on each administrative system.

Images