System

Abstract

A system is provided.SOLUTION: A system comprising: means for inputting information necessary for a user to perform administrative procedures; means for a generating AI to list the necessary procedures based on the inputted information; means for the generating AI to organize the listed procedures and provide detailed descriptions; and means for tracking the user's progress and reminding of incomplete procedures.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Describe the "problem that the invention aims to solve" and the "means for solving the problem."

[0005] When carrying out administrative procedures, many citizens and businesses often do not fully understand what they need to do. As a result, procedures are often incomplete, or they have to visit multiple offices, wasting time and effort. Furthermore, because it is difficult to access the latest laws and procedural information, procedures are often carried out based on outdated information, which can lead to unnecessary trouble. There is a need for a system that can solve these problems and simplify and speed up administrative procedures. [Means for solving the problem]

[0006] In order to solve the above problems, the present invention provides the following means.

[0007] The system includes a means for users to input the information necessary to carry out administrative procedures, a means for a generating AI to list the necessary procedures based on the input information, a means for organizing the procedures listed by the generating AI and providing detailed explanations, and a means for tracking the user's progress and reminding them of incomplete procedures.Furthermore, the system includes a means for the generating AI to obtain the latest administrative procedure information in real time, and a means for managing multiple administrative procedures together and making applications in a unified manner, thereby enabling users to carry out administrative procedures efficiently.

[0008] "Users" refer to citizens and businesses who carry out administrative procedures.

[0009] "Administrative procedures" refers to various procedures carried out by government offices and agencies.

[0010] "Means for inputting information" refers to an interface that allows a user to input required information into the system.

[0011] "Generative AI" refers to artificial intelligence that automatically lists the necessary procedures based on input information.

[0012] "Means for listing" refers to the function of the generating AI to compile a list of the necessary procedures.

[0013] "Means for providing detailed explanations" refers to the function of providing the user with a list of procedures in an easy-to-understand format.

[0014] "Means for tracking progress" refers to the ability to track and record the progress of procedures performed by a user.

[0015] "Means of reminding" refers to a function that notifies the user of incomplete procedures.

[0016] "Latest administrative procedure information" refers to information on the most current laws, regulations and procedures.

[0017] "Means of centralized management" refers to the function of managing multiple administrative procedures together within a single system.

[0018] "A means of making applications in a centralized manner" refers to a function that allows multiple procedures to be performed at once. [Brief explanation of the drawings]

[0019] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0020] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0021] First, the terms used in the following description will be explained.

[0022] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0023] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0024] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0025] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0026] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0027] [First embodiment]

[0028] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0029] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0030] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0031] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0032] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0033] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0034] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0035] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0036] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0037] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0038] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0039] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0040] This invention is a system that enables users to efficiently complete administrative procedures. The user inputs the information necessary to complete the administrative procedure, and a generation AI lists the necessary procedures based on the input information and provides them to the user. The system also includes a function to track the user's progress and remind them of any incomplete procedures.

[0041] Overall system overview

[0042] User Input

[0043] First, the user accesses the terminal and logs in to the system with their account. After logging in, the user selects an option such as "moving" or "starting a new business" and enters the necessary information (e.g., old and new addresses, industry, business size, location, etc.).

[0044] Server Processing

[0045] The server stores the information entered by the user in a database. Then, the server launches a generation AI to create a list of necessary procedures based on the entered information.

[0046] Acquiring and organizing procedural information

[0047] Based on the input information, the AI ​​generates a list of the latest administrative procedures. For example, in the case of moving, this includes procedures for moving out and in, mail forwarding, and utility bill transfer. In the case of starting a new business, this includes business registration, incorporation notification, business start-up notification to the tax office, and obtaining a business license. The server organizes the information from the AI ​​and provides it to the user in an easy-to-understand format.

[0048] Providing information to users

[0049] The organized procedure information and procedure list are sent to the terminal and displayed to the user, who can check the list and understand the detailed explanation of each procedure and the necessary documents.

[0050] Progress management and follow-up

[0051] Each time a user performs a procedure and completes it, they can enter a completion report into the system. The server tracks this information and manages the progress of the procedure. If there are any incomplete procedures, the server sends reminders to the user.

[0052] Specific examples

[0053] Specific examples of moving procedures

[0054] 1. The user logs in to the device and selects "Move"

[0055] The terminal prompts the user to enter their old and new addresses.

[0056] The user enters a new address (e.g., Shinjuku-ku, Tokyo) and an old address (e.g., Kita-ku, Osaka).

[0057] 2. The server uses a generative AI to list the procedures

[0058] The generation AI obtains the necessary procedures, such as moving-in and moving-out procedures for resident registration, mail forwarding procedures, and utility bill transfer procedures, and sends them to the server.

[0059] 3. The server organizes the procedure information and provides it to the user.

[0060] The server organizes the procedure information and sends it to the terminal.

[0061] The terminal displays the procedure list and detailed instructions to the user.

[0062] 4. The user performs the procedure and reports progress

[0063] The user executes each procedure in sequence and inputs a completion report into the system each time it is completed.

[0064] The server tracks your progress and reminds you of any outstanding steps.

[0065] Specific examples of procedures for starting a new business

[0066] 1. The user logs in to the device and selects "Start a new business."

[0067] The terminal asks the user to enter the industry, business size, and location.

[0068] The user enters the industry (e.g., food and beverage), business size (e.g., small scale), and location (e.g., Shinjuku-ku, Tokyo).

[0069] 2. The server uses a generative AI to list the procedures

[0070] The generation AI obtains the necessary procedures, such as business registration, incorporation notification, business start-up notification to the tax office, and obtaining a business license, and sends them to the server.

[0071] 3. The server organizes the procedure information and provides it to the user.

[0072] The server organizes the procedure information and sends it to the terminal.

[0073] The terminal displays the procedure list and detailed instructions to the user.

[0074] 4. The user performs the procedure and reports progress

[0075] The user executes each procedure in sequence and inputs a completion report into the system each time it is completed.

[0076] The server tracks your progress and reminds you of any outstanding steps.

[0077] In this way, this system supports users in efficiently completing the necessary administrative procedures. By utilizing generative AI to obtain the latest administrative procedure information in real time, the system always provides the latest information, allowing users to smoothly complete procedures.

[0078] The processing flow will be explained below.

[0079] When carrying out moving procedures

[0080] Step 1:

[0081] The user accesses the terminal and logs in to the system. After logging in, the user selects the "move" item from the menu and enters the new address and old address.

[0082] Step 2:

[0083] The server receives the user's input information (old and new addresses) and saves this information in a database. Once saved, the server starts the generation AI.

[0084] Step 3:

[0085] The server sends a request to the generation AI to list the necessary procedures based on the new and old address information entered by the user.

[0086] Step 4:

[0087] Based on the specified information, the generation AI creates a list of necessary procedures (e.g., moving-in / moving-out procedures for resident registration, mail forwarding procedures, utility bill transfer procedures, etc.) in real time. The listed information is then sent back to the server.

[0088] Step 5:

[0089] The server organizes the procedure list returned by the generation AI, including detailed instructions for each procedure, required documents, and procedure locations.

[0090] Step 6:

[0091] The server sends the organized procedure list to the terminal, which displays the procedure list and detailed instructions to the user.

[0092] Step 7:

[0093] The user checks the displayed list of procedures and executes each procedure in order. Each time a procedure is completed, the user inputs information to report the completion of the procedure into the system.

[0094] Step 8:

[0095] The server receives the completion report from the user and records the progress of the procedure in a database. If there are any incomplete procedures, the server sends a reminder to the user.

[0096] When starting a new business

[0097] Step 1:

[0098] The user accesses the terminal and logs in to the system. After logging in, the user selects the "Start a new business" item from the menu and enters the industry, business size, and location.

[0099] Step 2:

[0100] The server receives the user's input information (industry, business size, location) and stores this information in a database. Once the information is saved, the server launches the generation AI.

[0101] Step 3:

[0102] The server sends a request to the generation AI to list the necessary procedures based on the industry, business size, and location information entered by the user.

[0103] Step 4:

[0104] Based on the specified information, the generation AI creates a list of necessary procedures (e.g., business registration, incorporation notification, business start-up notification to the tax office, obtaining a business license, etc.) in real time. The listed information is then sent back to the server.

[0105] Step 5:

[0106] The server organizes the procedure list returned by the generation AI, including detailed instructions for each procedure, required documents, and procedure locations.

[0107] Step 6:

[0108] The server sends the organized procedure list to the terminal, which displays the procedure list and detailed instructions to the user.

[0109] Step 7:

[0110] The user checks the displayed list of procedures and executes each procedure in order. Each time a procedure is completed, the user inputs information to report the completion of the procedure into the system.

[0111] Step 8:

[0112] The server receives the completion report from the user and records the progress of the procedure in a database. If there are any incomplete procedures, the server sends a reminder to the user.

[0113] The above is the specific processing flow of the program when carrying out procedures for moving and starting a new business. This system allows users to complete administrative procedures efficiently.

[0114] Example 1

[0115] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0116] Current administrative procedures are complex, and it takes time and effort for users to find the necessary procedures and carry them out sequentially. Furthermore, when there are multiple procedures, it is difficult to track the progress of each. Furthermore, because procedure information is frequently updated, it is difficult to obtain the latest information in real time.

[0117] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0118] In this invention, the server includes means for a user to select a specific administrative procedure and input the necessary information, means for storing the input information in a database and sending prompts to a generative AI model to list the necessary procedures, means for analyzing the procedures listed by the generative AI model and providing detailed explanations, and means for tracking the user's progress and reminding the user of incomplete procedures, allowing the user to efficiently complete the necessary administrative procedures and obtain the latest procedural information in real time.

[0119] A "user" is an individual or legal entity that accesses the system, selects a particular administrative procedure, and enters the required information.

[0120] A "terminal" is an electronic device used by a user to enter information into and view information in a system. Examples include personal computers and smartphones.

[0121] The "server" is a networked computer system that receives information submitted by users, uses a generative AI model to list the necessary steps, and tracks progress.

[0122] A "generative AI model" is software equipped with artificial intelligence technology that lists the necessary administrative procedures based on user input information and obtains the latest information in real time.

[0123] A "prompt" is textual contextual information used to input specific conditions or instructions to a generative AI model.

[0124] A "database" is a digital data storage system used to store and later reference information entered by a user.

[0125] "Remind" is a function that notifies the user of incomplete procedures and calls for attention to complete the procedures.

[0126] A "procedure list" is a list of specific administrative procedures that a user must carry out, as listed by a generative AI model.

[0127] "Progress" is information that indicates the status of the user's administrative procedures, including which procedures have been completed and which procedures remain to be completed.

[0128] "A means of making applications in a centralized manner" is a function that allows multiple different administrative procedures to be managed in one place and allows applications to be made efficiently all at once.

[0129] The present invention is a system that allows users to efficiently carry out administrative procedures. This system includes a terminal, a server, and a generative AI model, and each module works in cooperation to simplify complex administrative procedures.

[0130] User Input

[0131] First, users access a terminal and log in to the system with their account. After logging in, the terminal provides an interface for users to select specific administrative procedures such as "moving" or "starting a new business." Users then enter the necessary information, such as their old and new addresses, industry, business size, and location.

[0132] Server Processing

[0133] The server stores the information sent by the user in a database. An example of a database is an SQL database (e.g., MySQL or PostgreSQL). Next, the server starts a generative AI model (e.g., OpenAI's GPT-4), generates a prompt sentence based on the input information, and sends it to the generative AI model.

[0134] Prompt Sentence Examples

[0135] "Please list the necessary administrative procedures based on the following information: My new address is in Shinjuku-ku, Tokyo, and my old address is in Kita-ku, Osaka."

[0136] Acquiring and organizing procedural information

[0137] The generative AI model lists the necessary administrative procedures based on the prompt. For example, in the case of "moving," this includes procedures for moving out and in, mail forwarding, and utility bill transfer. In the case of "starting a new business," this includes business registration, incorporation notification, business start-up notification to the tax office, and obtaining a business license. The server analyzes the information received from the generative AI model and organizes it in a format that is easy for the user to understand.

[0138] Providing information to users

[0139] The server sends the organized procedure information and procedure list to the terminal, which then displays the received information to the user, allowing the user to check the list and understand the detailed explanation of each procedure and the necessary documents.

[0140] Progress management and follow-up

[0141] Each time a user performs a procedure and completes it, they can enter a completion report into the system. The server tracks this information and manages the progress of the procedure. If there are any incomplete procedures, the server sends a reminder to the user. The reminder is notified to the user by email, push notification, or other methods.

[0142] Specific examples

[0143] Specific examples of moving procedures

[0144] 1. The user logs in to the terminal and selects "Move." The terminal prompts the user to enter their old and new addresses. The user enters their new address (e.g., Shinjuku-ku, Tokyo) and their old address (e.g., Kita-ku, Osaka).

[0145] 2. The server uses the generation AI to create a list of procedures. The generation AI obtains the necessary procedures, such as moving-in and moving-out procedures for resident registration, mail forwarding procedures, and utility bill transfer procedures, and sends them to the server.

[0146] 3. The server organizes the procedure information and sends it to the terminal, which displays the procedure list and detailed instructions to the user.

[0147] 4. The user performs each step in sequence, entering a completion report into the system as they complete it. The server tracks their progress and reminds them of any remaining steps.

[0148] In this way, this system supports users in efficiently completing the necessary administrative procedures. By utilizing generative AI and obtaining the latest administrative procedure information in real time, the system always provides the latest information, allowing users to smoothly complete procedures.

[0149] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0150] Step 1:

[0151] The user logs in to the terminal. The terminal displays a login screen and the user enters authentication information (user name and password). The entered authentication information is sent from the terminal to the server. The server compares the authentication information with a database and returns the authentication result (success or failure) to the terminal. The terminal displays the authentication result to the user. If authentication is successful, the user can access the system.

[0152] Step 2:

[0153] The user selects a specific administrative procedure. The terminal displays a procedure selection screen for the user, such as "moving" or "starting a new business." When the user selects a procedure, the terminal sends the selected procedure information to the server. The server generates an information input form corresponding to the selected procedure and sends it to the terminal. The terminal displays the information input form to the user.

[0154] Step 3:

[0155] The user enters the necessary information into the information input form. The terminal prompts the user to enter information such as old and new addresses, industry, business size, and location. The information entered by the user is sent from the terminal to the server. The server saves the received information in a database. The terminal is notified that the save was successful.

[0156] Step 4:

[0157] The server launches the generative AI model. The server retrieves the user's input information stored in the database and generates a prompt based on that information. The generated prompt is sent to the generative AI model. The generative AI model creates a list of necessary administrative procedures based on the prompt and sends that list back to the server. The server analyzes the received list of procedures and temporarily stores it in the database.

[0158] Step 5:

[0159] The server organizes the procedure information and provides it to the user. The server formats the procedure list obtained from the generated AI model into a user-friendly format (e.g., JSON format) and sends it to the device. The device displays the procedure list and detailed explanation to the user. The user can check the list and explanation.

[0160] Step 6:

[0161] The user performs each procedure and reports the progress. The user performs each procedure in sequence and inputs a completion report into the system when completed. The terminal sends the completion report to the server. The server receives the completion report and records the progress of the procedure in a database. The server tracks the progress.

[0162] Step 7:

[0163] The server reminds the user of incomplete procedures. The server periodically checks the database and, if there are incomplete procedures, sends a reminder notification to the user. Reminder notifications are sent via email or push notification. The device displays the reminder to the user. The user checks the notification and is prompted to retry the incomplete procedures.

[0164] (Application example 1)

[0165] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0166] Existing systems for efficiently carrying out administrative procedures provide a function that lists the necessary procedures based on information entered by the user, but they lack procedure progress management and reminder functions specialized for the operation and management of physical stores. This poses a challenge, requiring time and effort, particularly when opening a new store or managing daily operations, making efficient operation difficult. Furthermore, there is a lack of means to obtain the latest administrative procedure information in real time or to centrally manage multiple procedures, making it difficult for users to grasp the progress of procedures.

[0167] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0168] In this invention, the server includes means for a user to input information necessary for administrative procedures, means for a generation AI to list the necessary procedures based on the input information, means for organizing the procedures listed by the generation AI and providing detailed explanations, means for tracking the user's progress and reminding them of incomplete procedures, and means for listing the procedures necessary for opening a store based on the user's industry, store location, and size, and managing the progress. This enables administrative procedures related to operating or opening a physical store to be carried out efficiently and smoothly, significantly reducing the user's workload.

[0169] The "means for users to input the information necessary to carry out administrative procedures" refers to an interface that allows users to provide specific information to a computer system that corresponds to their own situation.

[0170] "Means for the generation AI to list the necessary procedures based on the input information" refers to a function that analyzes the information provided by the user and automatically creates a list of the corresponding procedures based on that information.

[0171] "Means for organizing the procedures listed by the generation AI and providing detailed explanations" refers to a function that organizes information about the procedures listed by the generation AI into an easy-to-understand format and provides detailed explanations to the user about specific steps to perform the procedures, necessary documents, etc.

[0172] "Means to track user progress and remind users of incomplete procedures" refers to a function that monitors the progress of users when carrying out administrative procedures and automatically notifies users of incomplete procedures.

[0173] "A means of listing the procedures required to open a store based on the user's industry, store location, and size, and managing the progress" is a function in which the AI ​​generates a list of the procedures required to open a new store based on details such as the industry, store location, and size entered by the user, and manages the progress of those procedures.

[0174] "Means for the generating AI to obtain the latest administrative procedure information in real time" refers to the function that allows the generating AI to constantly collect the latest information on administrative procedures in real time via the Internet and related databases.

[0175] "A means of managing multiple administrative procedures in one place and making applications in a centralized manner" is a function that manages multiple procedures simultaneously, allowing users to perform all necessary procedures with a single application operation.

[0176] System program generation

[0177] This system is designed to help users carry out administrative procedures efficiently, and has functions specifically designed for new store openings and daily business management. The main components of the system are a user information input section, a procedure list generation section using AI, a detailed explanation section, a progress management section, and a reminder section. The main programs required to realize a system with these functions are as follows:

[0178] 1. User information input section

[0179] Users use devices such as smartphones and tablets to enter the information required for administrative procedures. This entered information is linked to the user's account and saved. Examples include information such as "opening a restaurant" and "Shinjuku Ward, Tokyo."

[0180] 2. Procedure list generation by generative AI

[0181] The server launches a generative AI based on the information entered by the user, and lists the necessary procedures. Using the generative AI model, the system obtains the latest administrative procedure information in real time and generates specific procedures according to the user's industry, location, and scale. For example, "applying for a food business license" or "notifying the fire department."

[0182] 3. Detailed explanation section

[0183] The AI ​​then organizes the procedural information it lists in a user-friendly format and provides detailed instructions, including specific steps, required documents, and related links. For example, the instructions might say, "To apply for a business license, you need the following documents..."

[0184] 4. Progress management department

[0185] When the user performs each procedure and completes it, they can report their progress to the system. Based on this report, the server tracks the user's progress and lists the procedures that have not yet been completed. This function makes it easy for the user to know which procedures have not yet been completed.

[0186] 5. Remind Section

[0187] The server automatically sends reminders to users about incomplete procedures or procedures that are approaching deadlines, for example, by email or push notification, reminding them that "the deadline for submitting a notification to the fire department is approaching."

[0188] Hardware and software used

[0189] Hardware: Smartphones, tablets

[0190] Software: SQLite (database management), smtplib (email sending), Python (scripting language)

[0191] Processing Description

[0192] The server uses SQLite to manage user and procedure information. The AI ​​generates the procedure list based on the information entered by the user on the device. It also uses smtplib to implement a function to send reminder emails.

[0193] Specific example explanation

[0194] For example, if a user selects "Opening a Restaurant" and enters the required address and business information, the AI ​​will automatically create a list of procedures such as "Applying for a Food Business License" and "Notifying the Fire Department." The progress can be checked within the app, and it is easy to see at a glance which procedures have been completed and which remain to be completed. In addition, reminder emails are sent, helping users to remember important procedures.

[0195] Specific examples of prompts to input to generative AI models

[0196] Please list the administrative procedures required to open a new store in the following industries:

[0197] Industry: Food and beverage

[0198] Store location: Shinjuku Ward, Tokyo

[0199] Scale: Small

[0200] Output formats:

[0201] 1. Procedure Name

[0202] 2. Where to apply

[0203] 3. Required documents

[0204] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0205] Step 1:

[0206] The user accesses the device and logs in to their account.

[0207] Specific behavior:

[0208] A user logs in to the application using a smartphone or tablet. They enter their username and password on the login screen and are authenticated. After successful authentication, the user data is loaded onto the device.

[0209] Input: Username, Password

[0210] Output: Authenticated user session

[0211] Step 2:

[0212] The user enters the information required to carry out administrative procedures.

[0213] Specific behavior:

[0214] After logging in, the user selects an option such as "Opening a new store" or "Daily business management." Next, a form is displayed for entering specific information such as the type of business, store location, and size. The user enters this information and presses the submit button.

[0215] Input: Information such as business type, store location, size, etc.

[0216] Output: The input information is saved in the database.

[0217] Step 3:

[0218] The server launches the generation AI based on the input information.

[0219] Specific behavior:

[0220] The server retrieves the information entered by the user from the database and sends a prompt to the generative AI model, which analyzes the prompt and lists the necessary steps to follow according to the user's request.

[0221] Input: Information entered by the user, prompts for the AI ​​generator

[0222] Output: List of required procedures

[0223] Step 4:

[0224] The generative AI organizes the procedures listed and provides detailed explanations.

[0225] Specific behavior:

[0226] The server organizes the list of procedures received from the generation AI and generates detailed explanations for each procedure, including necessary documents, application locations, and procedures, and provides them to the user in an easy-to-understand format.

[0227] Input: Procedure list from the generating AI

[0228] Output: Detailed instructions with organized procedures

[0229] Step 5:

[0230] Track your progress and remind you of any outstanding steps.

[0231] Specific behavior:

[0232] As users complete each step, they enter a completion report through their device. The server tracks the progress and updates the database. For any remaining steps, reminders are automatically generated and sent to users via email or push notification.

[0233] Input: User completion report, database progress information

[0234] Output: Reminders for outstanding procedures

[0235] Step 6:

[0236] The server uses a generative AI model to obtain the latest administrative procedure information in real time.

[0237] Specific behavior:

[0238] The server periodically calls the generative AI model to retrieve the latest administrative procedure information from the internet and relevant databases, ensuring that the information provided to users is up-to-date.

[0239] Input: Routine requests, administrative procedure information on the Internet

[0240] Output: Updated administrative procedure information

[0241] Step 7:

[0242] Multiple administrative procedures are managed in one place, and applications are submitted centrally.

[0243] Specific behavior:

[0244] The server provides the interface and functionality to allow users to manage and apply for multiple administrative procedures at once. Users can complete all related procedures at once by performing a single application.

[0245] Input: User's bulk application instructions

[0246] Output: Centralized application processing

[0247] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0248] This invention is a system that enables users to carry out administrative procedures efficiently, and also combines it with an emotion engine that recognizes the user's emotions to provide a more user-friendly interface. By recognizing emotions based on the user's input information and operation status, and automatically adjusting the system's behavior according to the emotions, the user experience is improved.

[0249] Overall system overview

[0250] User Input

[0251] First, the user accesses a terminal and logs in to the system. After logging in, the user selects an option such as "moving" or "starting a new business" and enters the necessary information (e.g., old and new addresses, industry, business size, location, etc.).

[0252] Server Processing

[0253] The server stores the information entered by the user in a database. Then, the server launches a generation AI to create a list of necessary procedures based on the entered information.

[0254] Acquiring and organizing procedural information

[0255] Based on the input information, the AI ​​generates a list of the latest administrative procedures. For example, in the case of moving, this includes procedures for moving out and in, mail forwarding, and utility bill transfer. In the case of starting a new business, this includes business registration, incorporation notification, business start-up notification to the tax office, and obtaining a business license. The server organizes the information from the AI ​​and provides it to the user in an easy-to-understand format.

[0256] Emotional Engine Adjustment

[0257] As the user operates the system, the emotion engine analyzes the user's input information and operation status in real time to recognize the user's emotions. For example, if the system determines that the user is feeling stressed, it can display an encouraging message to the user or provide simpler instructions on how to proceed. The server automatically adjusts how the procedure is carried out and how information is presented based on the information sent from the emotion engine.

[0258] Providing information to users

[0259] The organized procedure information and procedure list are sent to the terminal and displayed to the user, who can check the list and understand the detailed explanation of each procedure and the necessary documents.

[0260] Progress management and follow-up

[0261] Each time a user performs a procedure and completes it, they can enter a completion report into the system. The server tracks this information and manages the progress of the procedure. If there are any incomplete procedures, the server sends reminders to the user. If the emotion engine detects the user's anxiety or frustration, it can also provide supportive messages and advice on progress.

[0262] Specific examples

[0263] Specific examples of moving procedures

[0264] 1. The user logs in to the device and selects "Move"

[0265] The terminal prompts the user to enter their old and new addresses.

[0266] The user enters a new address (e.g., Shinjuku-ku, Tokyo) and an old address (e.g., Kita-ku, Osaka).

[0267] 2. The server uses a generative AI to list the procedures

[0268] The generation AI obtains the necessary procedures, such as moving-in and moving-out procedures for resident registration, mail forwarding procedures, and utility bill transfer procedures, and sends them to the server.

[0269] 3. The server organizes the procedure information and provides it to the user.

[0270] The server organizes the procedure information and sends it to the terminal.

[0271] The terminal displays the procedure list and detailed instructions to the user.

[0272] 4. The emotion engine recognizes and responds to user emotions

[0273] When a user inputs or performs an operation, the emotion engine recognizes the user's emotions in real time.

[0274] If the emotion engine detects the user's stress, the server will provide an encouraging message or simple operating instructions.

[0275] 5. The user performs the procedure and reports progress

[0276] The user executes each procedure in sequence and inputs a completion report into the system each time it is completed.

[0277] The server tracks your progress and reminds you of any outstanding steps.

[0278] Specific examples of procedures for starting a new business

[0279] 1. The user logs in to the device and selects "Start a new business."

[0280] The terminal asks the user to enter the industry, business size, and location.

[0281] The user enters the industry (e.g., food and beverage), business size (e.g., small scale), and location (e.g., Shinjuku-ku, Tokyo).

[0282] 2. The server uses a generative AI to list the procedures

[0283] The generation AI obtains the necessary procedures, such as business registration, incorporation notification, business start-up notification to the tax office, and obtaining a business license, and sends them to the server.

[0284] 3. The server organizes the procedure information and provides it to the user.

[0285] The server organizes the procedure information and sends it to the terminal.

[0286] The terminal displays the procedure list and detailed instructions to the user.

[0287] 4. The emotion engine recognizes and responds to user emotions

[0288] When a user inputs or performs an operation, the emotion engine recognizes the user's emotions in real time.

[0289] If the emotion engine detects the user's anxiety, the server will present appropriate advice or support messages.

[0290] 5. The user performs the procedure and reports progress

[0291] The user executes each procedure in sequence and inputs a completion report into the system each time it is completed.

[0292] The server tracks your progress and reminds you of any outstanding steps.

[0293] In this way, this system not only supports users in efficiently carrying out the necessary administrative procedures, but also provides a better user experience by utilizing an emotion engine to respond in a way that is adapted to the user's emotions.

[0294] The processing flow will be explained below.

[0295] When carrying out moving procedures

[0296] Step 1:

[0297] The user accesses the terminal and logs in to the system. After logging in, the user selects "Move" from the menu and enters their new and old addresses.

[0298] Step 2:

[0299] The server receives the user's input information (old and new addresses) and saves this information in a database. Once saved, the server starts the generation AI.

[0300] Step 3:

[0301] The server sends a request to the generation AI to list the necessary procedures based on the new and old address information entered by the user.

[0302] Step 4:

[0303] Based on the specified information, the generation AI creates a list of necessary procedures (e.g., moving-in / moving-out procedures for resident registration, mail forwarding procedures, utility bill transfer procedures, etc.) in real time. The listed information is then sent back to the server.

[0304] Step 5:

[0305] The server organizes the procedure list returned by the generation AI, including detailed instructions for each procedure, required documents, and procedure locations.

[0306] Step 6:

[0307] The server sends the organized procedure list to the terminal, which displays the procedure list and detailed instructions to the user.

[0308] Step 7:

[0309] The emotion engine analyzes the user's input information and operation status to recognize the user's emotions. For example, it can detect stress from actions such as typing quickly or repeatedly clicking the same button.

[0310] Step 8:

[0311] The server adjusts its response to the user based on the emotional data sent from the emotion engine. For example, if the user is feeling stressed, it will present an encouraging message or simple instructions for how to proceed.

[0312] Step 9:

[0313] The user performs the procedures and inputs a completion report into the system as each procedure is completed.

[0314] Step 10:

[0315] The server receives the completion report from the user and records the progress of the procedure in a database. If there are any incomplete procedures, the server sends appropriate reminder messages based on the emotion engine data.

[0316] When starting a new business

[0317] Step 1:

[0318] The user accesses the terminal and logs in to the system. After logging in, the user selects "Starting a new business" from the menu and enters the industry, business size, and location.

[0319] Step 2:

[0320] The server receives the user's input information (industry, business size, location) and stores this information in a database. Once the information is saved, the server launches the generation AI.

[0321] Step 3:

[0322] The server sends a request to the generation AI to list the necessary procedures based on the industry, business size, and location information entered by the user.

[0323] Step 4:

[0324] Based on the specified information, the generation AI creates a list of necessary procedures (e.g., business registration, incorporation notification, business start-up notification to the tax office, obtaining a business license, etc.) in real time. The listed information is then sent back to the server.

[0325] Step 5:

[0326] The server organizes the procedure list returned by the generation AI, including detailed instructions for each procedure, required documents, and procedure locations.

[0327] Step 6:

[0328] The server sends the organized procedure list to the terminal, which displays the procedure list and detailed instructions to the user.

[0329] Step 7:

[0330] The emotion engine analyzes the user's input information and operation status to recognize the user's emotions. For example, if the user takes a long time to input, it is assumed that the user is feeling anxious.

[0331] Step 8:

[0332] The server adjusts its response to the user based on the emotional data sent from the emotion engine. For example, if the user is feeling anxious, it will provide specific advice or a support message.

[0333] Step 9:

[0334] The user performs the procedures and inputs a completion report into the system as each procedure is completed.

[0335] Step 10:

[0336] The server receives the completion report from the user and records the progress of the procedure in a database. If there are any incomplete procedures, the server sends appropriate reminder messages based on the emotion engine data.

[0337] The above is the specific processing flow of the program when carrying out procedures for moving and starting a new business. This system allows users to complete administrative procedures efficiently, and by utilizing the emotion engine, it is possible to respond flexibly to the user's emotions.

[0338] Example 2

[0339] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0340] In modern society, administrative procedures are becoming increasingly complex, making it difficult for users to complete them appropriately. Furthermore, there are only a limited number of systems that can accommodate the different needs and emotional states of each user, creating a need for improved user experience. Conventional systems lack the ability to dynamically adjust to user operations and emotions, making it difficult to streamline procedures and provide a user-friendly interface.

[0341] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0342] In this invention, the server includes means for a user to input information necessary for performing administrative procedures, means for a generation AI to list the necessary procedures based on the input information, means for organizing the procedures listed by the generation AI and providing detailed explanations, means for tracking the user's progress and reminding the user of incomplete procedures, means for analyzing the user's input information and operation status in real time and recognizing the user's emotions with an emotion engine, and means for automatically adjusting the system behavior based on the recognized user emotions. This enables the user to perform administrative procedures appropriately and efficiently, and furthermore, a customized interface can be provided according to the user's emotions through the emotion engine.

[0343] "User" refers to an individual or organization that uses the system to carry out administrative procedures.

[0344] "Terminal" refers to a computing device that a user accesses and enters information into.

[0345] "Server" refers to the central processing unit that processes information input by the user and manages data in cooperation with the generative AI and emotion engine.

[0346] "Generative AI" refers to an artificial intelligence model that lists the necessary administrative procedures based on input data and generates detailed explanations.

[0347] "Input information" refers to data such as address, industry, and business size that users provide to the system via their terminal.

[0348] "Procedure list" refers to a list of administrative procedures that users must carry out, compiled by the generation AI based on input information.

[0349] An "emotion engine" is a software engine that analyzes the user's input information and operating conditions to recognize emotions and adjusts the system's behavior according to those emotions.

[0350] "Tracking" refers to the system monitoring and recording the progress of a user's administrative procedures.

[0351] "Remind" refers to notifying the user of incomplete procedures or procedures with an upcoming deadline.

[0352] "Real-time" refers to processing data immediately and reflecting results without delay.

[0353] The system is designed to help users efficiently complete administrative procedures. It uses a generative AI model to provide users with a list of necessary procedures. It also incorporates an emotion engine that recognizes the user's emotional state in real time and provides interfaces and support appropriate to that state.

[0354] Overall system overview

[0355] User input method

[0356] First, the user accesses the terminal and logs in to the system. On the login screen, they enter their ID and password for authentication. If authentication is successful, the dashboard screen is displayed.

[0357] After logging in, users select an administrative procedure such as "moving" or "starting a new business" and enter the necessary information such as their old and new addresses, industry, business size, and location.

[0358] Server processing means

[0359] The server stores the information entered by the user in a database, such as MySQL.

[0360] Next, the server launches a generative AI model (e.g., OpenAI GPT-4) and sends a prompt to the model. Examples of prompts include "Please list the procedures for moving" and "Please tell me the procedures required to start a new business."

[0361] The generative AI model lists the necessary administrative procedures based on the input information and returns the results to the server.

[0362] A means of obtaining and organizing procedural information

[0363] The server organizes the output from the generative AI model and creates a procedure list. The procedure information is converted into a data format (e.g., JSON) and provided to the user.

[0364] The organized procedure list is sent to the terminal and displayed in an easy-to-understand format for the user, along with detailed instructions for each procedure and the necessary documents.

[0365] Emotion engine adjustment method

[0366] When a user operates the terminal, the terminal collects operation data such as the user's input speed, cursor movement, and click frequency.

[0367] The emotion engine analyzes this data in real time to recognize the user's emotional state and automatically adjusts the system's behavior if the user is feeling stressed, anxious, or irritated.

[0368] For example, if the user is feeling stressed, the server can display an encouraging message or provide more convenient instructions on how to proceed.

[0369] Progress management and follow-up measures

[0370] As the user performs each step and completes it, they enter a completion report into the system, and the server tracks this information and manages the progress.

[0371] The server sends reminders to users when there are unfinished tasks, and if the emotion engine detects anxiety or frustration in the user, it provides supportive messages and advice on progress.

[0372] Specific use cases

[0373] For example, when a user performs moving procedures, the flow is as follows:

[0374] 1. The user logs in to the terminal and selects "Move." Enters the old and new address information.

[0375] 2. The server uses generated AI to create a list of procedures for moving out and in, mail forwarding, and utility bill transfer.

[0376] 3. The server organizes the procedure list and sends it to the terminal. The user checks the list and understands the detailed explanation of each procedure and the necessary documents.

[0377] 4. The user performs the procedure and enters the completion report into the system. The server tracks the progress and reminds the user of any incomplete procedures.

[0378] In this way, this system not only supports users in efficiently carrying out the necessary administrative procedures, but also provides a better user experience by utilizing an emotion engine to respond in a way that adapts to the user's emotions.

[0379] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0380] Step 1:

[0381] A user accesses a terminal and logs into the system

[0382] Input: The user enters the ID and password.

[0383] What happens: The device displays a user authentication screen and provides fields for entering user information. The user enters the required authentication information and clicks the "Login" button.

[0384] Output: The server checks the user information against the database, and if authentication is successful, displays the dashboard screen on the terminal.

[0385] Step 2:

[0386] The user selects an item and enters the required information.

[0387] Input: The user selects an option such as "moving" or "starting a new business" and enters the necessary information (old and new addresses, industry, business size, location).

[0388] Action: The device displays a list of choices and then displays an input form based on the user's selection. The user enters information and presses the "Submit" button.

[0389] Output: The information entered by the user is sent to the server.

[0390] Step 3:

[0391] The server stores the information entered by the user in a database

[0392] Input: Information submitted by the user.

[0393] Behavior: Before the server stores the received information in a database (e.g., MySQL), it checks the data for errors and performs some processing to ensure the save was successful.

[0394] Output: Returns a message to the user that the save was successful.

[0395] Step 4:

[0396] The server launches a generation AI that lists the necessary procedures based on the input information.

[0397] Input: User input information stored in the database.

[0398] How it works: The server launches a generative AI model (e.g., OpenAI GPT-4) and generates a prompt. The prompt might be something like, "Please list the procedures for moving" or "Please tell me the procedures required to start a new business." The prompt is then sent to the generative AI.

[0399] Output: The generating AI lists the necessary procedures and replies to the server.

[0400] Step 5:

[0401] The server organizes the information received from the generated AI

[0402] Input: A list of procedures listed by the generation AI.

[0403] What it does: The server organizes the received list into a comprehensible format, categorizing and sorting as needed, and converts it into a data format (e.g., JSON).

[0404] Output: Sends organized procedural information to the terminal.

[0405] Step 6:

[0406] The terminal displays a list of procedures to the user.

[0407] Input: Organized procedural information sent from the server.

[0408] Operation: The device interprets the received data and displays a list of procedures and detailed instructions to the user. It also displays detailed instructions for each procedure and a list of required documents.

[0409] Output: An interface is provided for the user to confirm the procedure and proceed to the next step.

[0410] Step 7:

[0411] The emotion engine analyzes user input and operation status in real time.

[0412] Input: Operational data such as user typing speed, cursor movement, and click frequency.

[0413] Operation: The device collects these operation data and sends them to the emotion engine, which analyzes the data and recognizes the user's emotional state.

[0414] Output: The recognized emotional state is sent to the server.

[0415] Step 8:

[0416] The server adjusts the system's behavior based on the results of the emotion engine.

[0417] Input: The user's emotional state sent from the emotion engine.

[0418] Operation: The server receives the results of the emotion engine and determines the behavior of the system based on the user's emotional state. For example, if a user is feeling stressed, it may display an encouraging message or simplify the procedure.

[0419] Output: The device displays encouraging messages and simple operating instructions to the user.

[0420] Step 9:

[0421] The user performs a procedure and reports progress to the system

[0422] Input: Report information when the user completes the procedure.

[0423] How it works: The device receives a completion report from the user and sends it to the server, which stores the information in a database and tracks the progress.

[0424] Output: The server updates the progress and sends a reminder message to the user if there are any outstanding transactions.

[0425] Step 10:

[0426] The server sends reminders and support messages to the user

[0427] Input: Server-tracked procedural progress and user emotional state.

[0428] How it works: The server manages outstanding tasks and sends reminders when deadlines are approaching. If it detects user anxiety or frustration based on information from the emotion engine, it provides support messages and advice.

[0429] Output: The device displays a reminder or support message to the user.

[0430] (Application example 2)

[0431] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0432] Conventional systems require users to perform complex operations when carrying out specific procedures in stores, which can cause stress and frustration. Furthermore, because the system responds uniformly without considering the user's feelings, it is difficult to respond to individual needs. As a result, improving the user experience has been a challenge.

[0433] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0434] In this invention, the server includes: means for a user to input information necessary for a specific procedure; means for a generation AI to list the necessary procedures based on the input information; means for organizing the procedures listed by the generation AI and providing detailed explanations; means including an emotion engine that recognizes the user's emotions and adjusts the system's behavior in response to the emotions; and means for tracking the user's progress and reminding the user of incomplete procedures. This reduces the stress and anxiety felt by the user and enables efficient and user-friendly procedures.

[0435] The "means for a user to input information necessary for carrying out a specific procedure" is an interface that allows a user to input data necessary for achieving a specific purpose into the system.

[0436] "Means for the generation AI to list the necessary procedures based on the input information" refers to a function in which the generation AI automatically generates a list of related procedures and tasks based on the information input by the user.

[0437] "Means for organizing the procedures listed by the generation AI and providing detailed explanations" refers to a function that organizes the procedure list created by the generation AI in an easy-to-understand manner and provides specific and detailed explanations of its contents.

[0438] "Means including an emotion engine that recognizes the user's emotions and adjusts the system's behavior in accordance with the emotions" refers to a function that analyzes the user's emotions in real time from the information input by the user and the operating situation, and dynamically adjusts the system's behavior and display content based on the recognized emotions.

[0439] "Means to track user progress and remind users of incomplete procedures" is a function that tracks the progress of procedures the user is performing and automatically notifies the user of procedures that have not been completed.

[0440] System configuration and processing flow

[0441] 1. User Input Method

[0442] A user first logs into the system using a device such as a smartphone or smart glasses. After logging in, the user enters the information required to perform a specific procedure, such as a product search or service reservation. This information is data necessary for the user to achieve a specific purpose.

[0443] 2. Procedure listing using generative AI

[0444] The server collects information entered by the user and activates a generative AI model. This generative AI model (e.g., GPT-4 model) automatically generates a list of necessary procedures and tasks. During this process, a function is implemented to obtain the latest procedure information in real time based on the entered information.

[0445] 3. Organizing and explaining procedural information

[0446] The procedures listed by the AI ​​are organized in an easy-to-understand manner by the server. This procedure information is provided to the user's device along with detailed explanations. By referring to this, the user can understand the specific content and methods of the procedure.

[0447] 4. Emotional Engine Adjustment

[0448] When a user inputs information or performs an operation, the server activates the emotion engine. The emotion engine analyzes the user's input information and operation status in real time and recognizes the user's emotions. For example, if the user is feeling stressed, the device can display an encouraging message or a simple operation guide, improving user usability.

[0449] 5. Progress Tracking and Reminders

[0450] As the user completes each step, their progress is tracked by the server, and if there are any incomplete steps, the server automatically sends reminders to the user, helping them remember to complete the steps.

[0451] Specific examples

[0452] scenario

[0453] A customer is searching for a specific product in a physical store but is frustrated by long lines.

[0454] 1. The user logs in to the in-store terminal and selects "Product Search"

[0455] The terminal prompts the user to input the name of the product to be searched for.

[0456] The user enters "alcoholic beverages."

[0457] 2. The server uses a generative AI to list the procedures

[0458] The generative AI model obtains a list of products related to "alcoholic beverages" and sends it to the server.

[0459] 3. The server organizes the procedure information and provides it to the user.

[0460] The server organizes the procedure information and sends it to the terminal along with a detailed product description.

[0461] The terminal displays the product list and detailed descriptions to the user.

[0462] 4. The emotion engine recognizes and responds to user emotions

[0463] The emotion engine detects the user's stress, and the server displays an encouraging message.

[0464] 5. The user performs the procedure and reports progress

[0465] The user selects a product and completes the purchase process.

[0466] The server tracks the progress and assists until the procedure is completed.

[0467] Prompt Sentence Examples

[0468] After logging in to the system, press the "Product Search" button and enter "alcoholic beverages." If you feel stressed, enter "I'm frustrated by the long lines," and the system will take measures to alleviate your stress.

[0469] Hardware and software used

[0470] Hardware: Smartphones, smart glasses, servers

[0471] Software: Python, TensorFlow, GPT-4 model

[0472] Data processing details

[0473] 1. Data input: Input data from the user is collected on the terminal and sent to the server.

[0474] 2. Use of generative AI model: The server launches the GPT-4 model using the Python library and generates procedures based on user input.

[0475] 3. Emotion recognition: The emotion recognition model built using TensorFlow analyzes the user's input information and operation status in real time to recognize emotions.

[0476] 4. Data provision: Provide organized procedural information and messages corresponding to the user's emotions to the terminal.

[0477] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0478] Step 1: The user logs in to the system using a smartphone or smart glasses.

[0479] Input: Login information (user ID, password).

[0480] Specific operation: The terminal displays the login screen, and the user enters their ID and password. The entered information is sent to the server, where authentication is performed.

[0481] Output: A successful login message and the main menu screen.

[0482] Step 2: The user selects a specific procedure and enters the required information.

[0483] Input: Type of procedure (product search, service reservation, etc.), specific required information (product name, desired date and time, etc.).

[0484] Specific operation: The terminal displays the procedure selection screen, the user selects a procedure, and enters the required information. The input information is sent to the server.

[0485] Output: Input confirmation message and detailed input screen are displayed.

[0486] Step 3: The server uses the generative AI model to create a list of procedures.

[0487] Input: Information entered by the user.

[0488] How it works: The server uses Python and the GPT-4 model to generate relevant procedures and tasks based on the input information.

[0489] Output: A procedure list to send to the user's terminal.

[0490] Step 4: Organize the server-generated procedure list and provide detailed explanations.

[0491] Input: Procedural information listed by the generating AI.

[0492] Specific operation: The server organizes the procedure list, adds detailed instructions, and sends it to the user's terminal.

[0493] Output: Organized procedural information and detailed instructions.

[0494] Step 5: When the user inputs or performs an operation, the server activates the emotion engine and recognizes the user's emotion.

[0495] Input: User operation information, facial expression data, and voice input.

[0496] Specific operation: The emotion recognition model (using TensorFlow) analyzes the user's input information and operation status in real time to determine emotions.

[0497] Output: User's emotional state (e.g., stressed, excited, calm).

[0498] Step 6: The server adjusts the system behavior based on the emotion engine results and provides an appropriate message.

[0499] Input: User's emotional state information.

[0500] Specific operation: When the emotion engine recognizes a stressful state, it generates a message of encouragement or operational guidance and sends it to the user's device.

[0501] Output: Message display according to emotion.

[0502] Step 7: The user performs the procedure and reports its progress to the server.

[0503] Input: Procedure status information (completed, incomplete).

[0504] What it does: As the user completes each step, the device sends that information to the server, which tracks their progress.

[0505] Output: Progress updates, reminders of outstanding procedures.

[0506] In this way, appropriate data processing and calculations are performed based on input information at each processing step, and the entire system is designed to function smoothly.

[0507] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0508] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0509] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0510] [Second embodiment]

[0511] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0512] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0513] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0514] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0515] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0516] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0517] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0518] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0519] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0520] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0521] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0522] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0523] This invention is a system that enables users to efficiently complete administrative procedures. The user inputs the information necessary to complete the administrative procedure, and a generation AI lists the necessary procedures based on the input information and provides them to the user. The system also includes a function to track the user's progress and remind them of any incomplete procedures.

[0524] Overall system overview

[0525] User Input

[0526] First, the user accesses the terminal and logs in to the system with their account. After logging in, the user selects an option such as "moving" or "starting a new business" and enters the necessary information (e.g., old and new addresses, industry, business size, location, etc.).

[0527] Server Processing

[0528] The server stores the information entered by the user in a database. Then, the server launches a generation AI to create a list of necessary procedures based on the entered information.

[0529] Acquiring and organizing procedural information

[0530] Based on the input information, the AI ​​generates a list of the latest administrative procedures. For example, in the case of moving, this includes procedures for moving out and in, mail forwarding, and utility bill transfer. In the case of starting a new business, this includes business registration, incorporation notification, business start-up notification to the tax office, and obtaining a business license. The server organizes the information from the AI ​​and provides it to the user in an easy-to-understand format.

[0531] Providing information to users

[0532] The organized procedure information and procedure list are sent to the terminal and displayed to the user, who can check the list and understand the detailed explanation of each procedure and the necessary documents.

[0533] Progress management and follow-up

[0534] Each time a user performs a procedure and completes it, they can enter a completion report into the system. The server tracks this information and manages the progress of the procedure. If there are any incomplete procedures, the server sends reminders to the user.

[0535] Specific examples

[0536] Specific examples of moving procedures

[0537] 1. The user logs in to the device and selects "Move"

[0538] The terminal prompts the user to enter their old and new addresses.

[0539] The user enters a new address (e.g., Shinjuku-ku, Tokyo) and an old address (e.g., Kita-ku, Osaka).

[0540] 2. The server uses a generative AI to list the procedures

[0541] The generation AI obtains the necessary procedures, such as moving-in and moving-out procedures for resident registration, mail forwarding procedures, and utility bill transfer procedures, and sends them to the server.

[0542] 3. The server organizes the procedure information and provides it to the user.

[0543] The server organizes the procedure information and sends it to the terminal.

[0544] The terminal displays the procedure list and detailed instructions to the user.

[0545] 4. The user performs the procedure and reports progress

[0546] The user executes each procedure in sequence and inputs a completion report into the system each time it is completed.

[0547] The server tracks your progress and reminds you of any outstanding steps.

[0548] Specific examples of procedures for starting a new business

[0549] 1. The user logs in to the device and selects "Start a new business."

[0550] The terminal asks the user to enter the industry, business size, and location.

[0551] The user enters the industry (e.g., food and beverage), business size (e.g., small scale), and location (e.g., Shinjuku-ku, Tokyo).

[0552] 2. The server uses a generative AI to list the procedures

[0553] The generation AI obtains the necessary procedures, such as business registration, incorporation notification, business start-up notification to the tax office, and obtaining a business license, and sends them to the server.

[0554] 3. The server organizes the procedure information and provides it to the user.

[0555] The server organizes the procedure information and sends it to the terminal.

[0556] The terminal displays the procedure list and detailed instructions to the user.

[0557] 4. The user performs the procedure and reports progress

[0558] The user executes each procedure in sequence and inputs a completion report into the system each time it is completed.

[0559] The server tracks your progress and reminds you of any outstanding steps.

[0560] In this way, this system supports users in efficiently completing the necessary administrative procedures. By utilizing generative AI to obtain the latest administrative procedure information in real time, the system always provides the latest information, allowing users to smoothly complete procedures.

[0561] The processing flow will be explained below.

[0562] When carrying out moving procedures

[0563] Step 1:

[0564] The user accesses the terminal and logs in to the system. After logging in, the user selects the "move" item from the menu and enters the new address and old address.

[0565] Step 2:

[0566] The server receives the user's input information (old and new addresses) and saves this information in a database. Once saved, the server starts the generation AI.

[0567] Step 3:

[0568] The server sends a request to the generated AI to list the necessary procedures based on the new and old address information entered by the user.

[0569] Step 4:

[0570] Based on the specified information, the generation AI creates a list of necessary procedures (e.g., moving-in / moving-out procedures for resident registration, mail forwarding procedures, utility bill transfer procedures, etc.) in real time. The listed information is then sent back to the server.

[0571] Step 5:

[0572] The server organizes the procedure list returned by the generation AI, including detailed instructions for each procedure, required documents, and procedure locations.

[0573] Step 6:

[0574] The server sends the organized procedure list to the terminal, which displays the procedure list and detailed instructions to the user.

[0575] Step 7:

[0576] The user checks the displayed list of procedures and executes each procedure in order. Each time a procedure is completed, the user inputs information to report the completion of the procedure into the system.

[0577] Step 8:

[0578] The server receives the completion report from the user and records the progress of the procedure in a database. If there are any incomplete procedures, the server sends a reminder to the user.

[0579] When starting a new business

[0580] Step 1:

[0581] The user accesses the terminal and logs in to the system. After logging in, the user selects the "Start a new business" item from the menu and enters the industry, business size, and location.

[0582] Step 2:

[0583] The server receives the user's input information (industry, business size, location) and stores this information in a database. Once the information is saved, the server launches the generation AI.

[0584] Step 3:

[0585] The server sends a request to the generation AI to list the necessary procedures based on the industry, business size, and location information entered by the user.

[0586] Step 4:

[0587] Based on the specified information, the generation AI creates a list of necessary procedures (e.g., business registration, incorporation notification, business start-up notification to the tax office, obtaining a business license, etc.) in real time. The listed information is then sent back to the server.

[0588] Step 5:

[0589] The server organizes the procedure list returned by the generation AI, including detailed instructions for each procedure, required documents, and procedure locations.

[0590] Step 6:

[0591] The server sends the organized procedure list to the terminal, which displays the procedure list and detailed instructions to the user.

[0592] Step 7:

[0593] The user checks the displayed list of procedures and executes each procedure in order. Each time a procedure is completed, the user inputs information to report the completion of the procedure into the system.

[0594] Step 8:

[0595] The server receives the completion report from the user and records the progress of the procedure in a database. If there are any incomplete procedures, the server sends a reminder to the user.

[0596] The above is the specific processing flow of the program when carrying out procedures for moving and starting a new business. This system allows users to complete administrative procedures efficiently.

[0597] Example 1

[0598] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0599] Current administrative procedures are complex, and it takes time and effort for users to find the necessary procedures and carry them out sequentially. Furthermore, when there are multiple procedures, it is difficult to track the progress of each. Furthermore, because procedure information is frequently updated, it is difficult to obtain the latest information in real time.

[0600] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0601] In this invention, the server includes means for a user to select a specific administrative procedure and input the necessary information, means for storing the input information in a database and sending prompts to a generative AI model to list the necessary procedures, means for analyzing the procedures listed by the generative AI model and providing detailed explanations, and means for tracking the user's progress and reminding the user of incomplete procedures, allowing the user to efficiently complete the necessary administrative procedures and obtain the latest procedural information in real time.

[0602] A "user" is an individual or legal entity that accesses the system, selects a particular administrative procedure, and enters the required information.

[0603] A "terminal" is an electronic device used by a user to enter information into and view information in a system. Examples include personal computers and smartphones.

[0604] The "server" is a networked computer system that receives information submitted by users, uses a generative AI model to list the necessary steps, and tracks progress.

[0605] A "generative AI model" is software equipped with artificial intelligence technology that lists the necessary administrative procedures based on user input information and obtains the latest information in real time.

[0606] A "prompt" is textual contextual information used to input specific conditions or instructions to a generative AI model.

[0607] A "database" is a digital data storage system used to store and later reference information entered by a user.

[0608] "Remind" is a function that notifies the user of incomplete procedures and calls for attention to complete the procedures.

[0609] A "procedure list" is a list of specific administrative procedures that a user must carry out, as listed by a generative AI model.

[0610] "Progress" is information that indicates the status of the user's administrative procedures, including which procedures have been completed and which procedures remain to be completed.

[0611] "A means of making applications in a centralized manner" is a function that allows multiple different administrative procedures to be managed in one place and allows applications to be made efficiently all at once.

[0612] The present invention is a system that allows users to efficiently carry out administrative procedures. This system includes a terminal, a server, and a generative AI model, and each module works in cooperation to simplify complex administrative procedures.

[0613] User Input

[0614] First, users access a terminal and log in to the system with their account. After logging in, the terminal provides an interface for users to select specific administrative procedures such as "moving" or "starting a new business." Users then enter the necessary information, such as their old and new addresses, industry, business size, and location.

[0615] Server Processing

[0616] The server stores the information sent by the user in a database. An example of a database is an SQL database (e.g., MySQL or PostgreSQL). Next, the server starts a generative AI model (e.g., OpenAI's GPT-4), generates a prompt sentence based on the input information, and sends it to the generative AI model.

[0617] Prompt Sentence Examples

[0618] "Please list the necessary administrative procedures based on the following information: My new address is in Shinjuku-ku, Tokyo, and my old address is in Kita-ku, Osaka."

[0619] Acquiring and organizing procedural information

[0620] The generative AI model lists the necessary administrative procedures based on the prompt. For example, in the case of "moving," this includes procedures for moving out and in, mail forwarding, and utility bill transfer. In the case of "starting a new business," this includes business registration, incorporation notification, business start-up notification to the tax office, and obtaining a business license. The server analyzes the information received from the generative AI model and organizes it in a format that is easy for the user to understand.

[0621] Providing information to users

[0622] The server sends the organized procedure information and procedure list to the terminal, which then displays the received information to the user, allowing the user to check the list and understand the detailed explanation of each procedure and the necessary documents.

[0623] Progress management and follow-up

[0624] Each time a user performs a procedure and completes it, they can enter a completion report into the system. The server tracks this information and manages the progress of the procedure. If there are any incomplete procedures, the server sends a reminder to the user. The reminder is notified to the user by email, push notification, or other methods.

[0625] Specific examples

[0626] Specific examples of moving procedures

[0627] 1. The user logs in to the terminal and selects "Move." The terminal prompts the user to enter their old and new addresses. The user enters their new address (e.g., Shinjuku-ku, Tokyo) and their old address (e.g., Kita-ku, Osaka).

[0628] 2. The server uses the generation AI to create a list of procedures. The generation AI obtains the necessary procedures, such as moving-in and moving-out procedures for resident registration, mail forwarding procedures, and utility bill transfer procedures, and sends them to the server.

[0629] 3. The server organizes the procedure information and sends it to the terminal, which displays the procedure list and detailed instructions to the user.

[0630] 4. The user performs each step in sequence, entering a completion report into the system as they complete it. The server tracks their progress and reminds them of any remaining steps.

[0631] In this way, this system supports users in efficiently completing the necessary administrative procedures. By utilizing generative AI and obtaining the latest administrative procedure information in real time, the system always provides the latest information, allowing users to smoothly complete procedures.

[0632] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0633] Step 1:

[0634] The user logs in to the terminal. The terminal displays a login screen and the user enters authentication information (user name and password). The entered authentication information is sent from the terminal to the server. The server compares the authentication information with a database and returns the authentication result (success or failure) to the terminal. The terminal displays the authentication result to the user. If authentication is successful, the user can access the system.

[0635] Step 2:

[0636] The user selects a specific administrative procedure. The terminal displays a procedure selection screen for the user, such as "moving" or "starting a new business." When the user selects a procedure, the terminal sends the selected procedure information to the server. The server generates an information input form corresponding to the selected procedure and sends it to the terminal. The terminal displays the information input form to the user.

[0637] Step 3:

[0638] The user enters the necessary information into the information input form. The terminal prompts the user to enter information such as old and new addresses, industry, business size, and location. The information entered by the user is sent from the terminal to the server. The server saves the received information in a database. The terminal is notified that the save was successful.

[0639] Step 4:

[0640] The server launches the generative AI model. The server retrieves the user's input information stored in the database and generates a prompt based on that information. The generated prompt is sent to the generative AI model. The generative AI model creates a list of necessary administrative procedures based on the prompt and sends that list back to the server. The server analyzes the received list of procedures and temporarily stores it in the database.

[0641] Step 5:

[0642] The server organizes the procedure information and provides it to the user. The server formats the procedure list obtained from the generated AI model into a user-friendly format (e.g., JSON format) and sends it to the device. The device displays the procedure list and detailed explanation to the user. The user can check the list and explanation.

[0643] Step 6:

[0644] The user performs each procedure and reports the progress. The user performs each procedure in sequence and inputs a completion report into the system when completed. The terminal sends the completion report to the server. The server receives the completion report and records the progress of the procedure in a database. The server tracks the progress.

[0645] Step 7:

[0646] The server reminds the user of incomplete procedures. The server periodically checks the database and, if there are incomplete procedures, sends a reminder notification to the user. Reminder notifications are sent via email or push notification. The device displays the reminder to the user. The user checks the notification and is prompted to retry the incomplete procedures.

[0647] (Application example 1)

[0648] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0649] Existing systems for efficiently carrying out administrative procedures provide a function that lists the necessary procedures based on information entered by the user, but they lack procedure progress management and reminder functions specialized for the operation and management of physical stores. This poses a challenge, requiring time and effort, particularly when opening a new store or managing daily operations, making efficient operation difficult. Furthermore, there is a lack of means to obtain the latest administrative procedure information in real time or to centrally manage multiple procedures, making it difficult for users to grasp the progress of procedures.

[0650] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0651] In this invention, the server includes means for a user to input information necessary for administrative procedures, means for a generation AI to list the necessary procedures based on the input information, means for organizing the procedures listed by the generation AI and providing detailed explanations, means for tracking the user's progress and reminding them of incomplete procedures, and means for listing the procedures necessary for opening a store based on the user's industry, store location, and size, and managing the progress. This enables administrative procedures related to operating or opening a physical store to be carried out efficiently and smoothly, significantly reducing the user's workload.

[0652] The "means for users to input the information necessary to carry out administrative procedures" refers to an interface that allows users to provide specific information to a computer system that corresponds to their own situation.

[0653] "Means for the generation AI to list the necessary procedures based on the input information" refers to a function that analyzes the information provided by the user and automatically creates a list of the corresponding procedures based on that information.

[0654] "Means for organizing the procedures listed by the generation AI and providing detailed explanations" refers to a function that organizes information about the procedures listed by the generation AI into an easy-to-understand format and provides detailed explanations to the user about specific steps to perform the procedures, necessary documents, etc.

[0655] "Means to track user progress and remind users of incomplete procedures" refers to a function that monitors the progress of users when carrying out administrative procedures and automatically notifies users of incomplete procedures.

[0656] "A means of listing the procedures required to open a store based on the user's industry, store location, and size, and managing the progress" is a function in which the AI ​​generates a list of the procedures required to open a new store based on details such as the industry, store location, and size entered by the user, and manages the progress of those procedures.

[0657] "Means for the generating AI to obtain the latest administrative procedure information in real time" refers to the function that allows the generating AI to constantly collect the latest information on administrative procedures in real time via the Internet and related databases.

[0658] "A means of managing multiple administrative procedures in one place and making applications in a centralized manner" is a function that manages multiple procedures simultaneously, allowing users to perform all necessary procedures with a single application operation.

[0659] System program generation

[0660] This system is designed to help users carry out administrative procedures efficiently, and has functions specifically designed for new store openings and daily business management. The main components of the system are a user information input section, a procedure list generation section using AI, a detailed explanation section, a progress management section, and a reminder section. The main programs required to realize a system with these functions are as follows:

[0661] 1. User information input section

[0662] Users use devices such as smartphones and tablets to enter the information required for administrative procedures. This entered information is linked to the user's account and saved. Examples include information such as "opening a restaurant" and "Shinjuku Ward, Tokyo."

[0663] 2. Procedure list generation by generative AI

[0664] The server launches a generative AI based on the information entered by the user, and lists the necessary procedures. Using the generative AI model, the system obtains the latest administrative procedure information in real time and generates specific procedures according to the user's industry, location, and scale. For example, "applying for a food business license" or "notifying the fire department."

[0665] 3. Detailed explanation section

[0666] The AI ​​then organizes the procedural information it lists in a user-friendly format and provides detailed instructions, including specific steps, required documents, and related links. For example, the instructions might say, "To apply for a business license, you need the following documents..."

[0667] 4. Progress management department

[0668] When the user performs each procedure and completes it, they can report their progress to the system. Based on this report, the server tracks the user's progress and lists the procedures that have not yet been completed. This function makes it easy for the user to know which procedures have not yet been completed.

[0669] 5. Remind Section

[0670] The server automatically sends reminders to users about incomplete procedures or procedures that are approaching deadlines, for example, by email or push notification, reminding them that "the deadline for submitting a notification to the fire department is approaching."

[0671] Hardware and software used

[0672] Hardware: Smartphones, tablets

[0673] Software: SQLite (database management), smtplib (email sending), Python (scripting language)

[0674] Processing Description

[0675] The server uses SQLite to manage user and procedure information. The AI ​​generates the procedure list based on the information entered by the user on the device. It also uses smtplib to implement a function to send reminder emails.

[0676] Specific example explanation

[0677] For example, if a user selects "Opening a Restaurant" and enters the required address and business information, the AI ​​will automatically create a list of procedures such as "Applying for a Food Business License" and "Notifying the Fire Department." The progress can be checked within the app, and it is easy to see at a glance which procedures have been completed and which remain to be completed. In addition, reminder emails are sent, helping users to remember important procedures.

[0678] Specific examples of prompts to input to generative AI models

[0679] Please list the administrative procedures required to open a new store in the following industries:

[0680] Industry: Food and beverage

[0681] Store location: Shinjuku Ward, Tokyo

[0682] Scale: Small

[0683] Output formats:

[0684] 1. Procedure Name

[0685] 2. Where to apply

[0686] 3. Required documents

[0687] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0688] Step 1:

[0689] The user accesses the device and logs in to their account.

[0690] Specific behavior:

[0691] A user logs in to the application using a smartphone or tablet. They enter their username and password on the login screen and are authenticated. After successful authentication, the user data is loaded onto the device.

[0692] Input: Username, Password

[0693] Output: Authenticated user session

[0694] Step 2:

[0695] The user enters the information required to carry out administrative procedures.

[0696] Specific behavior:

[0697] After logging in, the user selects an option such as "Opening a new store" or "Daily business management." Next, a form is displayed for entering specific information such as the type of business, store location, and size. The user enters this information and presses the submit button.

[0698] Input: Information such as business type, store location, size, etc.

[0699] Output: The input information is saved in the database.

[0700] Step 3:

[0701] The server launches the generation AI based on the input information.

[0702] Specific behavior:

[0703] The server retrieves the information entered by the user from the database and sends a prompt to the generative AI model, which analyzes the prompt and lists the necessary steps to follow according to the user's request.

[0704] Input: Information entered by the user, prompts for the AI ​​generator

[0705] Output: List of required procedures

[0706] Step 4:

[0707] The generative AI organizes the procedures listed and provides detailed explanations.

[0708] Specific behavior:

[0709] The server organizes the list of procedures received from the generation AI and generates detailed explanations for each procedure, including necessary documents, application locations, and procedures, and provides them to the user in an easy-to-understand format.

[0710] Input: Procedure list from the generating AI

[0711] Output: Detailed instructions with organized procedures

[0712] Step 5:

[0713] Track your progress and remind you of any outstanding steps.

[0714] Specific behavior:

[0715] As users complete each step, they enter a completion report through their device. The server tracks the progress and updates the database. For any remaining steps, reminders are automatically generated and sent to users via email or push notification.

[0716] Input: User completion report, database progress information

[0717] Output: Reminders for outstanding procedures

[0718] Step 6:

[0719] The server uses a generative AI model to obtain the latest administrative procedure information in real time.

[0720] Specific behavior:

[0721] The server periodically calls the generative AI model to retrieve the latest administrative procedure information from the internet and relevant databases, ensuring that the information provided to users is up-to-date.

[0722] Input: Routine requests, administrative procedure information on the Internet

[0723] Output: Updated administrative procedure information

[0724] Step 7:

[0725] Multiple administrative procedures are managed in one place, and applications are submitted centrally.

[0726] Specific behavior:

[0727] The server provides the interface and functionality to allow users to manage and apply for multiple administrative procedures at once. Users can complete all related procedures at once by performing a single application.

[0728] Input: User's bulk application instructions

[0729] Output: Centralized application processing

[0730] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0731] This invention is a system that enables users to carry out administrative procedures efficiently, and also combines it with an emotion engine that recognizes the user's emotions to provide a more user-friendly interface. By recognizing emotions based on the user's input information and operation status, and automatically adjusting the system's behavior according to the emotions, the user experience is improved.

[0732] Overall system overview

[0733] User Input

[0734] First, the user accesses a terminal and logs in to the system. After logging in, the user selects an option such as "moving" or "starting a new business" and enters the necessary information (e.g., old and new addresses, industry, business size, location, etc.).

[0735] Server Processing

[0736] The server stores the information entered by the user in a database. Then, the server launches a generation AI to create a list of necessary procedures based on the entered information.

[0737] Acquiring and organizing procedural information

[0738] Based on the input information, the AI ​​generates a list of the latest administrative procedures. For example, in the case of moving, this includes procedures for moving out and in, mail forwarding, and utility bill transfer. In the case of starting a new business, this includes business registration, incorporation notification, business start-up notification to the tax office, and obtaining a business license. The server organizes the information from the AI ​​and provides it to the user in an easy-to-understand format.

[0739] Emotional Engine Adjustment

[0740] As the user operates the system, the emotion engine analyzes the user's input information and operation status in real time to recognize the user's emotions. For example, if the system determines that the user is feeling stressed, it can display an encouraging message to the user or provide simpler instructions on how to proceed. The server automatically adjusts how the procedure is carried out and how information is presented based on the information sent from the emotion engine.

[0741] Providing information to users

[0742] The organized procedure information and procedure list are sent to the terminal and displayed to the user, who can check the list and understand the detailed explanation of each procedure and the necessary documents.

[0743] Progress management and follow-up

[0744] Each time a user performs a procedure and completes it, they can enter a completion report into the system. The server tracks this information and manages the progress of the procedure. If there are any incomplete procedures, the server sends reminders to the user. If the emotion engine detects the user's anxiety or frustration, it can also provide supportive messages and advice on progress.

[0745] Specific examples

[0746] Specific examples of moving procedures

[0747] 1. The user logs in to the device and selects "Move"

[0748] The terminal prompts the user to enter their old and new addresses.

[0749] The user enters a new address (e.g., Shinjuku-ku, Tokyo) and an old address (e.g., Kita-ku, Osaka).

[0750] 2. The server uses a generative AI to list the procedures

[0751] The generation AI obtains the necessary procedures, such as moving-in and moving-out procedures for resident registration, mail forwarding procedures, and utility bill transfer procedures, and sends them to the server.

[0752] 3. The server organizes the procedure information and provides it to the user.

[0753] The server organizes the procedure information and sends it to the terminal.

[0754] The terminal displays the procedure list and detailed instructions to the user.

[0755] 4. The emotion engine recognizes and responds to user emotions

[0756] When a user inputs or performs an operation, the emotion engine recognizes the user's emotions in real time.

[0757] If the emotion engine detects the user's stress, the server will provide an encouraging message or simple operating instructions.

[0758] 5. The user performs the procedure and reports progress

[0759] The user executes each procedure in sequence and inputs a completion report into the system each time it is completed.

[0760] The server tracks your progress and reminds you of any outstanding steps.

[0761] Specific examples of procedures for starting a new business

[0762] 1. The user logs in to the device and selects "Start a new business."

[0763] The terminal asks the user to enter the industry, business size, and location.

[0764] The user enters the industry (e.g., food and beverage), business size (e.g., small scale), and location (e.g., Shinjuku-ku, Tokyo).

[0765] 2. The server uses a generative AI to list the procedures

[0766] The generation AI obtains the necessary procedures, such as business registration, incorporation notification, business start-up notification to the tax office, and obtaining a business license, and sends them to the server.

[0767] 3. The server organizes the procedure information and provides it to the user.

[0768] The server organizes the procedure information and sends it to the terminal.

[0769] The terminal displays the procedure list and detailed instructions to the user.

[0770] 4. The emotion engine recognizes and responds to user emotions

[0771] When a user inputs or performs an operation, the emotion engine recognizes the user's emotions in real time.

[0772] If the emotion engine detects the user's anxiety, the server will present appropriate advice or support messages.

[0773] 5. The user performs the procedure and reports progress

[0774] The user executes each procedure in sequence and inputs a completion report into the system each time it is completed.

[0775] The server tracks your progress and reminds you of any outstanding steps.

[0776] In this way, this system not only supports users in efficiently carrying out the necessary administrative procedures, but also provides a better user experience by utilizing an emotion engine to respond in a way that is adapted to the user's emotions.

[0777] The processing flow will be explained below.

[0778] When carrying out moving procedures

[0779] Step 1:

[0780] The user accesses the terminal and logs in to the system. After logging in, the user selects "Move" from the menu and enters their new and old addresses.

[0781] Step 2:

[0782] The server receives the user's input information (old and new addresses) and saves this information in a database. Once saved, the server starts the generation AI.

[0783] Step 3:

[0784] The server sends a request to the generation AI to list the necessary procedures based on the new and old address information entered by the user.

[0785] Step 4:

[0786] Based on the specified information, the generation AI creates a list of necessary procedures (e.g., moving-in / moving-out procedures for resident registration, mail forwarding procedures, utility bill transfer procedures, etc.) in real time. The listed information is then sent back to the server.

[0787] Step 5:

[0788] The server organizes the procedure list returned by the generation AI, including detailed instructions for each procedure, required documents, and procedure locations.

[0789] Step 6:

[0790] The server sends the organized procedure list to the terminal, which displays the procedure list and detailed instructions to the user.

[0791] Step 7:

[0792] The emotion engine analyzes the user's input information and operation status to recognize the user's emotions. For example, it can detect stress from actions such as typing quickly or repeatedly clicking the same button.

[0793] Step 8:

[0794] The server adjusts its response to the user based on the emotional data sent from the emotion engine. For example, if the user is feeling stressed, it will present an encouraging message or simple instructions for how to proceed.

[0795] Step 9:

[0796] The user performs the procedures and inputs a completion report into the system as each procedure is completed.

[0797] Step 10:

[0798] The server receives the completion report from the user and records the progress of the procedure in a database. If there are any incomplete procedures, the server sends appropriate reminder messages based on the emotion engine data.

[0799] When starting a new business

[0800] Step 1:

[0801] The user accesses the terminal and logs in to the system. After logging in, the user selects "Starting a new business" from the menu and enters the industry, business size, and location.

[0802] Step 2:

[0803] The server receives the user's input information (industry, business size, location) and stores this information in a database. Once the information is saved, the server launches the generation AI.

[0804] Step 3:

[0805] The server sends a request to the generation AI to list the necessary procedures based on the industry, business size, and location information entered by the user.

[0806] Step 4:

[0807] Based on the specified information, the generation AI creates a list of necessary procedures (e.g., business registration, incorporation notification, business start-up notification to the tax office, obtaining a business license, etc.) in real time. The listed information is then sent back to the server.

[0808] Step 5:

[0809] The server organizes the procedure list returned by the generation AI, including detailed instructions for each procedure, required documents, and procedure locations.

[0810] Step 6:

[0811] The server sends the organized procedure list to the terminal, which displays the procedure list and detailed instructions to the user.

[0812] Step 7:

[0813] The emotion engine analyzes the user's input information and operation status to recognize the user's emotions. For example, if the user takes a long time to input, it is assumed that the user is feeling anxious.

[0814] Step 8:

[0815] The server adjusts its response to the user based on the emotional data sent from the emotion engine. For example, if the user is feeling anxious, it will provide specific advice or a support message.

[0816] Step 9:

[0817] The user performs the procedures and inputs a completion report into the system as each procedure is completed.

[0818] Step 10:

[0819] The server receives the completion report from the user and records the progress of the procedure in a database. If there are any incomplete procedures, the server sends appropriate reminder messages based on the emotion engine data.

[0820] The above is the specific processing flow of the program when carrying out procedures for moving and starting a new business. This system allows users to complete administrative procedures efficiently, and by utilizing the emotion engine, it is possible to respond flexibly to the user's emotions.

[0821] Example 2

[0822] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0823] In modern society, administrative procedures are becoming increasingly complex, making it difficult for users to complete them appropriately. Furthermore, there are only a limited number of systems that can accommodate the different needs and emotional states of each user, creating a need for improved user experience. Conventional systems lack the ability to dynamically adjust to user operations and emotions, making it difficult to streamline procedures and provide a user-friendly interface.

[0824] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0825] In this invention, the server includes means for a user to input information necessary for performing administrative procedures, means for a generation AI to list the necessary procedures based on the input information, means for organizing the procedures listed by the generation AI and providing detailed explanations, means for tracking the user's progress and reminding the user of incomplete procedures, means for analyzing the user's input information and operation status in real time and recognizing the user's emotions with an emotion engine, and means for automatically adjusting the system behavior based on the recognized user emotions. This enables the user to perform administrative procedures appropriately and efficiently, and furthermore, a customized interface can be provided according to the user's emotions through the emotion engine.

[0826] "User" refers to an individual or organization that uses the system to carry out administrative procedures.

[0827] "Terminal" refers to a computing device that a user accesses and enters information into.

[0828] "Server" refers to the central processing unit that processes information input by the user and manages data in cooperation with the generative AI and emotion engine.

[0829] "Generative AI" refers to an artificial intelligence model that lists the necessary administrative procedures based on input data and generates detailed explanations.

[0830] "Input information" refers to data such as address, industry, and business size that users provide to the system via their terminal.

[0831] "Procedure list" refers to a list of administrative procedures that users must carry out, compiled by the generation AI based on input information.

[0832] An "emotion engine" is a software engine that analyzes the user's input information and operating conditions to recognize emotions and adjusts the system's behavior according to those emotions.

[0833] "Tracking" refers to the system monitoring and recording the progress of a user's administrative procedures.

[0834] "Remind" refers to notifying the user of incomplete procedures or procedures with an upcoming deadline.

[0835] "Real-time" refers to processing data immediately and reflecting results without delay.

[0836] The system is designed to help users efficiently complete administrative procedures. It uses a generative AI model to provide users with a list of necessary procedures. It also incorporates an emotion engine that recognizes the user's emotional state in real time and provides interfaces and support appropriate to that state.

[0837] Overall system overview

[0838] User input method

[0839] First, the user accesses the terminal and logs in to the system. On the login screen, they enter their ID and password for authentication. If authentication is successful, the dashboard screen is displayed.

[0840] After logging in, users select an administrative procedure such as "moving" or "starting a new business" and enter the necessary information such as their old and new addresses, industry, business size, and location.

[0841] Server processing means

[0842] The server stores the information entered by the user in a database, such as MySQL.

[0843] Next, the server launches a generative AI model (e.g., OpenAI GPT-4) and sends a prompt to the model. Examples of prompts include "Please list the procedures for moving" and "Please tell me the procedures required to start a new business."

[0844] The generative AI model lists the necessary administrative procedures based on the input information and returns the results to the server.

[0845] A means of obtaining and organizing procedural information

[0846] The server organizes the output from the generative AI model and creates a procedure list. The procedure information is converted into a data format (e.g., JSON) and provided to the user.

[0847] The organized procedure list is sent to the terminal and displayed in an easy-to-understand format for the user, along with detailed instructions for each procedure and the necessary documents.

[0848] Emotion engine adjustment method

[0849] When a user operates the terminal, the terminal collects operation data such as the user's input speed, cursor movement, and click frequency.

[0850] The emotion engine analyzes this data in real time to recognize the user's emotional state and automatically adjusts the system's behavior if the user is feeling stressed, anxious, or irritated.

[0851] For example, if the user is feeling stressed, the server can display an encouraging message or provide more convenient instructions on how to proceed.

[0852] Progress management and follow-up measures

[0853] As the user performs each step and completes it, they enter a completion report into the system, and the server tracks this information and manages the progress.

[0854] The server sends reminders to users when there are unfinished tasks, and if the emotion engine detects anxiety or frustration in the user, it provides supportive messages and advice on progress.

[0855] Specific use cases

[0856] For example, when a user performs moving procedures, the flow is as follows:

[0857] 1. The user logs in to the terminal and selects "Move." Enters the old and new address information.

[0858] 2. The server uses generated AI to create a list of procedures for moving out and in, mail forwarding, and utility bill transfer.

[0859] 3. The server organizes the procedure list and sends it to the terminal. The user checks the list and understands the detailed explanation of each procedure and the necessary documents.

[0860] 4. The user performs the procedure and enters the completion report into the system. The server tracks the progress and reminds the user of any incomplete procedures.

[0861] In this way, this system not only supports users in efficiently carrying out the necessary administrative procedures, but also provides a better user experience by utilizing an emotion engine to respond in a way that adapts to the user's emotions.

[0862] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0863] Step 1:

[0864] A user accesses a terminal and logs into the system

[0865] Input: The user enters the ID and password.

[0866] What happens: The device displays a user authentication screen and provides fields for entering user information. The user enters the required authentication information and clicks the "Login" button.

[0867] Output: The server checks the user information against the database, and if authentication is successful, displays the dashboard screen on the terminal.

[0868] Step 2:

[0869] The user selects an item and enters the required information.

[0870] Input: The user selects an option such as "moving" or "starting a new business" and enters the necessary information (old and new addresses, industry, business size, location).

[0871] Action: The device displays a list of choices and then displays an input form based on the user's selection. The user enters information and presses the "Submit" button.

[0872] Output: The information entered by the user is sent to the server.

[0873] Step 3:

[0874] The server stores the information entered by the user in a database

[0875] Input: Information submitted by the user.

[0876] Behavior: Before the server stores the received information in a database (e.g., MySQL), it checks the data for errors and performs some processing to ensure the save was successful.

[0877] Output: Returns a message to the user that the save was successful.

[0878] Step 4:

[0879] The server launches a generation AI that lists the necessary procedures based on the input information.

[0880] Input: User input information stored in the database.

[0881] How it works: The server launches a generative AI model (e.g., OpenAI GPT-4) and generates a prompt. The prompt might be something like, "Please list the procedures for moving" or "Please tell me the procedures required to start a new business." The prompt is then sent to the generative AI.

[0882] Output: The generating AI lists the necessary procedures and replies to the server.

[0883] Step 5:

[0884] The server organizes the information received from the generated AI

[0885] Input: A list of procedures listed by the generation AI.

[0886] What it does: The server organizes the received list into a comprehensible format, categorizing and sorting as needed, and converts it into a data format (e.g., JSON).

[0887] Output: Sends organized procedural information to the terminal.

[0888] Step 6:

[0889] The terminal displays a list of procedures to the user.

[0890] Input: Organized procedural information sent from the server.

[0891] Operation: The device interprets the received data and displays a list of procedures and detailed instructions to the user. It also displays detailed instructions for each procedure and a list of required documents.

[0892] Output: An interface is provided for the user to confirm the procedure and proceed to the next step.

[0893] Step 7:

[0894] The emotion engine analyzes user input and operation status in real time.

[0895] Input: Operational data such as user typing speed, cursor movement, and click frequency.

[0896] Operation: The device collects these operation data and sends them to the emotion engine, which analyzes the data and recognizes the user's emotional state.

[0897] Output: The recognized emotional state is sent to the server.

[0898] Step 8:

[0899] The server adjusts the system's behavior based on the results of the emotion engine.

[0900] Input: The user's emotional state sent from the emotion engine.

[0901] Operation: The server receives the results of the emotion engine and determines the behavior of the system based on the user's emotional state. For example, if a user is feeling stressed, it may display an encouraging message or simplify the procedure.

[0902] Output: The device displays encouraging messages and simple operating instructions to the user.

[0903] Step 9:

[0904] The user performs a procedure and reports progress to the system

[0905] Input: Report information when the user completes the procedure.

[0906] How it works: The device receives a completion report from the user and sends it to the server, which stores the information in a database and tracks the progress.

[0907] Output: The server updates the progress and sends a reminder message to the user if there are any outstanding transactions.

[0908] Step 10:

[0909] The server sends reminders and support messages to the user

[0910] Input: Server-tracked procedural progress and user emotional state.

[0911] How it works: The server manages outstanding tasks and sends reminders when deadlines are approaching. If it detects user anxiety or frustration based on information from the emotion engine, it provides support messages and advice.

[0912] Output: The device displays a reminder or support message to the user.

[0913] (Application example 2)

[0914] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0915] Conventional systems require users to perform complex operations when carrying out specific procedures in stores, which can cause stress and frustration. Furthermore, because the system responds uniformly without considering the user's feelings, it is difficult to respond to individual needs. As a result, improving the user experience has been a challenge.

[0916] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0917] In this invention, the server includes: means for a user to input information necessary for a specific procedure; means for a generation AI to list the necessary procedures based on the input information; means for organizing the procedures listed by the generation AI and providing detailed explanations; means including an emotion engine that recognizes the user's emotions and adjusts the system's behavior in response to the emotions; and means for tracking the user's progress and reminding the user of incomplete procedures. This reduces the stress and anxiety felt by the user and enables efficient and user-friendly procedures.

[0918] The "means for a user to input information necessary for carrying out a specific procedure" is an interface that allows a user to input data necessary for achieving a specific purpose into the system.

[0919] "Means for the generation AI to list the necessary procedures based on the input information" refers to a function in which the generation AI automatically generates a list of related procedures and tasks based on the information input by the user.

[0920] "Means for organizing the procedures listed by the generation AI and providing detailed explanations" refers to a function that organizes the procedure list created by the generation AI in an easy-to-understand manner and provides specific and detailed explanations of its contents.

[0921] "Means including an emotion engine that recognizes the user's emotions and adjusts the system's behavior in accordance with the emotions" refers to a function that analyzes the user's emotions in real time from the information input by the user and the operating situation, and dynamically adjusts the system's behavior and display content based on the recognized emotions.

[0922] "Means to track user progress and remind users of incomplete procedures" is a function that tracks the progress of procedures the user is performing and automatically notifies the user of procedures that have not been completed.

[0923] System configuration and processing flow

[0924] 1. User Input Method

[0925] A user first logs into the system using a device such as a smartphone or smart glasses. After logging in, the user enters the information required to perform a specific procedure, such as a product search or service reservation. This information is data necessary for the user to achieve a specific purpose.

[0926] 2. Procedure listing using generative AI

[0927] The server collects information entered by the user and activates a generative AI model. This generative AI model (e.g., GPT-4 model) automatically generates a list of necessary procedures and tasks. During this process, a function is implemented to obtain the latest procedure information in real time based on the entered information.

[0928] 3. Organizing and explaining procedural information

[0929] The procedures listed by the AI ​​are organized in an easy-to-understand manner by the server. This procedure information is provided to the user's device along with detailed explanations. By referring to this, the user can understand the specific content and methods of the procedure.

[0930] 4. Emotional Engine Adjustment

[0931] When a user inputs information or performs an operation, the server activates the emotion engine. The emotion engine analyzes the user's input information and operation status in real time and recognizes the user's emotions. For example, if the user is feeling stressed, the device can display an encouraging message or a simple operation guide, improving user usability.

[0932] 5. Progress Tracking and Reminders

[0933] As the user completes each step, their progress is tracked by the server, and if there are any incomplete steps, the server automatically sends reminders to the user, helping them remember to complete the steps.

[0934] Specific examples

[0935] scenario

[0936] A customer is searching for a specific product in a physical store but is frustrated by long lines.

[0937] 1. The user logs in to the in-store terminal and selects "Product Search"

[0938] The terminal prompts the user to input the name of the product to be searched for.

[0939] The user enters "alcoholic beverages."

[0940] 2. The server uses a generative AI to list the procedures

[0941] The generative AI model obtains a list of products related to "alcoholic beverages" and sends it to the server.

[0942] 3. The server organizes the procedure information and provides it to the user.

[0943] The server organizes the procedure information and sends it to the terminal along with a detailed product description.

[0944] The terminal displays the product list and detailed descriptions to the user.

[0945] 4. The emotion engine recognizes and responds to user emotions

[0946] The emotion engine detects the user's stress, and the server displays an encouraging message.

[0947] 5. The user performs the procedure and reports progress

[0948] The user selects a product and completes the purchase process.

[0949] The server tracks the progress and assists until the procedure is completed.

[0950] Prompt Sentence Examples

[0951] After logging in to the system, press the "Product Search" button and enter "alcoholic beverages." If you feel stressed, enter "I'm frustrated by the long lines," and the system will take measures to alleviate your stress.

[0952] Hardware and software used

[0953] Hardware: Smartphones, smart glasses, servers

[0954] Software: Python, TensorFlow, GPT-4 model

[0955] Data processing details

[0956] 1. Data input: Input data from the user is collected on the terminal and sent to the server.

[0957] 2. Use of generative AI model: The server launches the GPT-4 model using the Python library and generates procedures based on user input.

[0958] 3. Emotion recognition: The emotion recognition model built using TensorFlow analyzes the user's input information and operation status in real time to recognize emotions.

[0959] 4. Data provision: Provide organized procedural information and messages corresponding to the user's emotions to the terminal.

[0960] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0961] Step 1: The user logs in to the system using a smartphone or smart glasses.

[0962] Input: Login information (user ID, password).

[0963] Specific operation: The terminal displays the login screen, and the user enters their ID and password. The entered information is sent to the server, where authentication is performed.

[0964] Output: A successful login message and the main menu screen.

[0965] Step 2: The user selects a specific procedure and enters the required information.

[0966] Input: Type of procedure (product search, service reservation, etc.), specific required information (product name, desired date and time, etc.).

[0967] Specific operation: The terminal displays the procedure selection screen, the user selects a procedure, and enters the required information. The input information is sent to the server.

[0968] Output: Input confirmation message and detailed input screen are displayed.

[0969] Step 3: The server uses the generative AI model to create a list of procedures.

[0970] Input: Information entered by the user.

[0971] How it works: The server uses Python and the GPT-4 model to generate relevant procedures and tasks based on the input information.

[0972] Output: A procedure list to send to the user's terminal.

[0973] Step 4: Organize the server-generated procedure list and provide detailed explanations.

[0974] Input: Procedural information listed by the generating AI.

[0975] Specific operation: The server organizes the procedure list, adds detailed instructions, and sends it to the user's terminal.

[0976] Output: Organized procedural information and detailed instructions.

[0977] Step 5: When the user inputs or performs an operation, the server activates the emotion engine and recognizes the user's emotion.

[0978] Input: User operation information, facial expression data, and voice input.

[0979] Specific operation: The emotion recognition model (using TensorFlow) analyzes the user's input information and operation status in real time to determine emotions.

[0980] Output: User's emotional state (e.g., stressed, excited, calm).

[0981] Step 6: The server adjusts the system behavior based on the emotion engine results and provides an appropriate message.

[0982] Input: User's emotional state information.

[0983] Specific operation: When the emotion engine recognizes a stressful state, it generates a message of encouragement or operational guidance and sends it to the user's device.

[0984] Output: Message display according to emotion.

[0985] Step 7: The user performs the procedure and reports its progress to the server.

[0986] Input: Procedure status information (completed, incomplete).

[0987] What it does: As the user completes each step, the device sends that information to the server, which tracks their progress.

[0988] Output: Progress updates, reminders of outstanding procedures.

[0989] In this way, appropriate data processing and calculations are performed based on input information at each processing step, and the entire system is designed to function smoothly.

[0990] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0991] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0992] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0993] [Third embodiment]

[0994] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0995] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0996] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0997] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0998] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0999] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1000] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1001] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1002] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1003] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1004] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1005] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1006] This invention is a system that enables users to efficiently complete administrative procedures. The user inputs the information necessary to complete the administrative procedure, and a generation AI lists the necessary procedures based on the input information and provides them to the user. The system also includes a function to track the user's progress and remind them of any incomplete procedures.

[1007] Overall system overview

[1008] User Input

[1009] First, the user accesses the terminal and logs in to the system with their account. After logging in, the user selects an option such as "moving" or "starting a new business" and enters the necessary information (e.g., old and new addresses, industry, business size, location, etc.).

[1010] Server Processing

[1011] The server stores the information entered by the user in a database. Then, the server launches a generation AI to create a list of necessary procedures based on the entered information.

[1012] Acquiring and organizing procedural information

[1013] Based on the input information, the AI ​​generates a list of the latest administrative procedures. For example, in the case of moving, this includes procedures for moving out and in, mail forwarding, and utility bill transfer. In the case of starting a new business, this includes business registration, incorporation notification, business start-up notification to the tax office, and obtaining a business license. The server organizes the information from the AI ​​and provides it to the user in an easy-to-understand format.

[1014] Providing information to users

[1015] The organized procedure information and procedure list are sent to the terminal and displayed to the user, who can check the list and understand the detailed explanation of each procedure and the necessary documents.

[1016] Progress management and follow-up

[1017] Each time a user performs a procedure and completes it, they can enter a completion report into the system. The server tracks this information and manages the progress of the procedure. If there are any incomplete procedures, the server sends reminders to the user.

[1018] Specific examples

[1019] Specific examples of moving procedures

[1020] 1. The user logs in to the device and selects "Move"

[1021] The terminal prompts the user to enter their old and new addresses.

[1022] The user enters a new address (e.g., Shinjuku-ku, Tokyo) and an old address (e.g., Kita-ku, Osaka).

[1023] 2. The server uses a generative AI to list the procedures

[1024] The generation AI obtains the necessary procedures, such as moving-in and moving-out procedures for resident registration, mail forwarding procedures, and utility bill transfer procedures, and sends them to the server.

[1025] 3. The server organizes the procedure information and provides it to the user.

[1026] The server organizes the procedure information and sends it to the terminal.

[1027] The terminal displays the procedure list and detailed instructions to the user.

[1028] 4. The user performs the procedure and reports progress

[1029] The user executes each procedure in sequence and inputs a completion report into the system each time it is completed.

[1030] The server tracks your progress and reminds you of any outstanding steps.

[1031] Specific examples of procedures for starting a new business

[1032] 1. The user logs in to the device and selects "Start a new business."

[1033] The terminal asks the user to enter the industry, business size, and location.

[1034] The user enters the industry (e.g., food and beverage), business size (e.g., small scale), and location (e.g., Shinjuku-ku, Tokyo).

[1035] 2. The server uses a generative AI to list the procedures

[1036] The generation AI obtains the necessary procedures, such as business registration, incorporation notification, business start-up notification to the tax office, and obtaining a business license, and sends them to the server.

[1037] 3. The server organizes the procedure information and provides it to the user.

[1038] The server organizes the procedure information and sends it to the terminal.

[1039] The terminal displays the procedure list and detailed instructions to the user.

[1040] 4. The user performs the procedure and reports progress

[1041] The user executes each procedure in sequence and inputs a completion report into the system each time it is completed.

[1042] The server tracks your progress and reminds you of any outstanding steps.

[1043] In this way, this system supports users in efficiently completing the necessary administrative procedures. By utilizing generative AI to obtain the latest administrative procedure information in real time, the system always provides the latest information, allowing users to smoothly complete procedures.

[1044] The processing flow will be explained below.

[1045] When carrying out moving procedures

[1046] Step 1:

[1047] The user accesses the terminal and logs in to the system. After logging in, the user selects the "move" item from the menu and enters the new address and old address.

[1048] Step 2:

[1049] The server receives the user's input information (old and new addresses) and saves this information in a database. Once saved, the server starts the generation AI.

[1050] Step 3:

[1051] The server sends a request to the generated AI to list the necessary procedures based on the new and old address information entered by the user.

[1052] Step 4:

[1053] Based on the specified information, the generation AI creates a list of necessary procedures (e.g., moving-in / moving-out procedures for resident registration, mail forwarding procedures, utility bill transfer procedures, etc.) in real time. The listed information is then sent back to the server.

[1054] Step 5:

[1055] The server organizes the procedure list returned by the generation AI, including detailed instructions for each procedure, required documents, and procedure locations.

[1056] Step 6:

[1057] The server sends the organized procedure list to the terminal, which displays the procedure list and detailed instructions to the user.

[1058] Step 7:

[1059] The user checks the displayed list of procedures and executes each procedure in order. Each time a procedure is completed, the user inputs information to report the completion of the procedure into the system.

[1060] Step 8:

[1061] The server receives the completion report from the user and records the progress of the procedure in a database. If there are any incomplete procedures, the server sends a reminder to the user.

[1062] When starting a new business

[1063] Step 1:

[1064] The user accesses the terminal and logs in to the system. After logging in, the user selects the "Start a new business" item from the menu and enters the industry, business size, and location.

[1065] Step 2:

[1066] The server receives the user's input information (industry, business size, location) and stores this information in a database. Once the information is saved, the server launches the generation AI.

[1067] Step 3:

[1068] The server sends a request to the generation AI to list the necessary procedures based on the industry, business size, and location information entered by the user.

[1069] Step 4:

[1070] Based on the specified information, the generation AI creates a list of necessary procedures (e.g., business registration, incorporation notification, business start-up notification to the tax office, obtaining a business license, etc.) in real time. The listed information is then sent back to the server.

[1071] Step 5:

[1072] The server organizes the procedure list returned by the generation AI, including detailed instructions for each procedure, required documents, and procedure locations.

[1073] Step 6:

[1074] The server sends the organized procedure list to the terminal, which displays the procedure list and detailed instructions to the user.

[1075] Step 7:

[1076] The user checks the displayed list of procedures and executes each procedure in order. Each time a procedure is completed, the user inputs information to report the completion of the procedure into the system.

[1077] Step 8:

[1078] The server receives the completion report from the user and records the progress of the procedure in a database. If there are any incomplete procedures, the server sends a reminder to the user.

[1079] The above is the specific processing flow of the program when carrying out procedures for moving and starting a new business. This system allows users to complete administrative procedures efficiently.

[1080] Example 1

[1081] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1082] Current administrative procedures are complex, and it takes time and effort for users to find the necessary procedures and carry them out sequentially. Furthermore, when there are multiple procedures, it is difficult to track the progress of each. Furthermore, because procedure information is frequently updated, it is difficult to obtain the latest information in real time.

[1083] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1084] In this invention, the server includes means for a user to select a specific administrative procedure and input the necessary information, means for storing the input information in a database and sending prompts to a generative AI model to list the necessary procedures, means for analyzing the procedures listed by the generative AI model and providing detailed explanations, and means for tracking the user's progress and reminding the user of incomplete procedures, allowing the user to efficiently complete the necessary administrative procedures and obtain the latest procedural information in real time.

[1085] A "user" is an individual or legal entity that accesses the system, selects a particular administrative procedure, and enters the required information.

[1086] A "terminal" is an electronic device used by a user to enter information into and view information in a system. Examples include personal computers and smartphones.

[1087] The "server" is a networked computer system that receives information submitted by users, uses a generative AI model to list the necessary steps, and tracks progress.

[1088] A "generative AI model" is software equipped with artificial intelligence technology that lists the necessary administrative procedures based on user input information and obtains the latest information in real time.

[1089] A "prompt" is textual contextual information used to input specific conditions or instructions to a generative AI model.

[1090] A "database" is a digital data storage system used to store and later reference information entered by a user.

[1091] "Remind" is a function that notifies the user of incomplete procedures and calls for attention to complete the procedures.

[1092] A "procedure list" is a list of specific administrative procedures that a user must carry out, as listed by a generative AI model.

[1093] "Progress" is information that indicates the status of the user's administrative procedures, including which procedures have been completed and which procedures remain to be completed.

[1094] "A means of making applications in a centralized manner" is a function that allows multiple different administrative procedures to be managed in one place and allows applications to be made efficiently all at once.

[1095] This invention is a system that allows users to efficiently carry out administrative procedures. This system includes a terminal, a server, and a generative AI model, and each module works in cooperation to simplify complex administrative procedures.

[1096] User Input

[1097] First, users access a terminal and log in to the system with their account. After logging in, the terminal provides an interface for users to select specific administrative procedures such as "moving" or "starting a new business." Users then enter the necessary information, such as their old and new addresses, industry, business size, and location.

[1098] Server Processing

[1099] The server stores the information sent by the user in a database. An example of a database is an SQL database (e.g., MySQL or PostgreSQL). Next, the server starts a generative AI model (e.g., OpenAI's GPT-4), generates a prompt sentence based on the input information, and sends it to the generative AI model.

[1100] Prompt Sentence Examples

[1101] "Please list the necessary administrative procedures based on the following information: My new address is in Shinjuku-ku, Tokyo, and my old address is in Kita-ku, Osaka."

[1102] Acquiring and organizing procedural information

[1103] The generative AI model lists the necessary administrative procedures based on the prompt. For example, in the case of "moving," this includes procedures for moving out and in, mail forwarding, and utility bill transfer. In the case of "starting a new business," this includes business registration, incorporation notification, business start-up notification to the tax office, and obtaining a business license. The server analyzes the information received from the generative AI model and organizes it in a format that is easy for the user to understand.

[1104] Providing information to users

[1105] The server sends the organized procedure information and procedure list to the terminal, which then displays the received information to the user, allowing the user to check the list and understand the detailed explanation of each procedure and the necessary documents.

[1106] Progress management and follow-up

[1107] Each time a user performs a procedure and completes it, they can enter a completion report into the system. The server tracks this information and manages the progress of the procedure. If there are any incomplete procedures, the server sends a reminder to the user. The reminder is notified to the user by email, push notification, or other methods.

[1108] Specific examples

[1109] Specific examples of moving procedures

[1110] 1. The user logs in to the terminal and selects "Move." The terminal prompts the user to enter their old and new addresses. The user enters their new address (e.g., Shinjuku-ku, Tokyo) and their old address (e.g., Kita-ku, Osaka).

[1111] 2. The server uses the generation AI to create a list of procedures. The generation AI obtains the necessary procedures, such as moving-in and moving-out procedures for resident registration, mail forwarding procedures, and utility bill transfer procedures, and sends them to the server.

[1112] 3. The server organizes the procedure information and sends it to the terminal, which displays the procedure list and detailed instructions to the user.

[1113] 4. The user performs each step in sequence, entering a completion report into the system as they complete it. The server tracks their progress and reminds them of any remaining steps.

[1114] In this way, this system supports users in efficiently completing the necessary administrative procedures. By utilizing generative AI and obtaining the latest administrative procedure information in real time, the system always provides the latest information, allowing users to smoothly complete procedures.

[1115] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1116] Step 1:

[1117] The user logs in to the terminal. The terminal displays a login screen and the user enters authentication information (user name and password). The entered authentication information is sent from the terminal to the server. The server compares the authentication information with a database and returns the authentication result (success or failure) to the terminal. The terminal displays the authentication result to the user. If authentication is successful, the user can access the system.

[1118] Step 2:

[1119] The user selects a specific administrative procedure. The terminal displays a procedure selection screen for the user, such as "moving" or "starting a new business." When the user selects a procedure, the terminal sends the selected procedure information to the server. The server generates an information input form corresponding to the selected procedure and sends it to the terminal. The terminal displays the information input form to the user.

[1120] Step 3:

[1121] The user enters the necessary information into the information input form. The terminal prompts the user to enter information such as old and new addresses, industry, business size, and location. The information entered by the user is sent from the terminal to the server. The server saves the received information in a database. The terminal is notified that the save was successful.

[1122] Step 4:

[1123] The server launches the generative AI model. The server retrieves the user's input information stored in the database and generates a prompt based on that information. The generated prompt is sent to the generative AI model. The generative AI model creates a list of necessary administrative procedures based on the prompt and sends that list back to the server. The server analyzes the received list of procedures and temporarily stores it in the database.

[1124] Step 5:

[1125] The server organizes the procedure information and provides it to the user. The server formats the procedure list obtained from the generated AI model into a user-friendly format (e.g., JSON format) and sends it to the device. The device displays the procedure list and detailed explanation to the user. The user can check the list and explanation.

[1126] Step 6:

[1127] The user performs each procedure and reports the progress. The user performs each procedure in sequence and inputs a completion report into the system when completed. The terminal sends the completion report to the server. The server receives the completion report and records the progress of the procedure in a database. The server tracks the progress.

[1128] Step 7:

[1129] The server reminds the user of incomplete procedures. The server periodically checks the database and, if there are incomplete procedures, sends a reminder notification to the user. Reminder notifications are sent via email or push notification. The device displays the reminder to the user. The user checks the notification and is prompted to retry the incomplete procedures.

[1130] (Application example 1)

[1131] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1132] Existing systems for efficiently carrying out administrative procedures provide a function that lists the necessary procedures based on information entered by the user, but they lack procedure progress management and reminder functions specialized for the operation and management of physical stores. This poses a challenge, requiring time and effort, particularly when opening a new store or managing daily operations, making efficient operation difficult. Furthermore, there is a lack of means to obtain the latest administrative procedure information in real time or to centrally manage multiple procedures, making it difficult for users to grasp the progress of procedures.

[1133] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1134] In this invention, the server includes means for a user to input information necessary for administrative procedures, means for a generation AI to list the necessary procedures based on the input information, means for organizing the procedures listed by the generation AI and providing detailed explanations, means for tracking the user's progress and reminding them of incomplete procedures, and means for listing the procedures necessary for opening a store based on the user's industry, store location, and size, and managing the progress. This enables administrative procedures related to operating or opening a physical store to be carried out efficiently and smoothly, significantly reducing the user's workload.

[1135] The "means for users to input the information necessary to carry out administrative procedures" refers to an interface that allows users to provide specific information to a computer system that corresponds to their own situation.

[1136] "Means for the generation AI to list the necessary procedures based on the input information" refers to a function that analyzes the information provided by the user and automatically creates a list of the corresponding procedures based on that information.

[1137] "Means for organizing the procedures listed by the generation AI and providing detailed explanations" refers to a function that organizes information about the procedures listed by the generation AI into an easy-to-understand format and provides detailed explanations to the user about specific steps to perform the procedures, necessary documents, etc.

[1138] "Means to track user progress and remind users of incomplete procedures" refers to a function that monitors the progress of users when carrying out administrative procedures and automatically notifies users of incomplete procedures.

[1139] "A means of listing the procedures required to open a store based on the user's industry, store location, and size, and managing the progress" is a function in which the AI ​​generates a list of the procedures required to open a new store based on details such as the industry, store location, and size entered by the user, and manages the progress of those procedures.

[1140] "Means for the generating AI to obtain the latest administrative procedure information in real time" refers to the function that allows the generating AI to constantly collect the latest information on administrative procedures in real time via the Internet and related databases.

[1141] "A means of managing multiple administrative procedures in one place and making applications in a centralized manner" is a function that manages multiple procedures simultaneously, allowing users to perform all necessary procedures with a single application operation.

[1142] System program generation

[1143] This system is designed to help users carry out administrative procedures efficiently, and has functions specifically designed for new store openings and daily business management. The main components of the system are a user information input section, a procedure list generation section using AI, a detailed explanation section, a progress management section, and a reminder section. The main programs required to realize a system with these functions are as follows:

[1144] 1. User information input section

[1145] Users use devices such as smartphones and tablets to enter the information required for administrative procedures. This entered information is linked to the user's account and saved. Examples include information such as "opening a restaurant" and "Shinjuku Ward, Tokyo."

[1146] 2. Procedure list generation by generative AI

[1147] The server launches a generative AI based on the information entered by the user, and lists the necessary procedures. Using the generative AI model, the system obtains the latest administrative procedure information in real time and generates specific procedures according to the user's industry, location, and scale. For example, "applying for a food business license" or "notifying the fire department."

[1148] 3. Detailed explanation section

[1149] The AI ​​then organizes the procedural information it lists in a user-friendly format and provides detailed instructions, including specific steps, required documents, and related links. For example, the instructions might say, "To apply for a business license, you need the following documents..."

[1150] 4. Progress management department

[1151] When the user performs each procedure and completes it, they can report their progress to the system. Based on this report, the server tracks the user's progress and lists the procedures that have not yet been completed. This function makes it easy for the user to know which procedures have not yet been completed.

[1152] 5. Remind Section

[1153] The server automatically sends reminders to users about incomplete procedures or procedures that are approaching deadlines, for example, by email or push notification, reminding them that "the deadline for submitting a notification to the fire department is approaching."

[1154] Hardware and software used

[1155] Hardware: Smartphones, tablets

[1156] Software: SQLite (database management), smtplib (email sending), Python (scripting language)

[1157] Processing Description

[1158] The server uses SQLite to manage user and procedure information. The AI ​​generates the procedure list based on the information entered by the user on the device. It also uses smtplib to implement a function to send reminder emails.

[1159] Specific example explanation

[1160] For example, if a user selects "Opening a Restaurant" and enters the required address and business information, the AI ​​will automatically create a list of procedures such as "Applying for a Food Business License" and "Notifying the Fire Department." The progress can be checked within the app, and it is easy to see at a glance which procedures have been completed and which remain to be completed. In addition, reminder emails are sent, helping users to remember important procedures.

[1161] Specific examples of prompts to input to generative AI models

[1162] Please list the administrative procedures required to open a new store in the following industries:

[1163] Industry: Food and beverage

[1164] Store location: Shinjuku Ward, Tokyo

[1165] Scale: Small

[1166] Output formats:

[1167] 1. Procedure Name

[1168] 2. Where to apply

[1169] 3. Required documents

[1170] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1171] Step 1:

[1172] The user accesses the device and logs in to their account.

[1173] Specific behavior:

[1174] A user logs in to the application using a smartphone or tablet. They enter their username and password on the login screen and are authenticated. After successful authentication, the user data is loaded onto the device.

[1175] Input: Username, Password

[1176] Output: Authenticated user session

[1177] Step 2:

[1178] The user enters the information required to carry out administrative procedures.

[1179] Specific behavior:

[1180] After logging in, the user selects an option such as "Opening a new store" or "Daily business management." Next, a form is displayed for entering specific information such as the type of business, store location, and size. The user enters this information and presses the submit button.

[1181] Input: Information such as business type, store location, size, etc.

[1182] Output: The input information is saved in the database.

[1183] Step 3:

[1184] The server launches the generation AI based on the input information.

[1185] Specific behavior:

[1186] The server retrieves the information entered by the user from the database and sends a prompt to the generative AI model, which analyzes the prompt and lists the necessary steps to follow according to the user's request.

[1187] Input: Information entered by the user, prompts for the AI ​​generator

[1188] Output: List of required procedures

[1189] Step 4:

[1190] The generative AI organizes the procedures listed and provides detailed explanations.

[1191] Specific behavior:

[1192] The server organizes the list of procedures received from the generation AI and generates detailed explanations for each procedure, including necessary documents, application locations, and procedures, and provides them to the user in an easy-to-understand format.

[1193] Input: Procedure list from the generating AI

[1194] Output: Detailed instructions with organized procedures

[1195] Step 5:

[1196] Track your progress and remind you of any outstanding steps.

[1197] Specific behavior:

[1198] As users complete each step, they enter a completion report through their device. The server tracks the progress and updates the database. For any remaining steps, reminders are automatically generated and sent to users via email or push notification.

[1199] Input: User completion report, database progress information

[1200] Output: Reminders for outstanding procedures

[1201] Step 6:

[1202] The server uses a generative AI model to obtain the latest administrative procedure information in real time.

[1203] Specific behavior:

[1204] The server periodically calls the generative AI model to retrieve the latest administrative procedure information from the internet and relevant databases, ensuring that the information provided to users is up-to-date.

[1205] Input: Routine requests, administrative procedure information on the Internet

[1206] Output: Updated administrative procedure information

[1207] Step 7:

[1208] Multiple administrative procedures are managed in one place, and applications are submitted centrally.

[1209] Specific behavior:

[1210] The server provides the interface and functionality to allow users to manage and apply for multiple administrative procedures at once. Users can complete all related procedures at once by performing a single application.

[1211] Input: User's bulk application instructions

[1212] Output: Centralized application processing

[1213] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1214] This invention is a system that enables users to carry out administrative procedures efficiently, and also combines it with an emotion engine that recognizes the user's emotions to provide a more user-friendly interface. By recognizing emotions based on the user's input information and operation status, and automatically adjusting the system's behavior according to the emotions, the user experience is improved.

[1215] Overall system overview

[1216] User Input

[1217] First, the user accesses a terminal and logs in to the system. After logging in, the user selects an option such as "moving" or "starting a new business" and enters the necessary information (e.g., old and new addresses, industry, business size, location, etc.).

[1218] Server Processing

[1219] The server stores the information entered by the user in a database. Then, the server launches a generation AI to create a list of necessary procedures based on the entered information.

[1220] Acquiring and organizing procedural information

[1221] Based on the input information, the AI ​​generates a list of the latest administrative procedures. For example, in the case of moving, this includes procedures for moving out and in, mail forwarding, and utility bill transfer. In the case of starting a new business, this includes business registration, incorporation notification, business start-up notification to the tax office, and obtaining a business license. The server organizes the information from the AI ​​and provides it to the user in an easy-to-understand format.

[1222] Emotional engine regulation

[1223] As the user operates the system, the emotion engine analyzes the user's input information and operation status in real time to recognize the user's emotions. For example, if the system determines that the user is feeling stressed, it can display an encouraging message to the user or provide simpler instructions on how to proceed. The server automatically adjusts how the procedure is carried out and how information is presented based on the information sent from the emotion engine.

[1224] Providing information to users

[1225] The organized procedure information and procedure list are sent to the terminal and displayed to the user, who can check the list and understand the detailed explanation of each procedure and the necessary documents.

[1226] Progress management and follow-up

[1227] Each time a user performs a procedure and completes it, they can enter a completion report into the system. The server tracks this information and manages the progress of the procedure. If there are any incomplete procedures, the server sends reminders to the user. If the emotion engine detects the user's anxiety or frustration, it can also provide supportive messages and advice on progress.

[1228] Specific examples

[1229] Specific examples of moving procedures

[1230] 1. The user logs in to the device and selects "Move"

[1231] The terminal prompts the user to enter their old and new addresses.

[1232] The user enters a new address (e.g., Shinjuku-ku, Tokyo) and an old address (e.g., Kita-ku, Osaka).

[1233] 2. The server uses a generative AI to list the procedures

[1234] The generation AI obtains the necessary procedures, such as moving-in and moving-out procedures for resident registration, mail forwarding procedures, and utility bill transfer procedures, and sends them to the server.

[1235] 3. The server organizes the procedure information and provides it to the user.

[1236] The server organizes the procedure information and sends it to the terminal.

[1237] The terminal displays the procedure list and detailed instructions to the user.

[1238] 4. The emotion engine recognizes and responds to user emotions

[1239] When a user inputs or performs an operation, the emotion engine recognizes the user's emotions in real time.

[1240] If the emotion engine detects the user's stress, the server will present encouraging messages and simple operating instructions.

[1241] 5. The user performs the procedure and reports progress

[1242] The user executes each procedure in sequence and inputs a completion report into the system each time it is completed.

[1243] The server tracks your progress and reminds you of any outstanding steps.

[1244] Specific examples of procedures for starting a new business

[1245] 1. The user logs in to the device and selects "Start a new business."

[1246] The terminal asks the user to enter the industry, business size, and location.

[1247] The user enters the industry (e.g., food and beverage), business size (e.g., small scale), and location (e.g., Shinjuku-ku, Tokyo).

[1248] 2. The server uses a generative AI to list the procedures

[1249] The generation AI obtains the necessary procedures, such as business registration, incorporation notification, business start-up notification to the tax office, and obtaining a business license, and sends them to the server.

[1250] 3. The server organizes the procedure information and provides it to the user.

[1251] The server organizes the procedure information and sends it to the terminal.

[1252] The terminal displays the procedure list and detailed instructions to the user.

[1253] 4. The emotion engine recognizes and responds to user emotions

[1254] When a user inputs or performs an operation, the emotion engine recognizes the user's emotions in real time.

[1255] If the emotion engine detects the user's anxiety, the server will present appropriate advice or support messages.

[1256] 5. The user performs the procedure and reports progress

[1257] The user executes each procedure in sequence and inputs a completion report into the system each time it is completed.

[1258] The server tracks your progress and reminds you of any outstanding steps.

[1259] In this way, this system not only supports users in efficiently carrying out the necessary administrative procedures, but also provides a better user experience by utilizing an emotion engine to respond in a way that is adapted to the user's emotions.

[1260] The processing flow will be explained below.

[1261] When carrying out moving procedures

[1262] Step 1:

[1263] The user accesses the terminal and logs in to the system. After logging in, the user selects "Move" from the menu and enters their new address and old address.

[1264] Step 2:

[1265] The server receives the user's input information (old and new addresses) and saves this information in a database. Once saved, the server starts the generation AI.

[1266] Step 3:

[1267] The server sends a request to the generated AI to list the necessary procedures based on the new and old address information entered by the user.

[1268] Step 4:

[1269] Based on the specified information, the generation AI creates a list of necessary procedures (e.g., moving-in / moving-out procedures for resident registration, mail forwarding procedures, utility bill transfer procedures, etc.) in real time. The listed information is then sent back to the server.

[1270] Step 5:

[1271] The server organizes the procedure list returned by the generation AI, including detailed instructions for each procedure, required documents, and procedure locations.

[1272] Step 6:

[1273] The server sends the organized procedure list to the terminal, which displays the procedure list and detailed instructions to the user.

[1274] Step 7:

[1275] The emotion engine analyzes the user's input information and operation status to recognize the user's emotions. For example, it can detect stress from actions such as typing quickly or repeatedly clicking the same button.

[1276] Step 8:

[1277] The server adjusts its response to the user based on the emotional data sent from the emotion engine. For example, if the user is feeling stressed, it will present an encouraging message or simple instructions for how to proceed.

[1278] Step 9:

[1279] The user performs the procedures and inputs a completion report into the system as each procedure is completed.

[1280] Step 10:

[1281] The server receives the completion report from the user and records the progress of the procedure in a database. If there are any incomplete procedures, the server sends appropriate reminder messages based on the emotion engine data.

[1282] When starting a new business

[1283] Step 1:

[1284] The user accesses the terminal and logs in to the system. After logging in, the user selects "Starting a new business" from the menu and enters the industry, business size, and location.

[1285] Step 2:

[1286] The server receives the user's input information (industry, business size, location) and stores this information in a database. Once the information is saved, the server launches the generation AI.

[1287] Step 3:

[1288] The server sends a request to the generation AI to list the necessary procedures based on the industry, business size, and location information entered by the user.

[1289] Step 4:

[1290] Based on the specified information, the generation AI creates a list of necessary procedures (e.g., business registration, incorporation notification, business start-up notification to the tax office, obtaining a business license, etc.) in real time. The listed information is then sent back to the server.

[1291] Step 5:

[1292] The server organizes the procedure list returned by the generation AI, including detailed instructions for each procedure, required documents, and procedure locations.

[1293] Step 6:

[1294] The server sends the organized procedure list to the terminal, which displays the procedure list and detailed instructions to the user.

[1295] Step 7:

[1296] The emotion engine analyzes the user's input information and operation status to recognize the user's emotions. For example, if the user takes a long time to input, it is assumed that the user is feeling anxious.

[1297] Step 8:

[1298] The server adjusts its response to the user based on the emotional data sent from the emotion engine. For example, if the user is feeling anxious, it will provide specific advice or a support message.

[1299] Step 9:

[1300] The user performs the procedures and inputs a completion report into the system as each procedure is completed.

[1301] Step 10:

[1302] The server receives the completion report from the user and records the progress of the procedure in a database. If there are any incomplete procedures, the server sends appropriate reminder messages based on the emotion engine data.

[1303] The above is the specific processing flow of the program when carrying out procedures for moving and starting a new business. This system allows users to complete administrative procedures efficiently, and by utilizing the emotion engine, it is possible to respond flexibly to the user's emotions.

[1304] Example 2

[1305] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1306] In modern society, administrative procedures are becoming increasingly complex, making it difficult for users to complete them appropriately. Furthermore, there are only a limited number of systems that can accommodate the different needs and emotional states of each user, creating a need for improved user experience. Conventional systems lack the ability to dynamically adjust to user operations and emotions, making it difficult to streamline procedures and provide a user-friendly interface.

[1307] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1308] In this invention, the server includes means for a user to input information necessary for performing administrative procedures, means for a generation AI to list the necessary procedures based on the input information, means for organizing the procedures listed by the generation AI and providing detailed explanations, means for tracking the user's progress and reminding the user of incomplete procedures, means for analyzing the user's input information and operation status in real time and recognizing the user's emotions with an emotion engine, and means for automatically adjusting the system behavior based on the recognized user emotions. This enables the user to perform administrative procedures appropriately and efficiently, and furthermore, a customized interface can be provided according to the user's emotions through the emotion engine.

[1309] "User" refers to an individual or organization that uses the system to carry out administrative procedures.

[1310] "Terminal" refers to a computing device that a user accesses and enters information into.

[1311] "Server" refers to the central processing unit that processes information input by the user and manages data in cooperation with the generative AI and emotion engine.

[1312] "Generative AI" refers to an artificial intelligence model that lists the necessary administrative procedures based on input data and generates detailed explanations.

[1313] "Input information" refers to data such as address, industry, and business size that users provide to the system via their terminal.

[1314] "Procedure list" refers to a list of administrative procedures that users must carry out, compiled by the generation AI based on input information.

[1315] An "emotion engine" is a software engine that analyzes the user's input information and operating conditions to recognize emotions and adjusts the system's behavior according to those emotions.

[1316] "Tracking" refers to the system monitoring and recording the progress of a user's administrative procedures.

[1317] "Remind" refers to notifying the user of incomplete procedures or procedures with an upcoming deadline.

[1318] "Real-time" refers to processing data immediately and reflecting results without delay.

[1319] The system is designed to help users efficiently complete administrative procedures. It uses a generative AI model to provide users with a list of necessary procedures. It also incorporates an emotion engine that recognizes the user's emotional state in real time and provides interfaces and support appropriate to that state.

[1320] Overall system overview

[1321] User input method

[1322] First, the user accesses the terminal and logs in to the system. On the login screen, they enter their ID and password for authentication. If authentication is successful, the dashboard screen will be displayed.

[1323] After logging in, users select an administrative procedure such as "moving" or "starting a new business" and enter the necessary information such as their old and new addresses, industry, business size, and location.

[1324] Server processing means

[1325] The server stores the information entered by the user in a database, such as MySQL.

[1326] Next, the server launches a generative AI model (e.g., OpenAI GPT-4) and sends a prompt to the model. Examples of prompts include "Please list the procedures for moving" and "Please tell me the procedures required to start a new business."

[1327] The generative AI model lists the necessary administrative procedures based on the input information and returns the results to the server.

[1328] A means of obtaining and organizing procedural information

[1329] The server organizes the output from the generative AI model and creates a procedure list. The procedure information is converted into a data format (e.g., JSON) and provided to the user.

[1330] The organized procedure list is sent to the terminal and displayed in an easy-to-understand format for the user, along with detailed instructions for each procedure and the necessary documents.

[1331] Emotion engine adjustment method

[1332] When a user operates the terminal, the terminal collects operation data such as the user's input speed, cursor movement, and click frequency.

[1333] The emotion engine analyzes this data in real time to recognize the user's emotional state and automatically adjusts the system's behavior if the user is feeling stressed, anxious, or irritated.

[1334] For example, if the user is feeling stressed, the server can display an encouraging message or provide more convenient instructions on how to proceed.

[1335] Progress management and follow-up measures

[1336] As the user performs each step and completes it, they enter a completion report into the system, and the server tracks this information and manages the progress.

[1337] The server sends reminders to users when there are unfinished tasks, and if the emotion engine detects anxiety or frustration in the user, it provides supportive messages and advice on progress.

[1338] Specific use cases

[1339] For example, when a user performs moving procedures, the flow is as follows:

[1340] 1. The user logs in to the terminal and selects "Move." Enters the old and new address information.

[1341] 2. The server uses generated AI to create a list of procedures for moving out and in, mail forwarding, and utility bill transfer.

[1342] 3. The server organizes the procedure list and sends it to the terminal. The user checks the list and understands the detailed explanation of each procedure and the necessary documents.

[1343] 4. The user performs the procedure and enters the completion report into the system. The server tracks the progress and reminds the user of any incomplete procedures.

[1344] In this way, this system not only supports users in efficiently carrying out the necessary administrative procedures, but also provides a better user experience by utilizing an emotion engine to respond in a way that adapts to the user's emotions.

[1345] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1346] Step 1:

[1347] A user accesses a terminal and logs into the system

[1348] Input: The user enters the ID and password.

[1349] What happens: The device displays a user authentication screen and provides fields for entering user information. The user enters the required authentication information and clicks the "Login" button.

[1350] Output: The server checks the user information against the database, and if authentication is successful, displays the dashboard screen on the terminal.

[1351] Step 2:

[1352] The user selects an item and enters the required information.

[1353] Input: The user selects an option such as "moving" or "starting a new business" and enters the necessary information (old and new addresses, industry, business size, location).

[1354] Action: The device displays a list of choices and then displays an input form based on the user's selection. The user enters information and presses the "Submit" button.

[1355] Output: The information entered by the user is sent to the server.

[1356] Step 3:

[1357] The server stores the information entered by the user in a database

[1358] Input: Information submitted by the user.

[1359] Behavior: Before the server stores the received information in a database (e.g., MySQL), it checks the data for errors and performs some processing to ensure the save was successful.

[1360] Output: Returns a message to the user that the save was successful.

[1361] Step 4:

[1362] The server launches a generation AI that lists the necessary procedures based on the input information.

[1363] Input: User input information stored in the database.

[1364] How it works: The server launches a generative AI model (e.g., OpenAI GPT-4) and generates a prompt. The prompt might be something like, "Please list the procedures for moving" or "Please tell me the procedures required to start a new business." The prompt is then sent to the generative AI.

[1365] Output: The generating AI lists the necessary procedures and replies to the server.

[1366] Step 5:

[1367] The server organizes the information received from the generated AI

[1368] Input: A list of procedures listed by the generation AI.

[1369] What it does: The server organizes the received list into a comprehensible format, categorizing and sorting as needed, and converts it into a data format (e.g., JSON).

[1370] Output: Sends organized procedural information to the terminal.

[1371] Step 6:

[1372] The terminal displays a list of procedures to the user.

[1373] Input: Organized procedural information sent from the server.

[1374] Operation: The device interprets the received data and displays a list of procedures and detailed instructions to the user. It also displays detailed instructions for each procedure and a list of required documents.

[1375] Output: An interface is provided for the user to confirm the procedure and proceed to the next step.

[1376] Step 7:

[1377] The emotion engine analyzes user input and operation status in real time.

[1378] Input: Operational data such as user typing speed, cursor movement, and click frequency.

[1379] Operation: The device collects these operation data and sends them to the emotion engine, which analyzes the data and recognizes the user's emotional state.

[1380] Output: The recognized emotional state is sent to the server.

[1381] Step 8:

[1382] The server adjusts the system's behavior based on the results of the emotion engine.

[1383] Input: The user's emotional state sent from the emotion engine.

[1384] Operation: The server receives the results of the emotion engine and determines the behavior of the system based on the user's emotional state. For example, if a user is feeling stressed, it may display an encouraging message or simplify the procedure.

[1385] Output: The device displays encouraging messages and simple operating instructions to the user.

[1386] Step 9:

[1387] The user performs a procedure and reports progress to the system

[1388] Input: Report information when the user completes the procedure.

[1389] How it works: The device receives a completion report from the user and sends it to the server, which stores the information in a database and tracks the progress.

[1390] Output: The server updates the progress and sends a reminder message to the user if there are any outstanding transactions.

[1391] Step 10:

[1392] The server sends reminders and support messages to the user

[1393] Input: Server-tracked procedural progress and user emotional state.

[1394] How it works: The server manages outstanding tasks and sends reminders when deadlines are approaching. If it detects user anxiety or frustration based on information from the emotion engine, it provides support messages and advice.

[1395] Output: The device displays a reminder or support message to the user.

[1396] (Application example 2)

[1397] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1398] Conventional systems require users to perform complex operations when carrying out specific procedures in stores, which can cause stress and frustration. Furthermore, because the system responds uniformly without considering the user's feelings, it is difficult to respond to individual needs. As a result, improving the user experience has been a challenge.

[1399] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1400] In this invention, the server includes: means for a user to input information necessary for a specific procedure; means for a generation AI to list the necessary procedures based on the input information; means for organizing the procedures listed by the generation AI and providing detailed explanations; means including an emotion engine that recognizes the user's emotions and adjusts the system's behavior in response to the emotions; and means for tracking the user's progress and reminding the user of incomplete procedures. This reduces the stress and anxiety felt by the user and enables efficient and user-friendly procedures.

[1401] The "means for a user to input information necessary for carrying out a specific procedure" is an interface that allows a user to input data necessary for achieving a specific purpose into the system.

[1402] "Means for the generation AI to list the necessary procedures based on the input information" refers to a function in which the generation AI automatically generates a list of related procedures and tasks based on the information input by the user.

[1403] "Means for organizing the procedures listed by the generation AI and providing detailed explanations" refers to a function that organizes the procedure list created by the generation AI in an easy-to-understand manner and provides specific and detailed explanations of its contents.

[1404] "Means including an emotion engine that recognizes the user's emotions and adjusts the system's behavior in accordance with the emotions" refers to a function that analyzes the user's emotions in real time from the information input by the user and the operating situation, and dynamically adjusts the system's behavior and display content based on the recognized emotions.

[1405] "Means to track user progress and remind users of incomplete procedures" is a function that tracks the progress of procedures the user is performing and automatically notifies the user of procedures that have not been completed.

[1406] System configuration and processing flow

[1407] 1. User Input Method

[1408] A user first logs into the system using a device such as a smartphone or smart glasses. After logging in, the user enters the information required to perform a specific procedure, such as a product search or service reservation. This information is data necessary for the user to achieve a specific purpose.

[1409] 2. Procedure listing using generative AI

[1410] The server collects information entered by the user and activates a generative AI model. This generative AI model (e.g., GPT-4 model) automatically generates a list of necessary procedures and tasks. During this process, a function is implemented to obtain the latest procedure information in real time based on the entered information.

[1411] 3. Organizing and explaining procedural information

[1412] The procedures listed by the AI ​​are organized in an easy-to-understand manner by the server. This procedure information is provided to the user's device along with detailed explanations. By referring to this, the user can understand the specific content and methods of the procedure.

[1413] 4. Emotional Engine Adjustment

[1414] When a user inputs information or performs an operation, the server activates the emotion engine. The emotion engine analyzes the user's input information and operation status in real time and recognizes the user's emotions. For example, if the user is feeling stressed, the device can display an encouraging message or a simple operation guide, improving user usability.

[1415] 5. Progress Tracking and Reminders

[1416] As the user completes each step, their progress is tracked by the server, and if there are any incomplete steps, the server automatically sends reminders to the user, helping them remember to complete the steps.

[1417] Specific examples

[1418] scenario

[1419] A customer is searching for a specific product in a physical store but is frustrated by long lines.

[1420] 1. The user logs in to the in-store terminal and selects "Product Search"

[1421] The terminal prompts the user to input the name of the product to be searched for.

[1422] The user enters "alcoholic beverages."

[1423] 2. The server uses a generative AI to list the procedures

[1424] The generative AI model obtains a list of products related to "alcoholic beverages" and sends it to the server.

[1425] 3. The server organizes the procedure information and provides it to the user.

[1426] The server organizes the procedure information and sends it to the terminal along with a detailed product description.

[1427] The terminal displays the product list and detailed descriptions to the user.

[1428] 4. The emotion engine recognizes and responds to user emotions

[1429] The emotion engine detects the user's stress, and the server displays an encouraging message.

[1430] 5. The user performs the procedure and reports progress

[1431] The user selects a product and completes the purchase process.

[1432] The server tracks the progress and assists until the procedure is completed.

[1433] Prompt Sentence Examples

[1434] After logging in to the system, press the "Product Search" button and enter "alcoholic beverages." If you feel stressed, enter "I'm frustrated by the long lines," and the system will take measures to alleviate your stress.

[1435] Hardware and software used

[1436] Hardware: Smartphones, smart glasses, servers

[1437] Software: Python, TensorFlow, GPT-4 model

[1438] Data processing details

[1439] 1. Data input: Input data from the user is collected on the terminal and sent to the server.

[1440] 2. Use of generative AI model: The server launches the GPT-4 model using the Python library and generates procedures based on user input.

[1441] 3. Emotion recognition: The emotion recognition model built using TensorFlow analyzes the user's input information and operation status in real time to recognize emotions.

[1442] 4. Data provision: Provide organized procedural information and messages corresponding to the user's emotions to the terminal.

[1443] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1444] Step 1: The user logs in to the system using a smartphone or smart glasses.

[1445] Input: Login information (user ID, password).

[1446] Specific operation: The terminal displays the login screen, and the user enters their ID and password. The entered information is sent to the server, where authentication is performed.

[1447] Output: A successful login message and the main menu screen.

[1448] Step 2: The user selects a specific procedure and enters the required information.

[1449] Input: Type of procedure (product search, service reservation, etc.), specific required information (product name, desired date and time, etc.).

[1450] Specific operation: The terminal displays the procedure selection screen, the user selects a procedure, and enters the required information. The input information is sent to the server.

[1451] Output: Input confirmation message and detailed input screen are displayed.

[1452] Step 3: The server uses the generative AI model to create a list of procedures.

[1453] Input: Information entered by the user.

[1454] How it works: The server uses Python and the GPT-4 model to generate relevant procedures and tasks based on the input information.

[1455] Output: A procedure list to send to the user's terminal.

[1456] Step 4: Organize the server-generated procedure list and provide detailed explanations.

[1457] Input: Procedural information listed by the generating AI.

[1458] Specific operation: The server organizes the procedure list, adds detailed instructions, and sends it to the user's terminal.

[1459] Output: Organized procedural information and detailed instructions.

[1460] Step 5: When the user inputs or performs an operation, the server activates the emotion engine and recognizes the user's emotion.

[1461] Input: User operation information, facial expression data, and voice input.

[1462] Specific operation: The emotion recognition model (using TensorFlow) analyzes the user's input information and operation status in real time to determine emotions.

[1463] Output: User's emotional state (e.g., stressed, excited, calm).

[1464] Step 6: The server adjusts the system behavior based on the emotion engine results and provides an appropriate message.

[1465] Input: User's emotional state information.

[1466] Specific operation: When the emotion engine recognizes a stressful state, it generates a message of encouragement or operational guidance and sends it to the user's device.

[1467] Output: Message display according to emotion.

[1468] Step 7: The user performs the procedure and reports its progress to the server.

[1469] Input: Procedure status information (completed, incomplete).

[1470] What it does: As the user completes each step, the device sends that information to the server, which tracks their progress.

[1471] Output: Progress updates, reminders of outstanding procedures.

[1472] In this way, appropriate data processing and calculations are performed based on input information at each processing step, and the entire system is designed to function smoothly.

[1473] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1474] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1475] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1476] [Fourth embodiment]

[1477] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1478] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1479] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1480] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1481] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1482] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1483] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1484] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1485] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1486] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1487] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1488] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1489] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1490] This invention is a system that enables users to efficiently complete administrative procedures. The user inputs the information necessary to complete the administrative procedure, and a generation AI lists the necessary procedures based on the input information and provides them to the user. The system also includes a function to track the user's progress and remind them of any incomplete procedures.

[1491] Overall system overview

[1492] User Input

[1493] First, the user accesses the terminal and logs in to the system with their account. After logging in, the user selects an option such as "moving" or "starting a new business" and enters the necessary information (e.g., old and new addresses, industry, business size, location, etc.).

[1494] Server Processing

[1495] The server stores the information entered by the user in a database. Then, the server launches a generation AI to create a list of necessary procedures based on the entered information.

[1496] Acquiring and organizing procedural information

[1497] Based on the input information, the AI ​​generates a list of the latest administrative procedures. For example, in the case of moving, this includes procedures for moving out and in, mail forwarding, and utility bill transfer. In the case of starting a new business, this includes business registration, incorporation notification, business start-up notification to the tax office, and obtaining a business license. The server organizes the information from the AI ​​and provides it to the user in an easy-to-understand format.

[1498] Providing information to users

[1499] The organized procedure information and procedure list are sent to the terminal and displayed to the user, who can check the list and understand the detailed explanation of each procedure and the necessary documents.

[1500] Progress management and follow-up

[1501] Each time a user performs a procedure and completes it, they can enter a completion report into the system. The server tracks this information and manages the progress of the procedure. If there are any incomplete procedures, the server sends reminders to the user.

[1502] Specific examples

[1503] Specific examples of moving procedures

[1504] 1. The user logs in to the device and selects "Move"

[1505] The terminal prompts the user to enter their old and new addresses.

[1506] The user enters a new address (e.g., Shinjuku-ku, Tokyo) and an old address (e.g., Kita-ku, Osaka).

[1507] 2. The server uses a generative AI to list the procedures

[1508] The generation AI obtains the necessary procedures, such as moving-in and moving-out procedures for resident registration, mail forwarding procedures, and utility bill transfer procedures, and sends them to the server.

[1509] 3. The server organizes the procedure information and provides it to the user.

[1510] The server organizes the procedure information and sends it to the terminal.

[1511] The terminal displays the procedure list and detailed instructions to the user.

[1512] 4. The user performs the procedure and reports progress

[1513] The user executes each procedure in sequence and inputs a completion report into the system each time it is completed.

[1514] The server tracks your progress and reminds you of any outstanding steps.

[1515] Specific examples of procedures for starting a new business

[1516] 1. The user logs in to the device and selects "Start a new business."

[1517] The terminal asks the user to enter the industry, business size, and location.

[1518] The user enters the industry (e.g., food and beverage), business size (e.g., small scale), and location (e.g., Shinjuku-ku, Tokyo).

[1519] 2. The server uses a generative AI to list the procedures

[1520] The generation AI obtains the necessary procedures, such as business registration, incorporation notification, business start-up notification to the tax office, and obtaining a business license, and sends them to the server.

[1521] 3. The server organizes the procedure information and provides it to the user.

[1522] The server organizes the procedure information and sends it to the terminal.

[1523] The terminal displays the procedure list and detailed instructions to the user.

[1524] 4. The user performs the procedure and reports progress

[1525] The user executes each procedure in sequence and inputs a completion report into the system each time it is completed.

[1526] The server tracks your progress and reminds you of any outstanding steps.

[1527] In this way, this system supports users in efficiently completing the necessary administrative procedures. By utilizing generative AI to obtain the latest administrative procedure information in real time, the system always provides the latest information, allowing users to smoothly complete procedures.

[1528] The processing flow will be explained below.

[1529] When carrying out moving procedures

[1530] Step 1:

[1531] The user accesses the terminal and logs in to the system. After logging in, the user selects the "move" item from the menu and enters the new address and old address.

[1532] Step 2:

[1533] The server receives the user's input information (old and new addresses) and saves this information in a database. Once saved, the server starts the generation AI.

[1534] Step 3:

[1535] The server sends a request to the generated AI to list the necessary procedures based on the new and old address information entered by the user.

[1536] Step 4:

[1537] Based on the specified information, the generation AI creates a list of necessary procedures (e.g., moving-in / moving-out procedures for resident registration, mail forwarding procedures, utility bill transfer procedures, etc.) in real time. The listed information is then sent back to the server.

[1538] Step 5:

[1539] The server organizes the procedure list returned by the generation AI, including detailed instructions for each procedure, required documents, and procedure locations.

[1540] Step 6:

[1541] The server sends the organized procedure list to the terminal, which displays the procedure list and detailed instructions to the user.

[1542] Step 7:

[1543] The user checks the displayed list of procedures and executes each procedure in order. Each time a procedure is completed, the user inputs information to report the completion of the procedure into the system.

[1544] Step 8:

[1545] The server receives the completion report from the user and records the progress of the procedure in a database. If there are any incomplete procedures, the server sends a reminder to the user.

[1546] When starting a new business

[1547] Step 1:

[1548] The user accesses the terminal and logs in to the system. After logging in, the user selects the "Start a new business" item from the menu and enters the industry, business size, and location.

[1549] Step 2:

[1550] The server receives the user's input information (industry, business size, location) and stores this information in a database. Once the information is saved, the server launches the generation AI.

[1551] Step 3:

[1552] The server sends a request to the generation AI to list the necessary procedures based on the industry, business size, and location information entered by the user.

[1553] Step 4:

[1554] Based on the specified information, the generation AI creates a list of necessary procedures (e.g., business registration, incorporation notification, business start-up notification to the tax office, obtaining a business license, etc.) in real time. The listed information is then sent back to the server.

[1555] Step 5:

[1556] The server organizes the procedure list returned by the generation AI, including detailed instructions for each procedure, required documents, and procedure locations.

[1557] Step 6:

[1558] The server sends the organized procedure list to the terminal, which displays the procedure list and detailed instructions to the user.

[1559] Step 7:

[1560] The user checks the displayed list of procedures and executes each procedure in order. Each time a procedure is completed, the user inputs information to report the completion of the procedure into the system.

[1561] Step 8:

[1562] The server receives the completion report from the user and records the progress of the procedure in a database. If there are any incomplete procedures, the server sends a reminder to the user.

[1563] The above is the specific processing flow of the program when carrying out procedures for moving and starting a new business. This system allows users to complete administrative procedures efficiently.

[1564] Example 1

[1565] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1566] Current administrative procedures are complex, and it takes time and effort for users to find the necessary procedures and carry them out sequentially. Furthermore, when there are multiple procedures, it is difficult to track the progress of each. Furthermore, because procedure information is frequently updated, it is difficult to obtain the latest information in real time.

[1567] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1568] In this invention, the server includes means for a user to select a specific administrative procedure and input the necessary information, means for storing the input information in a database and sending prompts to a generative AI model to list the necessary procedures, means for analyzing the procedures listed by the generative AI model and providing detailed explanations, and means for tracking the user's progress and reminding the user of incomplete procedures, allowing the user to efficiently complete the necessary administrative procedures and obtain the latest procedural information in real time.

[1569] A "user" is an individual or legal entity that accesses the system, selects a particular administrative procedure, and enters the required information.

[1570] A "terminal" is an electronic device used by a user to enter information into and view information in a system. Examples include personal computers and smartphones.

[1571] The "server" is a networked computer system that receives information submitted by users, uses a generative AI model to list the necessary steps, and tracks progress.

[1572] A "generative AI model" is software equipped with artificial intelligence technology that lists the necessary administrative procedures based on user input information and obtains the latest information in real time.

[1573] A "prompt" is textual contextual information used to input specific conditions or instructions to a generative AI model.

[1574] A "database" is a digital data storage system used to store and later reference information entered by a user.

[1575] "Remind" is a function that notifies the user of incomplete procedures and calls for attention to complete the procedures.

[1576] A "procedure list" is a list of specific administrative procedures that a user must carry out, as listed by a generative AI model.

[1577] "Progress" is information that indicates the status of the user's administrative procedures, including which procedures have been completed and which procedures remain to be completed.

[1578] "A means of making applications in a centralized manner" is a function that allows multiple different administrative procedures to be managed in one place and allows applications to be made efficiently all at once.

[1579] This invention is a system that allows users to efficiently carry out administrative procedures. This system includes a terminal, a server, and a generative AI model, and each module works in cooperation to simplify complex administrative procedures.

[1580] User Input

[1581] First, users access a terminal and log in to the system with their account. After logging in, the terminal provides an interface for users to select specific administrative procedures such as "moving" or "starting a new business." Users then enter the necessary information, such as their old and new addresses, industry, business size, and location.

[1582] Server Processing

[1583] The server stores the information sent by the user in a database. An example of a database is an SQL database (e.g., MySQL or PostgreSQL). Next, the server starts a generative AI model (e.g., OpenAI's GPT-4), generates a prompt sentence based on the input information, and sends it to the generative AI model.

[1584] Prompt Sentence Examples

[1585] "Please list the necessary administrative procedures based on the following information: My new address is in Shinjuku-ku, Tokyo, and my old address is in Kita-ku, Osaka."

[1586] Acquiring and organizing procedural information

[1587] The generative AI model lists the necessary administrative procedures based on the prompt. For example, in the case of "moving," this includes procedures for moving out and in, mail forwarding, and utility bill transfer. In the case of "starting a new business," this includes business registration, incorporation notification, business start-up notification to the tax office, and obtaining a business license. The server analyzes the information received from the generative AI model and organizes it in a format that is easy for the user to understand.

[1588] Providing information to users

[1589] The server sends the organized procedure information and procedure list to the terminal, which then displays the received information to the user, allowing the user to check the list and understand the detailed explanation of each procedure and the necessary documents.

[1590] Progress management and follow-up

[1591] Each time a user performs a procedure and completes it, they can enter a completion report into the system. The server tracks this information and manages the progress of the procedure. If there are any incomplete procedures, the server sends a reminder to the user. The reminder is notified to the user by email, push notification, or other methods.

[1592] Specific examples

[1593] Specific examples of moving procedures

[1594] 1. The user logs in to the terminal and selects "Move." The terminal prompts the user to enter their old and new addresses. The user enters their new address (e.g., Shinjuku-ku, Tokyo) and their old address (e.g., Kita-ku, Osaka).

[1595] 2. The server uses the generation AI to create a list of procedures. The generation AI obtains the necessary procedures, such as moving-in and moving-out procedures for resident registration, mail forwarding procedures, and utility bill transfer procedures, and sends them to the server.

[1596] 3. The server organizes the procedure information and sends it to the terminal, which displays the procedure list and detailed instructions to the user.

[1597] 4. The user performs each step in sequence, entering a completion report into the system as they complete it. The server tracks their progress and reminds them of any remaining steps.

[1598] In this way, this system supports users in efficiently completing the necessary administrative procedures. By utilizing generative AI and obtaining the latest administrative procedure information in real time, the system always provides the latest information, allowing users to smoothly complete procedures.

[1599] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1600] Step 1:

[1601] The user logs in to the terminal. The terminal displays a login screen and the user enters authentication information (user name and password). The entered authentication information is sent from the terminal to the server. The server compares the authentication information with a database and returns the authentication result (success or failure) to the terminal. The terminal displays the authentication result to the user. If authentication is successful, the user can access the system.

[1602] Step 2:

[1603] The user selects a specific administrative procedure. The terminal displays a procedure selection screen for the user, such as "moving" or "starting a new business." When the user selects a procedure, the terminal sends the selected procedure information to the server. The server generates an information input form corresponding to the selected procedure and sends it to the terminal. The terminal displays the information input form to the user.

[1604] Step 3:

[1605] The user enters the necessary information into the information input form. The terminal prompts the user to enter information such as old and new addresses, industry, business size, and location. The information entered by the user is sent from the terminal to the server. The server saves the received information in a database. The terminal is notified that the save was successful.

[1606] Step 4:

[1607] The server launches the generative AI model. The server retrieves the user's input information stored in the database and generates a prompt based on that information. The generated prompt is sent to the generative AI model. The generative AI model creates a list of necessary administrative procedures based on the prompt and sends that list back to the server. The server analyzes the received list of procedures and temporarily stores it in the database.

[1608] Step 5:

[1609] The server organizes the procedure information and provides it to the user. The server formats the procedure list obtained from the generated AI model into a user-friendly format (e.g., JSON format) and sends it to the device. The device displays the procedure list and detailed explanation to the user. The user can check the list and explanation.

[1610] Step 6:

[1611] The user performs each procedure and reports the progress. The user performs each procedure in sequence and inputs a completion report into the system when completed. The terminal sends the completion report to the server. The server receives the completion report and records the progress of the procedure in a database. The server tracks the progress.

[1612] Step 7:

[1613] The server reminds the user of incomplete procedures. The server periodically checks the database and, if there are incomplete procedures, sends a reminder notification to the user. Reminder notifications are sent via email or push notification. The device displays the reminder to the user. The user checks the notification and is prompted to retry the incomplete procedures.

[1614] (Application example 1)

[1615] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1616] Existing systems for efficiently carrying out administrative procedures provide a function that lists the necessary procedures based on information entered by the user, but they lack procedure progress management and reminder functions specialized for the operation and management of physical stores. This poses a challenge, requiring time and effort, particularly when opening a new store or managing daily operations, making efficient operation difficult. Furthermore, there is a lack of means to obtain the latest administrative procedure information in real time or to centrally manage multiple procedures, making it difficult for users to grasp the progress of procedures.

[1617] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1618] In this invention, the server includes means for a user to input information necessary for administrative procedures, means for a generation AI to list the necessary procedures based on the input information, means for organizing the procedures listed by the generation AI and providing detailed explanations, means for tracking the user's progress and reminding them of incomplete procedures, and means for listing the procedures necessary for opening a store based on the user's industry, store location, and size, and managing the progress. This enables administrative procedures related to operating or opening a physical store to be carried out efficiently and smoothly, significantly reducing the user's workload.

[1619] The "means for users to input the information necessary to carry out administrative procedures" refers to an interface that allows users to provide specific information to a computer system that corresponds to their own situation.

[1620] "Means for the generation AI to list the necessary procedures based on the input information" refers to a function that analyzes the information provided by the user and automatically creates a list of the corresponding procedures based on that information.

[1621] "Means for organizing the procedures listed by the generation AI and providing detailed explanations" refers to a function that organizes information about the procedures listed by the generation AI into an easy-to-understand format and provides detailed explanations to the user about specific steps to perform the procedures, necessary documents, etc.

[1622] "Means to track user progress and remind users of incomplete procedures" refers to a function that monitors the progress of users when carrying out administrative procedures and automatically notifies users of incomplete procedures.

[1623] "A means of listing the procedures required to open a store based on the user's industry, store location, and size, and managing the progress" is a function in which the AI ​​generates a list of the procedures required to open a new store based on details such as the industry, store location, and size entered by the user, and manages the progress of those procedures.

[1624] "Means for the generating AI to obtain the latest administrative procedure information in real time" refers to the function that allows the generating AI to constantly collect the latest information on administrative procedures in real time via the Internet and related databases.

[1625] "A means of managing multiple administrative procedures in one place and making applications in a centralized manner" is a function that manages multiple procedures simultaneously, allowing users to perform all necessary procedures with a single application operation.

[1626] System program generation

[1627] This system is designed to help users carry out administrative procedures efficiently, and has functions specifically designed for new store openings and daily business management. The main components of the system are a user information input section, a procedure list generation section using AI, a detailed explanation section, a progress management section, and a reminder section. The main programs required to realize a system with these functions are as follows:

[1628] 1. User information input section

[1629] Users use devices such as smartphones and tablets to enter the information required for administrative procedures. This entered information is linked to the user's account and saved. Examples include information such as "opening a restaurant" and "Shinjuku Ward, Tokyo."

[1630] 2. Procedure list generation by generative AI

[1631] The server launches a generative AI based on the information entered by the user, and lists the necessary procedures. Using the generative AI model, the system obtains the latest administrative procedure information in real time and generates specific procedures according to the user's industry, location, and scale. For example, "applying for a food business license" or "notifying the fire department."

[1632] 3. Detailed explanation section

[1633] The AI ​​then organizes the procedural information it lists in a user-friendly format and provides detailed instructions, including specific steps, required documents, and related links. For example, the instructions might say, "To apply for a business license, you need the following documents..."

[1634] 4. Progress management department

[1635] When the user performs each procedure and completes it, they can report their progress to the system. Based on this report, the server tracks the user's progress and lists the procedures that have not yet been completed. This function makes it easy for the user to know which procedures have not yet been completed.

[1636] 5. Remind Section

[1637] The server automatically sends reminders to users about incomplete procedures or procedures that are approaching deadlines, for example, by email or push notification, reminding them that "the deadline for submitting a notification to the fire department is approaching."

[1638] Hardware and software used

[1639] Hardware: Smartphones, tablets

[1640] Software: SQLite (database management), smtplib (email sending), Python (scripting language)

[1641] Processing Description

[1642] The server uses SQLite to manage user and procedure information. The AI ​​generates the procedure list based on the information entered by the user on the device. It also uses smtplib to implement a function to send reminder emails.

[1643] Specific example explanation

[1644] For example, if a user selects "Opening a Restaurant" and enters the necessary address and business information, the AI ​​will automatically create a list of procedures such as "Applying for a Food Business License" and "Notifying the Fire Department." The progress can be checked within the app, and it is easy to see at a glance which procedures have been completed and which remain to be completed. Reminder emails are also sent, helping users to remember important procedures.

[1645] Specific examples of prompts to input to generative AI models

[1646] Please list the administrative procedures required to open a new store in the following industries:

[1647] Industry: Food and beverage

[1648] Store location: Shinjuku Ward, Tokyo

[1649] Scale: Small

[1650] Output formats:

[1651] 1. Procedure Name

[1652] 2. Where to apply

[1653] 3. Required documents

[1654] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1655] Step 1:

[1656] The user accesses the device and logs in to their account.

[1657] Specific behavior:

[1658] A user logs in to the application using a smartphone or tablet. They enter their username and password on the login screen and are authenticated. After successful authentication, the user data is loaded onto the device.

[1659] Input: Username, Password

[1660] Output: Authenticated user session

[1661] Step 2:

[1662] The user enters the information required to carry out administrative procedures.

[1663] Specific behavior:

[1664] After logging in, the user selects an option such as "Opening a new store" or "Daily business management." Next, a form is displayed for entering specific information such as the type of business, store location, and size. The user enters this information and presses the submit button.

[1665] Input: Information such as business type, store location, size, etc.

[1666] Output: The input information is saved in the database.

[1667] Step 3:

[1668] The server launches the generation AI based on the input information.

[1669] Specific behavior:

[1670] The server retrieves the information entered by the user from the database and sends a prompt to the generative AI model, which analyzes the prompt and lists the necessary steps to follow according to the user's request.

[1671] Input: Information entered by the user, prompts for the AI ​​generator

[1672] Output: List of required procedures

[1673] Step 4:

[1674] The generative AI organizes the procedures listed and provides detailed explanations.

[1675] Specific behavior:

[1676] The server organizes the list of procedures received from the generation AI and generates detailed explanations for each procedure, including necessary documents, application locations, and procedures, and provides them to the user in an easy-to-understand format.

[1677] Input: Procedure list from the generating AI

[1678] Output: Detailed instructions with organized procedures

[1679] Step 5:

[1680] Track your progress and remind you of any outstanding steps.

[1681] Specific behavior:

[1682] As users complete each step, they enter a completion report through their device. The server tracks the progress and updates the database. For any remaining steps, reminders are automatically generated and sent to users via email or push notification.

[1683] Input: User completion report, database progress information

[1684] Output: Reminders for outstanding procedures

[1685] Step 6:

[1686] The server uses a generative AI model to obtain the latest administrative procedure information in real time.

[1687] Specific behavior:

[1688] The server periodically calls the generative AI model to retrieve the latest administrative procedure information from the internet and relevant databases, ensuring that the information provided to users is up-to-date.

[1689] Input: Routine requests, administrative procedure information on the Internet

[1690] Output: Updated administrative procedure information

[1691] Step 7:

[1692] Multiple administrative procedures are managed in one place, and applications are submitted centrally.

[1693] Specific behavior:

[1694] The server provides the interface and functionality to allow users to manage and apply for multiple administrative procedures at once. Users can complete all related procedures at once by performing a single application.

[1695] Input: User's bulk application instructions

[1696] Output: Centralized application processing

[1697] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1698] This invention is a system that enables users to carry out administrative procedures efficiently, and also combines it with an emotion engine that recognizes the user's emotions to provide a more user-friendly interface. By recognizing emotions based on the user's input information and operation status, and automatically adjusting the system's behavior according to the emotions, the user experience is improved.

[1699] Overall system overview

[1700] User Input

[1701] First, the user accesses a terminal and logs in to the system. After logging in, the user selects an option such as "moving" or "starting a new business" and enters the necessary information (e.g., old and new addresses, industry, business size, location, etc.).

[1702] Server Processing

[1703] The server stores the information entered by the user in a database. Then, the server launches a generation AI to create a list of necessary procedures based on the entered information.

[1704] Acquiring and organizing procedural information

[1705] Based on the input information, the AI ​​generates a list of the latest administrative procedures. For example, in the case of moving, this includes procedures for moving out and in, mail forwarding, and utility bill transfer. In the case of starting a new business, this includes business registration, incorporation notification, business start-up notification to the tax office, and obtaining a business license. The server organizes the information from the AI ​​and provides it to the user in an easy-to-understand format.

[1706] Emotional engine regulation

[1707] As the user operates the system, the emotion engine analyzes the user's input information and operation status in real time to recognize the user's emotions. For example, if the system determines that the user is feeling stressed, it can display an encouraging message to the user or provide simpler instructions on how to proceed. The server automatically adjusts how the procedure is carried out and how information is presented based on the information sent from the emotion engine.

[1708] Providing information to users

[1709] The organized procedure information and procedure list are sent to the terminal and displayed to the user, who can check the list and understand the detailed explanation of each procedure and the necessary documents.

[1710] Progress management and follow-up

[1711] Each time a user performs a procedure and completes it, they can enter a completion report into the system. The server tracks this information and manages the progress of the procedure. If there are any incomplete procedures, the server sends reminders to the user. If the emotion engine detects the user's anxiety or frustration, it can also provide supportive messages and advice on progress.

[1712] Specific examples

[1713] Specific examples of moving procedures

[1714] 1. The user logs in to the device and selects "Move"

[1715] The terminal prompts the user to enter their old and new addresses.

[1716] The user enters a new address (e.g., Shinjuku-ku, Tokyo) and an old address (e.g., Kita-ku, Osaka).

[1717] 2. The server uses a generative AI to list the procedures

[1718] The generation AI obtains the necessary procedures, such as moving-in and moving-out procedures for resident registration, mail forwarding procedures, and utility bill transfer procedures, and sends them to the server.

[1719] 3. The server organizes the procedure information and provides it to the user.

[1720] The server organizes the procedure information and sends it to the terminal.

[1721] The terminal displays the procedure list and detailed instructions to the user.

[1722] 4. The emotion engine recognizes and responds to user emotions

[1723] When a user inputs or performs an operation, the emotion engine recognizes the user's emotions in real time.

[1724] If the emotion engine detects the user's stress, the server will present encouraging messages and simple operating instructions.

[1725] 5. The user performs the procedure and reports progress

[1726] The user executes each procedure in sequence and inputs a completion report into the system each time it is completed.

[1727] The server tracks your progress and reminds you of any outstanding steps.

[1728] Specific examples of procedures for starting a new business

[1729] 1. The user logs in to the device and selects "Start a new business."

[1730] The terminal asks the user to enter the industry, business size, and location.

[1731] The user enters the industry (e.g., food and beverage), business size (e.g., small scale), and location (e.g., Shinjuku-ku, Tokyo).

[1732] 2. The server uses a generative AI to list the procedures

[1733] The generation AI obtains the necessary procedures, such as business registration, incorporation notification, business start-up notification to the tax office, and obtaining a business license, and sends them to the server.

[1734] 3. The server organizes the procedure information and provides it to the user.

[1735] The server organizes the procedure information and sends it to the terminal.

[1736] The terminal displays the procedure list and detailed instructions to the user.

[1737] 4. The emotion engine recognizes and responds to user emotions

[1738] When a user inputs or performs an operation, the emotion engine recognizes the user's emotions in real time.

[1739] If the emotion engine detects the user's anxiety, the server will present appropriate advice or support messages.

[1740] 5. The user performs the procedure and reports progress

[1741] The user executes each procedure in sequence and inputs a completion report into the system each time it is completed.

[1742] The server tracks your progress and reminds you of any outstanding steps.

[1743] In this way, this system not only supports users in efficiently carrying out the necessary administrative procedures, but also provides a better user experience by utilizing an emotion engine to respond in a way that is adapted to the user's emotions.

[1744] The processing flow will be explained below.

[1745] When carrying out moving procedures

[1746] Step 1:

[1747] The user accesses the terminal and logs in to the system. After logging in, the user selects "Move" from the menu and enters their new address and old address.

[1748] Step 2:

[1749] The server receives the user's input information (old and new addresses) and saves this information in a database. Once saved, the server starts the generation AI.

[1750] Step 3:

[1751] The server sends a request to the generated AI to list the necessary procedures based on the new and old address information entered by the user.

[1752] Step 4:

[1753] Based on the specified information, the generation AI creates a list of necessary procedures (e.g., moving-in / moving-out procedures for resident registration, mail forwarding procedures, utility bill transfer procedures, etc.) in real time. The listed information is then sent back to the server.

[1754] Step 5:

[1755] The server organizes the procedure list returned by the generation AI, including detailed instructions for each procedure, required documents, and procedure locations.

[1756] Step 6:

[1757] The server sends the organized procedure list to the terminal, which displays the procedure list and detailed instructions to the user.

[1758] Step 7:

[1759] The emotion engine analyzes the user's input information and operation status to recognize the user's emotions. For example, it can detect stress from actions such as typing quickly or repeatedly clicking the same button.

[1760] Step 8:

[1761] The server adjusts its response to the user based on the emotional data sent from the emotion engine. For example, if the user is feeling stressed, it will present an encouraging message or simple instructions for how to proceed.

[1762] Step 9:

[1763] The user performs the procedures and inputs a completion report into the system as each procedure is completed.

[1764] Step 10:

[1765] The server receives the completion report from the user and records the progress of the procedure in a database. If there are any incomplete procedures, the server sends appropriate reminder messages based on the emotion engine data.

[1766] When starting a new business

[1767] Step 1:

[1768] The user accesses the terminal and logs in to the system. After logging in, the user selects "Starting a new business" from the menu and enters the industry, business size, and location.

[1769] Step 2:

[1770] The server receives the user's input information (industry, business size, location) and stores this information in a database. Once the information is saved, the server launches the generation AI.

[1771] Step 3:

[1772] The server sends a request to the generation AI to list the necessary procedures based on the industry, business size, and location information entered by the user.

[1773] Step 4:

[1774] Based on the specified information, the generation AI creates a list of necessary procedures (e.g., business registration, incorporation notification, business start-up notification to the tax office, obtaining a business license, etc.) in real time. The listed information is then sent back to the server.

[1775] Step 5:

[1776] The server organizes the procedure list returned by the generation AI, including detailed instructions for each procedure, required documents, and procedure locations.

[1777] Step 6:

[1778] The server sends the organized procedure list to the terminal, which displays the procedure list and detailed instructions to the user.

[1779] Step 7:

[1780] The emotion engine analyzes the user's input information and operation status to recognize the user's emotions. For example, if the user takes a long time to input, it is assumed that the user is feeling anxious.

[1781] Step 8:

[1782] The server adjusts its response to the user based on the emotional data sent from the emotion engine. For example, if the user is feeling anxious, it will provide specific advice or a support message.

[1783] Step 9:

[1784] The user performs the procedures and inputs a completion report into the system as each procedure is completed.

[1785] Step 10:

[1786] The server receives the completion report from the user and records the progress of the procedure in a database. If there are any incomplete procedures, the server sends appropriate reminder messages based on the emotion engine data.

[1787] The above is the specific processing flow of the program when carrying out procedures for moving and starting a new business. This system allows users to complete administrative procedures efficiently, and by utilizing the emotion engine, it is possible to respond flexibly to the user's emotions.

[1788] Example 2

[1789] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1790] In modern society, administrative procedures are becoming increasingly complex, making it difficult for users to complete them appropriately. Furthermore, there are only a limited number of systems that can accommodate the different needs and emotional states of each user, creating a need for improved user experience. Conventional systems lack the ability to dynamically adjust to user operations and emotions, making it difficult to streamline procedures and provide a user-friendly interface.

[1791] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1792] In this invention, the server includes means for a user to input information necessary for performing administrative procedures, means for a generation AI to list the necessary procedures based on the input information, means for organizing the procedures listed by the generation AI and providing detailed explanations, means for tracking the user's progress and reminding the user of incomplete procedures, means for analyzing the user's input information and operation status in real time and recognizing the user's emotions with an emotion engine, and means for automatically adjusting the system behavior based on the recognized user emotions. This enables the user to perform administrative procedures appropriately and efficiently, and furthermore, a customized interface can be provided according to the user's emotions through the emotion engine.

[1793] "User" refers to an individual or organization that uses the system to carry out administrative procedures.

[1794] "Terminal" refers to a computing device that a user accesses and enters information into.

[1795] "Server" refers to the central processing unit that processes information input by the user and manages data in cooperation with the generative AI and emotion engine.

[1796] "Generative AI" refers to an artificial intelligence model that lists the necessary administrative procedures based on input data and generates detailed explanations.

[1797] "Input information" refers to data such as address, industry, and business size that users provide to the system via their terminal.

[1798] "Procedure list" refers to a list of administrative procedures that users must carry out, compiled by the generation AI based on input information.

[1799] An "emotion engine" is a software engine that analyzes the user's input information and operating conditions to recognize emotions and adjusts the system's behavior according to those emotions.

[1800] "Tracking" refers to the system monitoring and recording the progress of a user's administrative procedures.

[1801] "Remind" refers to notifying the user of incomplete procedures or procedures with an upcoming deadline.

[1802] "Real-time" refers to processing data immediately and reflecting results without delay.

[1803] The system is designed to help users efficiently complete administrative procedures. It uses a generative AI model to provide users with a list of necessary procedures. It also incorporates an emotion engine that recognizes the user's emotional state in real time and provides interfaces and support appropriate to that state.

[1804] Overall system overview

[1805] User input method

[1806] First, the user accesses the terminal and logs in to the system. On the login screen, they enter their ID and password for authentication. If authentication is successful, the dashboard screen will be displayed.

[1807] After logging in, users select an administrative procedure such as "moving" or "starting a new business" and enter the necessary information such as their old and new addresses, industry, business size, and location.

[1808] Server processing means

[1809] The server stores the information entered by the user in a database, such as MySQL.

[1810] Next, the server launches a generative AI model (e.g., OpenAI GPT-4) and sends a prompt to the model. Examples of prompts include "Please list the procedures for moving" and "Please tell me the procedures required to start a new business."

[1811] The generative AI model lists the necessary administrative procedures based on the input information and returns the results to the server.

[1812] A means of obtaining and organizing procedural information

[1813] The server organizes the output from the generative AI model and creates a procedure list. The procedure information is converted into a data format (e.g., JSON) and provided to the user.

[1814] The organized procedure list is sent to the terminal and displayed in an easy-to-understand format for the user, along with detailed instructions for each procedure and the necessary documents.

[1815] Emotion engine adjustment method

[1816] When a user operates the terminal, the terminal collects operation data such as the user's input speed, cursor movement, and click frequency.

[1817] The emotion engine analyzes this data in real time to recognize the user's emotional state and automatically adjusts the system's behavior if the user is feeling stressed, anxious, or irritated.

[1818] For example, if the user is feeling stressed, the server can display an encouraging message or provide more convenient instructions on how to proceed.

[1819] Progress management and follow-up measures

[1820] As the user performs each step and completes it, they enter a completion report into the system, and the server tracks this information and manages the progress.

[1821] The server sends reminders to users when there are unfinished tasks, and if the emotion engine detects anxiety or frustration in the user, it provides supportive messages and advice on progress.

[1822] Specific use cases

[1823] For example, when a user performs moving procedures, the flow is as follows:

[1824] 1. The user logs in to the terminal and selects "Move." Enters the old and new address information.

[1825] 2. The server uses generated AI to create a list of procedures for moving out and in, mail forwarding, and utility bill transfer.

[1826] 3. The server organizes the procedure list and sends it to the terminal. The user checks the list and understands the detailed explanation of each procedure and the necessary documents.

[1827] 4. The user performs the procedure and enters the completion report into the system. The server tracks the progress and reminds the user of any incomplete procedures.

[1828] In this way, this system not only supports users in efficiently carrying out the necessary administrative procedures, but also provides a better user experience by utilizing an emotion engine to respond in a way that adapts to the user's emotions.

[1829] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1830] Step 1:

[1831] A user accesses a terminal and logs into the system

[1832] Input: The user enters the ID and password.

[1833] What happens: The device displays a user authentication screen and provides fields for entering user information. The user enters the required authentication information and clicks the "Login" button.

[1834] Output: The server checks the user information against the database, and if authentication is successful, displays the dashboard screen on the terminal.

[1835] Step 2:

[1836] The user selects an item and enters the required information.

[1837] Input: The user selects an option such as "moving" or "starting a new business" and enters the necessary information (old and new addresses, industry, business size, location).

[1838] Action: The device displays a list of choices and then displays an input form based on the user's selection. The user enters information and presses the "Submit" button.

[1839] Output: The information entered by the user is sent to the server.

[1840] Step 3:

[1841] The server stores the information entered by the user in a database

[1842] Input: Information submitted by the user.

[1843] Behavior: Before the server stores the received information in a database (e.g., MySQL), it checks the data for errors and performs some processing to ensure the save was successful.

[1844] Output: Returns a message to the user that the save was successful.

[1845] Step 4:

[1846] The server launches a generation AI that lists the necessary procedures based on the input information.

[1847] Input: User input information stored in the database.

[1848] How it works: The server launches a generative AI model (e.g., OpenAI GPT-4) and generates a prompt. The prompt might be something like, "Please list the procedures for moving" or "Please tell me the procedures required to start a new business." The prompt is then sent to the generative AI.

[1849] Output: The generating AI lists the necessary procedures and replies to the server.

[1850] Step 5:

[1851] The server organizes the information received from the generated AI

[1852] Input: A list of procedures listed by the generation AI.

[1853] What it does: The server organizes the received list into a comprehensible format, categorizing and sorting as needed, and converts it into a data format (e.g., JSON).

[1854] Output: Sends organized procedural information to the terminal.

[1855] Step 6:

[1856] The terminal displays a list of procedures to the user.

[1857] Input: Organized procedural information sent from the server.

[1858] Operation: The device interprets the received data and displays a list of procedures and detailed instructions to the user. It also displays detailed instructions for each procedure and a list of required documents.

[1859] Output: An interface is provided for the user to confirm the procedure and proceed to the next step.

[1860] Step 7:

[1861] The emotion engine analyzes user input and operation status in real time.

[1862] Input: Operational data such as user typing speed, cursor movement, and click frequency.

[1863] Operation: The device collects these operation data and sends them to the emotion engine, which analyzes the data and recognizes the user's emotional state.

[1864] Output: The recognized emotional state is sent to the server.

[1865] Step 8:

[1866] The server adjusts the system's behavior based on the results of the emotion engine.

[1867] Input: The user's emotional state sent from the emotion engine.

[1868] Operation: The server receives the results of the emotion engine and determines the behavior of the system based on the user's emotional state. For example, if a user is feeling stressed, it may display an encouraging message or simplify the procedure.

[1869] Output: The device displays encouraging messages and simple operating instructions to the user.

[1870] Step 9:

[1871] The user performs a procedure and reports progress to the system

[1872] Input: Report information when the user completes the procedure.

[1873] How it works: The device receives a completion report from the user and sends it to the server, which stores the information in a database and tracks the progress.

[1874] Output: The server updates the progress and sends a reminder message to the user if there are any outstanding transactions.

[1875] Step 10:

[1876] The server sends reminders and support messages to the user

[1877] Input: Server-tracked procedural progress and user emotional state.

[1878] How it works: The server manages outstanding tasks and sends reminders when deadlines are approaching. If it detects user anxiety or frustration based on information from the emotion engine, it provides support messages and advice.

[1879] Output: The device displays a reminder or support message to the user.

[1880] (Application example 2)

[1881] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1882] Conventional systems require users to perform complex operations when carrying out specific procedures in stores, which can cause stress and frustration. Furthermore, because the system responds uniformly without considering the user's feelings, it is difficult to respond to individual needs. As a result, improving the user experience has been a challenge.

[1883] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1884] In this invention, the server includes: means for a user to input information necessary for a specific procedure; means for a generation AI to list the necessary procedures based on the input information; means for organizing the procedures listed by the generation AI and providing detailed explanations; means including an emotion engine that recognizes the user's emotions and adjusts the system's behavior in response to the emotions; and means for tracking the user's progress and reminding the user of incomplete procedures. This reduces the stress and anxiety felt by the user and enables efficient and user-friendly procedures.

[1885] The "means for a user to input information necessary for carrying out a specific procedure" is an interface that allows a user to input data necessary for achieving a specific purpose into the system.

[1886] "Means for the generation AI to list the necessary procedures based on the input information" refers to a function in which the generation AI automatically generates a list of related procedures and tasks based on the information input by the user.

[1887] "Means for organizing the procedures listed by the generation AI and providing detailed explanations" refers to a function that organizes the procedure list created by the generation AI in an easy-to-understand manner and provides specific and detailed explanations of its contents.

[1888] "Means including an emotion engine that recognizes the user's emotions and adjusts the system's behavior in accordance with the emotions" refers to a function that analyzes the user's emotions in real time from the information input by the user and the operating situation, and dynamically adjusts the system's behavior and display content based on the recognized emotions.

[1889] "Means to track user progress and remind users of incomplete procedures" is a function that tracks the progress of procedures the user is performing and automatically notifies the user of procedures that have not been completed.

[1890] System configuration and processing flow

[1891] 1. User Input Method

[1892] A user first logs into the system using a device such as a smartphone or smart glasses. After logging in, the user enters the information required to perform a specific procedure, such as a product search or service reservation. This information is data necessary for the user to achieve a specific purpose.

[1893] 2. Procedure listing using generative AI

[1894] The server collects information entered by the user and activates a generative AI model. This generative AI model (e.g., GPT-4 model) automatically generates a list of necessary procedures and tasks. During this process, a function is implemented to obtain the latest procedure information in real time based on the entered information.

[1895] 3. Organizing and explaining procedural information

[1896] The procedures listed by the AI ​​are organized in an easy-to-understand manner by the server. This procedure information is provided to the user's device along with detailed explanations. By referring to this, the user can understand the specific content and methods of the procedure.

[1897] 4. Emotional Engine Adjustment

[1898] When a user inputs information or performs an operation, the server activates the emotion engine. The emotion engine analyzes the user's input information and operation status in real time and recognizes the user's emotions. For example, if the user is feeling stressed, the device can display an encouraging message or a simple operation guide, improving user usability.

[1899] 5. Progress Tracking and Reminders

[1900] As the user completes each step, their progress is tracked by the server, and if there are any incomplete steps, the server automatically sends reminders to the user, helping them remember to complete the steps.

[1901] Specific examples

[1902] scenario

[1903] A customer is searching for a specific product in a physical store but is frustrated by long lines.

[1904] 1. The user logs in to the in-store terminal and selects "Product Search"

[1905] The terminal prompts the user to input the name of the product to be searched for.

[1906] The user enters "alcoholic beverages."

[1907] 2. The server uses a generative AI to list the procedures

[1908] The generative AI model obtains a list of products related to "alcoholic beverages" and sends it to the server.

[1909] 3. The server organizes the procedure information and provides it to the user.

[1910] The server organizes the procedure information and sends it to the terminal along with a detailed product description.

[1911] The terminal displays the product list and detailed descriptions to the user.

[1912] 4. The emotion engine recognizes and responds to user emotions

[1913] The emotion engine detects the user's stress, and the server displays an encouraging message.

[1914] 5. The user performs the procedure and reports progress

[1915] The user selects a product and completes the purchase process.

[1916] The server tracks the progress and assists until the procedure is completed.

[1917] Prompt Sentence Examples

[1918] After logging in to the system, press the "Product Search" button and enter "alcoholic beverages." If you feel stressed, enter "I'm frustrated by the long lines," and the system will take measures to alleviate your stress.

[1919] Hardware and software used

[1920] Hardware: Smartphones, smart glasses, servers

[1921] Software: Python, TensorFlow, GPT-4 model

[1922] Data processing details

[1923] 1. Data input: Input data from the user is collected on the terminal and sent to the server.

[1924] 2. Use of generative AI model: The server launches the GPT-4 model using the Python library and generates procedures based on user input.

[1925] 3. Emotion recognition: The emotion recognition model built using TensorFlow analyzes the user's input information and operation status in real time to recognize emotions.

[1926] 4. Data provision: Provide organized procedural information and messages corresponding to the user's emotions to the terminal.

[1927] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1928] Step 1: The user logs in to the system using a smartphone or smart glasses.

[1929] Input: Login information (user ID, password).

[1930] Specific operation: The terminal displays the login screen, and the user enters their ID and password. The entered information is sent to the server, where authentication is performed.

[1931] Output: A successful login message and the main menu screen.

[1932] Step 2: The user selects a specific procedure and enters the required information.

[1933] Input: Type of procedure (product search, service reservation, etc.), specific required information (product name, desired date and time, etc.).

[1934] Specific operation: The terminal displays the procedure selection screen, the user selects a procedure, and enters the required information. The input information is sent to the server.

[1935] Output: Input confirmation message and detailed input screen are displayed.

[1936] Step 3: The server uses the generative AI model to create a list of procedures.

[1937] Input: Information entered by the user.

[1938] How it works: The server uses Python and the GPT-4 model to generate relevant procedures and tasks based on the input information.

[1939] Output: A procedure list to send to the user's terminal.

[1940] Step 4: Organize the server-generated procedure list and provide detailed explanations.

[1941] Input: Procedural information listed by the generating AI.

[1942] Specific operation: The server organizes the procedure list, adds detailed instructions, and sends it to the user's terminal.

[1943] Output: Organized procedural information and detailed instructions.

[1944] Step 5: When the user inputs or performs an operation, the server activates the emotion engine and recognizes the user's emotion.

[1945] Input: User operation information, facial expression data, and voice input.

[1946] Specific operation: The emotion recognition model (using TensorFlow) analyzes the user's input information and operation status in real time to determine emotions.

[1947] Output: User's emotional state (e.g., stressed, excited, calm).

[1948] Step 6: The server adjusts the system behavior based on the emotion engine results and provides an appropriate message.

[1949] Input: User's emotional state information.

[1950] Specific operation: When the emotion engine recognizes a stressful state, it generates a message of encouragement or operational guidance and sends it to the user's device.

[1951] Output: Message display according to emotion.

[1952] Step 7: The user performs the procedure and reports its progress to the server.

[1953] Input: Procedure status information (completed, incomplete).

[1954] What it does: As the user completes each step, the device sends that information to the server, which tracks their progress.

[1955] Output: Progress updates, reminders of outstanding procedures.

[1956] In this way, appropriate data processing and calculations are performed based on input information at each processing step, and the entire system is designed to function smoothly.

[1957] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1958] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1959] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1960] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1961] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1962] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1963] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1964] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1965] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1966] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1967] ...

Claims

1. A means for a user to input information necessary for carrying out administrative procedures; A method for AI to generate a list of necessary procedures based on input information, A means of organizing and providing detailed explanations for the procedures listed by the generative AI; A way to track the user's progress and remind them of any outstanding steps; A system including:

2. The system of claim 1 , further comprising means for the generating AI to obtain the latest administrative procedure information in real time.

3. The system according to claim 1, further comprising means for managing a plurality of administrative procedures in a consolidated manner and for making applications in a centralized manner.

Images