System

Abstract

To provide a system.SOLUTION: A system includes: first means which receives input information including key words related to childbirth and residential region inputted by a user; second means which generates a first prompt sentence for outputting procedure related to life events of the user and supplementary information on the basis of the inputted information; third means which inputs the generated first prompt sentence to a generative AI model and generates procedure related to the user's life event and supplementary information; and fourth means which provides the user with the generated procedure related to the user's life event and supplementary information.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including a description and related instruction sentence regarding the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2022-180282 A Summary of the Invention [Problem to be solved by the invention]

[0004] There are issues with information about administrative procedures and various subsidies, such as what needs to be done, by when, and at which office. In addition, people have to look into it themselves in order to receive subsidies, and there is no one to inform them of various restrictions, such as not doing things by a deadline. [Means for solving the problem]

[0005] We provide a system that includes a means for centrally reading information on procedures and various subsidies from various government agencies, a means for accepting event input from users, and a means for providing guidance on procedures based on the input events.This system allows users to obtain information on necessary procedures and subsidies based on events that occur to them (birth, injury, illness, death, etc.). [Brief description of the drawings]

[0006] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Diagram 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. FIG. [Diagram 3] FIG. 11 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Diagram 5] FIG. 13 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 13 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 13 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 2 is a sequence diagram showing a process flow of the data processing system in the first embodiment of the first form example. [Figure 12] FIG. 11 is a sequence diagram showing a process flow of the data processing system in the application example 1 of the first embodiment. [Figure 13] FIG. 11 is a sequence diagram showing a process flow of the data processing system in the second embodiment of the second embodiment. [Figure 14] FIG. 13 is a sequence diagram showing a process flow of the data processing system in application example 2 of embodiment 2. [Figure 15] FIG. 13 is a sequence diagram showing a process flow of a data processing system in a third embodiment of the present invention. [Figure 16]FIG. 13 is a sequence diagram showing a process flow of the data processing system in the third application example of the third embodiment. [Figure 17] FIG. 13 is a sequence diagram showing the flow of processing in the data processing system in the first embodiment of the first form example when an emotion engine is combined. [Figure 18] FIG. 13 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Form Example 1 when combined with an emotion engine. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0008] First, the terms used in the following description will be explained.

[0009] In the following embodiments, a signed processor (hereinafter simply referred to as a "processor") may be one arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be one type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (TENSOR PROCESSING UNIT (registered trademark)).

[0010] In the following embodiments, a signed RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0011] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0012] In the following embodiments, a communication I / F (Interface) with a code is an interface including a communication processor and an antenna. The communication I / F controls communication between multiple computers. An example of a communication standard applied to the communication I / F is a wireless communication standard including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0013] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. In addition, in this specification, the same idea as "A and / or B" is also applied when three or more things are expressed by connecting them with "and / or."

[0014] [First embodiment]

[0015] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0016] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0017] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a wide area network (WAN) and / or a local area network (LAN).

[0018] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0019] The reception device 38 includes a touch panel 38A and a microphone 38B, and receives user input. The touch panel 38A detects contact with a pointer (e.g., a pen or a finger) to receive user input by the touch of the pointer. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0020] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (e.g., voice and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs voice according to instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, an aperture, and a shutter, and an imaging element such as a Complementary Metal-Oxide-Semiconductor (CMOS) image sensor or a Charge Coupled Device (CCD) image sensor.

[0021] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for transmitting and receiving various types of information between the processor 46 and the processor 28 via the network 54.

[0022] FIG. 2 shows an example of main functions of the data processing device 12 and the smart device 14.

[0023] As shown in Fig. 2, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32. The specific process program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific process program 56 from the storage 32, and executes the read specific process program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific process program 56 executed on the RAM 30.

[0024] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0025] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores a reception output program 60. The reception output program 60 is used together with the specific processing program 56 by the data processing system 10. The processor 46 reads out the reception output program 60 from the storage 50, and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0026] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0027] "Example 1"

[0028] The system of the present invention is equipped with a database that centrally reads information on procedures and various types of assistance from each government agency. This database can collect and update information from government agency websites and official documents. It also has an interface that accepts event input from users. This interface is provided in the form of a website or application, and allows users to input events that have occurred to them (birth, injury, illness, death, etc.). It then has the function of searching the database for information on necessary procedures and assistance based on the input event, and providing guidance to the user.

[0029] "Example 2"

[0030] As a specific example, when a user enters that they have given birth, the system searches the database for information on procedures and subsidies related to childbirth. For example, it provides information such as the deadline for submitting a birth notification, where to submit it, and how to apply for a lump-sum childbirth allowance. It also provides information on the area where the user lives, taking into account differences in subsidies by region. This allows users to be sure to complete the necessary procedures and receive assistance.

[0031] The process flow of each embodiment will be described below.

[0032] "Example 1"

[0033] Step 1: The system collects procedural and subsidy information from each government agency's website, official documents, etc. and stores it in a database.

[0034] Step 2: The user enters events that have occurred to them (birth, injury, illness, death, etc.) through an interface such as a website or application.

[0035] Step 3: Based on the entered event, the system searches the database for the necessary procedures and auxiliary information.

[0036] Step 4: The system guides the user through the search results, allowing them to take the necessary steps and receive assistance.

[0037] "Example 2"

[0038] Step 1: If the user enters birth, the system searches the database for information on procedures and assistance related to birth.

[0039] Step 2: The system will provide information such as the deadline for submitting the birth notification, where to submit it, and how to apply for the maternity benefit.

[0040] Step 3: The system also provides information about the area where the user lives, taking into account differences in subsidies depending on the region.

[0041] Step 4: This allows the user to ensure they take the necessary steps and receive assistance.

[0042] Example 1

[0043] Next, a description will be given of Example 1 of the embodiment 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal".

[0044] In conventional systems, users had to collect information on procedures and assistance from each government agency individually, making it difficult for users to quickly obtain the information they needed. In addition, there was a lack of a means to centrally provide information on procedures and assistance according to life events, increasing the time and effort required for users to carry out appropriate procedures. Furthermore, information had to be updated manually, making it difficult to provide the latest information.

[0045] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0046] In this invention, the server includes a means for centrally reading information on procedures and various assistance from each administrative agency, a means for accepting event input from a user, a means for providing guidance on procedures based on the input event, a means for storing collected information in a database and periodically updating it, a means for providing an interface accessible to the user, a means for searching the database based on the input event information, and a means for notifying the user of the search results. This allows the user to quickly obtain the latest information on procedures and assistance from a centralized location, and to efficiently carry out appropriate procedures.

[0047] "Each administrative agency" refers to a public institution such as the national government or a local government, which is an organization that provides information on procedures and subsidies.

[0048] A "procedure" refers to a formal procedure or method required to accomplish a particular objective.

[0049] "Subsidy" refers to financial or material support provided to individuals or organizations that meet certain criteria.

[0050] "Means of centrally loading information" refers to methods and technologies for centrally collecting information on procedures and subsidies from each administrative agency and storing it in a database.

[0051] "User" refers to an individual or organization that uses this system to obtain information and carry out procedures.

[0052] "Means for accepting event input" refers to an interface or method for a user to input life events that have occurred to them (such as birth, injury, illness, or death).

[0053] "Guidance means" refers to methods or technologies for providing relevant procedural or assistance information based on event information entered by a user.

[0054] A "database" refers to an information management system that stores collected information in an organized manner and allows it to be searched and updated.

[0055] "Interface" refers to the screens and applications through which a user accesses a system and enters or retrieves information.

[0056] "Search means" refers to methods and technologies for extracting relevant information from a database based on event information entered by a user.

[0057] "Means of presenting search results" refers to methods and technologies for presenting searched information to users in an easy-to-understand manner.

[0058] This invention is a system that centrally collects information on procedures and various subsidies from various government agencies and provides information on necessary procedures and subsidies based on event information entered by a user. A specific embodiment of this system will be described below.

[0059] Information collection and database updates

[0060] The server collects procedural and auxiliary information from the websites and official documents of each government agency. This collection is done using web scraping tools (e.g. Beautiful Soup (registered trademark) and Scrapy (registered trademark)) and APIs. The collected information is stored in databases such as MySQL (registered trademark) and PostgreSQL (registered trademark). The server periodically runs the crawler to update the information.

[0061] Providing a user interface

[0062] The server provides an interface where the user can input event information. This interface is provided in the form of a web interface using React (registered trademark) or Vue.js (registered trademark), or a mobile application using Flutter (registered trademark). The terminal displays these interfaces when accessed by the user.

[0063] Accepting event input

[0064] The user inputs events that have occurred to them (birth, injury, illness, death, etc.) through the provided interface. For example, if the user inputs the event "birth," they can enter the expected date of birth and hospital information. The terminal sends the input event information to the server. The HTTPS protocol is used for transmission to ensure data security.

[0065] Search and find the information you need

[0066] The server searches the database using SQL queries and ElasticSearch (registered trademark) based on the event information entered by the user. For example, it searches for information on procedures and subsidies related to "childbirth." The server then presents the search results to the user. For example, it displays information on procedures related to childbirth (submitting a birth notification, applying for child allowance, etc.) and subsidies (lump-sum childbirth and child care grants, etc.).

[0067] Examples

[0068] For example, if a user enters the event "birth," the server searches the database for information on birth-related procedures (submitting a birth notification, applying for child allowance, etc.) and subsidies (lump-sum childbirth and child care grants, etc.) and provides guidance to the user.

[0069] Examples of prompt statements

[0070] Examples of prompts to be input to a generative AI model include the following:

[0071] "When a user inputs the event of childbirth, please explain the system process that guides them to relevant procedures and support information."

[0072] By inputting this prompt sentence into a generative AI model, a sentence is generated that explains the specific processing content of the system in natural language.

[0073] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0074] Step 1: Collect information and update the database

[0075] The server collects procedural and auxiliary information from the websites and official documents of each government agency. Specifically, the information is obtained using web scraping tools (e.g. Beautiful Soup and Scrapy) and APIs. The collected information is stored in a database such as MySQL or PostgreSQL. The server periodically runs the crawler to update the information.

[0076] Input: Websites and official documents of each government agency

[0077] Output: Procedure and auxiliary information stored in a database

[0078] Step 2: Providing a User Interface

[0079] The server provides an interface that allows users to input event information. Specifically, it develops and provides a web interface using React or Vue.js, or a mobile application using Flutter. The terminal displays these interfaces when the user accesses them.

[0080] Input: User access

[0081] Output: Event information input screen

[0082] Step 3: Accepting event input

[0083] The user inputs events that have occurred to them (birth, injury, illness, death, etc.) through the provided interface. For example, if the user inputs the event "birth," they can enter the expected date of birth and hospital information. The terminal sends the input event information to the server. The HTTPS protocol is used for transmission to ensure data security.

[0084] Input: User-entered event information

[0085] Output: Event information sent to the server

[0086] Step 4: Finding the information you need

[0087] The server searches the database using SQL queries and Elasticsearch (registered trademark) based on the event information entered by the user. For example, it searches for information on procedures and assistance related to "birth."

[0088] Input: User-entered event information

[0089] Output: Procedures and supporting information as search results

[0090] Step 5: Navigate through search results

[0091] The server informs the user of the search results. Specifically, it uses methods and technologies to present the searched information to the user in an easy-to-understand manner. For example, it displays information on procedures related to childbirth (submitting a birth notification, applying for child allowance, etc.) and subsidies (lump-sum childbirth and childcare grants, etc.).

[0092] Input: Procedure and auxiliary information as search results

[0093] Output: Information about the procedure or assistance provided to the user

[0094] Step 6: Update your information

[0095] The server periodically runs a crawler to keep the information in the database up to date, ensuring that the information provided to users is always up to date.

[0096] Input: Latest information from each government agency

[0097] Output: Updated database

[0098] (Application example 1)

[0099] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0100] In the conventional system, it was difficult to centrally manage the procedures and supplementary information of each government agency, making it difficult for users to quickly obtain the information they needed. In addition, there was a lack of means to provide appropriate procedures and supplementary information in real time for events occurring in physical stores, which reduced user convenience. This caused problems such as users being unable to use procedures and supplementary information appropriately.

[0101] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0102] In this invention, the server includes a means for centrally reading information on procedures and various assistance from each government agency, a means for accepting event input from a user, a means for providing information on procedures based on the input event, a means for inputting an event that occurred in a real store by the user, and a means for providing information on procedures and assistance in real time based on the input event. This enables a user to quickly obtain necessary procedure and assistance information for an event that occurred in a real store and take appropriate action.

[0103] "Each administrative agency" refers to a public institution such as the national or local government, which is an organization that handles procedures and provides subsidies.

[0104] A "procedure" refers to a formal procedure or method required to accomplish a particular objective.

[0105] "Assistance" refers to financial or material support provided to achieve a specific purpose.

[0106] "Means for centrally reading information" refers to a method or device for centrally collecting and managing data from multiple sources.

[0107] "User" refers to any individual or entity that uses the System.

[0108] "Means for accepting event input" refers to a method or device that allows a user to input an occurrence or situation into the system.

[0109] "Means for providing information" refers to a method or device for providing the user with the necessary information.

[0110] "Brick and mortar store" refers to a commercial establishment that exists in a physical location and offers goods and services.

[0111] "Real-time" refers to immediate processing or response without delay.

[0112] "Procedure or assistance information" refers to detailed data or instructions relating to a particular procedure or assistance.

[0113] A system for implementing this invention includes means for centrally reading information on procedures and various assistance from each government agency, means for accepting event input from a user, means for providing guidance on procedures based on the input events, means for inputting events that occur in a physical store by a user, and means for providing information on procedures and assistance in real time based on the input events.

[0114] System Programming

[0115] The server collects procedures and supporting information from the websites and official documents of each government agency and stores it in a database. When a user inputs an event using a smartphone or smart glasses, the information is sent to the server. The server searches the database for related procedures and supporting information based on the input event and provides the user with guidance in real time.

[0116] Hardware and software used

[0117] Hardware: Smartphones, smart glasses

[0118] Software: Flask (a Python web framework), requests (a Python library for sending HTTP requests)

[0119] Data processing and calculation

[0120] 1. Event input: The user inputs an event via a smartphone or smart glasses.

[0121] 2. Database integration: Based on the entered event information, the server sends a request to the database API.

[0122] 3. Information retrieval: Retrieve relevant procedure and assistance information from the database.

[0123] 4. Real-time guidance: The acquired information is provided to the user in real time.

[0124] Examples

[0125] When a user enters "return product" on their smartphone, the server retrieves information about the return procedure from the database and provides it to the user, allowing the user to quickly complete the necessary procedures.

[0126] Examples of prompt statements

[0127] The user has entered "return product" on their smartphone. Retrieve information about the return procedure from the database and guide the user.

[0128] In this way, a system can be realized that improves the user experience in a physical store.

[0129] The flow of the specific process in the application example 1 will be described with reference to FIG.

[0130] Step 1:

[0131] Users input events using a smartphone or smart glasses.

[0132] Input: The event the user occurred (e.g. "return product")

[0133] Output: Event information is sent from the device to the server.

[0134] Specific operation: The user opens the smartphone application, enters an event such as "product return" on the event input screen, and presses the send button.

[0135] Step 2:

[0136] The server analyzes the received event information.

[0137] Input: Event information sent from the device

[0138] Output: Parsed event information

[0139] Specific operation: The server analyzes the received event information and identifies the type of event (e.g., "product return").

[0140] Step 3:

[0141] The server sends a request to the database API to retrieve relevant procedures and auxiliary information.

[0142] Input: Parsed event information

[0143] Output: Procedures and auxiliary information retrieved from the database

[0144] Specific operation: The server requests procedures and auxiliary information related to "product returns" from the database API and retrieves the relevant information from the database.

[0145] Step 4:

[0146] The server provides the user with real-time information on procedures and auxiliary information obtained.

[0147] Input: Procedures and supporting information retrieved from the database

[0148] Output: Instructions and support information provided to the user

[0149] Specific operation: The server sends the acquired information to a smartphone or smart glasses application, and displays the procedure details and auxiliary information to the user.

[0150] Step 5:

[0151] The user carries out the procedure based on the information provided.

[0152] Input: Procedures and auxiliary information provided by the server

[0153] Output: Specific steps that the user will take

[0154] Specific actions: The user checks the details of the procedure displayed on their smartphone or smart glasses and carries out the necessary procedures (e.g., going to the returns counter, preparing the necessary documents).

[0155] Example 2

[0156] Next, a second embodiment of the second embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0157] In the conventional system, users had to search multiple government agencies and information sources individually to obtain procedures and supplementary information related to life events, which was time-consuming and laborious. In addition, because supplementary information differs by region, it was difficult for users to obtain information appropriate to their own area of ​​residence.

[0158] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0159] In this invention, the server includes a means for centrally reading information on procedures and various assistance from each administrative agency, a means for accepting an event input from a user, a means for providing procedure information based on the input event, a means for accepting information on the user's residential area, a means for providing assistance information for each area based on the accepted residential area information, a means for searching a database to obtain related information, and a means for providing the obtained information to the user. This allows the user to easily obtain procedures and assistance information related to life events through one system, and assistance information for each area is also provided appropriately.

[0160] "Each administrative agency" refers to a public agency such as the national or local government, which is responsible for providing information on procedures and subsidies.

[0161] A "procedure" refers to a formal procedure or method required to accomplish a particular objective.

[0162] "Subsidy" refers to financial or material support provided to individuals or organizations that meet certain criteria.

[0163] "Means for centrally reading information" refers to a method or device for centrally collecting necessary data from multiple sources.

[0164] "User" refers to an individual or entity that uses the System to input information and obtain required procedures and supporting information.

[0165] "Event input" refers to the act of a user inputting information about a specific life event (e.g. birth, injury, illness, death, etc.) into the system.

[0166] "Means for providing guidance" refers to a method or device for providing appropriate procedures or auxiliary information based on information input by a user.

[0167] "Residence area information" refers to information about the area where the user currently lives, and is used to provide auxiliary information for each area.

[0168] "Database" refers to a system for efficiently storing, retrieving, and managing information.

[0169] "Means for searching and obtaining relevant information" refers to a method or device for searching information in a database and obtaining the data required by the user.

[0170] "Means for providing" refers to a method or device for displaying the acquired information in a format that is easy for the user to understand.

[0171] The present invention provides a system that allows a user to easily obtain procedures and auxiliary information related to a life event. A specific embodiment of this system will be described below.

[0172] System Configuration

[0173] This system is composed of three main elements: a server, a terminal, and a user. The server includes a means for centrally reading information on procedures and various assistance from each government agency, a means for accepting event input from the user, a means for providing procedure guidance based on the input event, a means for accepting information on the user's residential area, a means for providing assistance information for each area based on the accepted residential area information, a means for searching a database to obtain related information, and a means for providing the obtained information to the user.

[0174] Hardware and Software Used

[0175] The server uses MySQL as a database management system and executes programs to process information entered by users. The terminal is a device such as a PC or smartphone that provides an interface for users to enter information. Users use the terminal to access the system and enter the required information.

[0176] Data processing and calculation

[0177] The server takes the information entered by the user and searches the MySQL database to retrieve any relevant procedures or auxiliary information, by executing SQL queries such as:

[0178] sql

[0179] SELECT FROM procedures WHERE keyword = 'birth' AND region = 'Tokyo';

[0180] The server organizes the acquired information and provides it to the user in an easy-to-understand format.

[0181] Examples

[0182] For example, if a user enters "birth" and selects "Tokyo" as their place of residence, the server provides the following information:

[0183] Deadline for submitting birth notification: Within 14 days after birth

[0184] Submit to: City / ward / town / village office

[0185] How to apply for maternity benefits: Apply to your health insurance association

[0186] Tokyo Metropolitan Government Subsidy Information: In addition to the lump-sum childbirth allowance, Tokyo Metropolitan Government provides additional subsidies if certain conditions are met.

[0187] Examples of prompt statements

[0188] If a user enters "birth" and selects "Tokyo" as their area of ​​residence, please provide information on the deadline and place to submit the birth notification, how to apply for the lump-sum birth allowance, and information on Tokyo's subsidies.

[0189] This system allows users to easily obtain procedures and supplementary information related to life events through a single interface. In addition, supplementary information for each region is provided appropriately, so users can obtain information appropriate for their own area.

[0190] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0191] Step 1:

[0192] The user enters the information.

[0193] The user opens a browser on the terminal, accesses the web page of the system, enters information related to the birth into the input form, and clicks the "Search" button.

[0194] Input: Information related to birth (e.g. birth, place of residence)

[0195] Output: User input is sent to the server

[0196] Step 2:

[0197] The server receives the input information.

[0198] The server receives the information entered by the user, which includes birth-related keywords and the area of ​​residence.

[0199] Input: User input information

[0200] Output: The database is ready to be searched based on the input information received.

[0201] Step 3:

[0202] The server searches the database.

[0203] The server connects to a MySQL database and executes a query based on the information entered by the user, for example executing a SQL query like this:

[0204] sql

[0205] SELECT FROM procedures WHERE keyword = 'birth' AND region = 'Tokyo';

[0206] Input: User input information (keywords and area of ​​residence)

[0207] Output: Relevant information retrieved from the database

[0208] Step 4:

[0209] The server processes the search results.

[0210] The server processes the information retrieved from the database, such as the deadline for submitting birth notification, where to submit it, how to apply for a lump-sum birth allowance, and information on subsidies by region.

[0211] Input: Relevant information retrieved from the database

[0212] Output: Organized information (e.g. deadline for submitting birth notification, where to submit it, how to apply for childbirth lump sum payment, subsidy information by region)

[0213] Step 5:

[0214] The server provides the information to the user.

[0215] The server then presents the organized information to the user, typically in the form of a web page that displays information such as:

[0216] Deadline for submitting birth notification: Within 14 days after birth

[0217] Submit to: City / ward / town / village office

[0218] How to apply for maternity benefits: Apply to your health insurance association

[0219] Tokyo Metropolitan Government Subsidy Information: In addition to the lump-sum childbirth allowance, Tokyo Metropolitan Government provides additional subsidies if certain conditions are met.

[0220] Input: Organized information

[0221] Output: Information provided to the user

[0222] In this way, the user can be sure to take the necessary steps and receive appropriate assistance.

[0223] (Application example 2)

[0224] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0225] When users face life events such as childbirth, it is difficult for them to quickly and accurately obtain information on necessary procedures and subsidies. In addition, there is a lack of a centralized means of providing information on subsidies and related services by region, making it difficult for users to receive appropriate support.

[0226] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0227] In this invention, the server includes a means for centrally reading information on procedures and various subsidies of each government agency, a means for accepting event input from a user, a means for guiding the procedures based on the input event, a means for providing subsidy information for each region based on the user's residential area, and a means for displaying related services based on the user's input. This allows the user to quickly and accurately obtain information on procedures and subsidies related to life events such as childbirth, and to centrally receive information on subsidies for each region and information on related services.

[0228] "A means of centrally reading information on procedures and various subsidies from each administrative agency" is a function for centrally collecting information on procedures and subsidies provided by multiple administrative agencies and storing it in a database.

[0229] The "means for accepting event input from a user" refers to an interface that enables a user to input a specific life event (e.g., birth, injury, illness, death, etc.) into the system.

[0230] The "means for providing guidance regarding procedures based on an input event" is a function for searching for procedure information related to a life event input by the user and providing it to the user.

[0231] The "means for providing regional subsidy information based on the user's region of residence" is a function for searching for subsidy information specific to that region based on the region of residence input by the user and providing it to the user.

[0232] "Means for displaying related services based on user input" refers to a function for searching for related services (e.g. obstetricians, baby goods stores, childcare support centers, etc.) based on information entered by the user and displaying them to the user.

[0233] The system for carrying out the present invention includes a server, a user terminal, and a database. The server includes a means for centrally reading information on procedures and various subsidies of each government agency, a means for accepting event input from a user, a means for providing procedure information based on the input event, a means for providing subsidy information by region based on the user's residential area, and a means for displaying related services based on the user's input.

[0234] Explanation of program processing

[0235] 1. A way to centrally read information on procedures and various subsidies from various government agencies

[0236] The server periodically collects information on procedures and assistance provided by each government agency and stores it in a database, so that users can always receive the latest information.

[0237] 2. A means of accepting event input from the user

[0238] Through a user terminal (such as a smartphone or smart glasses), the user inputs a specific life event (e.g., childbirth). The input interface is designed to be intuitive and easy to use.

[0239] 3. A means of providing procedural guidance based on entered events

[0240] The server searches the database for relevant procedural information based on the life event entered by the user and provides it to the user. For example, in the case of childbirth, information such as the deadline for submitting a birth notification, where to submit it, and how to apply for a lump-sum birth benefit are displayed.

[0241] 4. A way to provide local grant information based on where a user lives

[0242] Based on the user's input of the residential area information, the server searches the database for subsidy information specific to that area and provides it to the user, allowing the user to easily check the subsidies available in his / her area.

[0243] 5. How to display relevant services based on user input

[0244] The server searches for related services (e.g. obstetricians, baby goods stores, childcare support centers, etc.) based on the information entered by the user and displays them to the user, allowing the user to quickly find the services they need.

[0245] Examples

[0246] For example, if a user enters "birth" and "Tokyo," the server provides the following information:

[0247] Deadline and place to submit birth notification

[0248] How to apply for maternity benefits

[0249] Tokyo-specific subsidy information

[0250] Information on nearby obstetrics and gynecology clinics, baby goods stores, and childcare support centers

[0251] Example prompts to be input to the generative AI model

[0252] "Create an application that provides information on procedures and subsidies related to childbirth when a user enters their expected delivery date and area of ​​residence. For example, it displays the deadline and place to submit the birth notification, how to apply for the lump-sum childbirth allowance, and subsidy information by area."

[0253] In this way, users can quickly and accurately obtain the information they need and take the appropriate steps.

[0254] The flow of the specific process in the application example 2 will be described with reference to FIG.

[0255] Step 1:

[0256] The server periodically collects information on procedures and assistance provided by each government agency and stores it in a database. Specifically, it uses APIs and web scraping technology to obtain information from the websites and databases of each government agency. The input is data from the websites and databases of each government agency, and the output is information on procedures and assistance stored in the server's database.

[0257] Step 2:

[0258] A user inputs a specific life event (e.g., childbirth) using a terminal such as a smartphone or smart glasses. The input interface is designed to be intuitive and easy to use. The input is the life event information that the user enters into the terminal, and the output is the life event information sent to the server.

[0259] Step 3:

[0260] The server searches the database for relevant procedure information based on the life event input by the user and provides it to the user. Specifically, it uses an SQL query to search the database and obtains the relevant procedure information. The input is the life event information input by the user, and the output is the procedure information provided to the user.

[0261] Step 4:

[0262] The user inputs the residential area information into the terminal. The input interface is designed to allow the user to easily input the area information. The input is the residential area information that the user inputs into the terminal, and the output is the residential area information that is sent to the server.

[0263] Step 5:

[0264] The server searches the database for subsidy information specific to the region based on the residential area information entered by the user, and provides it to the user. Specifically, it uses an SQL query to search the database and obtains the relevant subsidy information. The input is the residential area information entered by the user, and the output is the subsidy information provided to the user.

[0265] Step 6:

[0266] The server searches for related services (e.g. obstetricians, baby goods stores, childcare support centers, etc.) based on the information entered by the user and displays them to the user. Specifically, it retrieves related service information from a database and displays it on the user's terminal. The input is the life event information and residential area information entered by the user, and the output is related service information provided to the user.

[0267] In this way, the user can quickly and accurately obtain the necessary information and take the appropriate steps.

[0268] Furthermore, an emotion engine that estimates the emotion of the user may be combined. That is, the identification processing unit 290 may estimate the emotion of the user using the emotion identification model 59, and perform identification processing using the emotion of the user.

[0269] "Example 1"

[0270] In one embodiment of the present invention, an emotion engine is incorporated. This emotion engine recognizes emotions from the user's tone of voice, facial expression, text input, etc. Specifically, the emotion is estimated from the tone, strength, speed, etc. of the voice when the user speaks to the system. In addition, when the user shows the system his or her face through a webcam, etc., emotion is estimated using facial expression recognition technology. Furthermore, when the user inputs text, emotion is estimated from the wording and context of the text.

[0271] "Example 2"

[0272] In addition, in one embodiment of the present invention, the content and method of guidance are adjusted based on the emotion recognized by the emotion engine. Specifically, if the system estimates that the user is angry or frustrated, the system uses more polite language to provide guidance. If the system estimates that the user is confused or anxious, the system provides a more detailed explanation. This allows optimal guidance to be provided according to the user's emotions.

[0273] The process flow of each embodiment will be described below.

[0274] "Example 1"

[0275] Step 1: The user speaks to the system. At this time, the emotion engine captures the tone, strength, and speed of the user's voice.

[0276] Step 2: The emotion engine estimates the user's emotion from voice characteristics.

[0277] Step 3: The user shows the system their face via a webcam or other device. At this time, the user's facial expressions are captured by the emotion engine.

[0278] Step 4: The emotion engine uses facial expression recognition technology to estimate the user's emotions.

[0279] Step 5: The user enters text, whose phrasing and context are captured by the emotion engine.

[0280] Step 6: The sentiment engine infers the user's sentiment from the text content.

[0281] "Example 2"

[0282] Step 1: The emotion engine recognizes the user's emotion.

[0283] Step 2: The system adjusts the content and method of guidance based on the emotions recognized by the emotion engine.

[0284] Step 3: If the system estimates that the user is angry or frustrated, it will provide more polite guidance.

[0285] Step 4: If the system estimates that the user is confused or anxious, it will provide a more detailed explanation.

[0286] Example 1

[0287] Next, a description will be given of Example 1 of the embodiment 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal".

[0288] Conventional systems for providing administrative procedures and auxiliary information have the problem that it is difficult for users to quickly and accurately obtain the information they need. In addition, the user experience can be poor because information is provided without considering the user's feelings. This creates an issue that makes it difficult for users to carry out appropriate procedures, especially during stressful life events.

[0289] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0290] In this invention, the server includes a means for centrally reading information on procedures and various subsidies of each government agency, a means for accepting event input from the user, a means for providing guidance on procedures based on the input event, a means for recognizing the user's emotions, and a means for adjusting the guidance content based on the emotions. This not only enables the user to quickly and accurately obtain the information he or she needs, but also makes it possible to provide information that takes the user's emotions into consideration.

[0291] "Each administrative agency" refers to a public institution such as a national or local government, which is an organization that provides specific administrative services or procedures.

[0292] A "procedure" refers to a formal step or process required to achieve a particular objective.

[0293] "Subsidy" refers to financial or material support provided to individuals or organizations that meet certain criteria.

[0294] "Means of centrally loading information" refers to technologies and methods for collecting data from multiple sources and managing it centrally.

[0295] "User" refers to any individual or organization that uses this system.

[0296] "Event input" refers to the act of a user inputting a specific occurrence or situation into the system.

[0297] "Means of guidance" refers to technologies and methods for providing users with the necessary information and encouraging them to go through the appropriate procedures.

[0298] "Means of recognizing emotions" refers to technologies and methods for inferring emotions from a user's tone of voice, facial expressions, text input, etc.

[0299] "Means for adjusting guidance content based on emotions" refers to techniques or methods for appropriately changing the information or guidance content provided in response to the recognized emotions of the user.

[0300] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0301] The system of the present invention is equipped with a database that centrally reads information on procedures and various types of assistance from each government agency. This database can collect and update information from government agency websites and official documents. It also has an interface that accepts event input from users. This interface is provided in the form of a website or application, and allows users to input events that have occurred to them (birth, injury, illness, death, etc.). It then has the function of searching the database for information on necessary procedures and assistance based on the input event, and providing guidance to the user.

[0302] In one embodiment of the present invention, an emotion engine is incorporated. This emotion engine recognizes emotions from the user's tone of voice, facial expression, text input, etc. Specifically, the emotion is estimated from the tone, strength, speed, etc. of the voice when the user speaks to the system. In addition, when the user shows the system his or her face through a webcam, etc., emotion is estimated using facial expression recognition technology. Furthermore, when the user inputs text, emotion is estimated from the wording and context of the text.

[0303] Hardware and Software Used

[0304] The server collects information from government websites and official documents and stores it in a database. This is done using web scraping technology and APIs. Specific software used includes Python's BeautifulSoup and Scrapy, and API client libraries.

[0305] Users input their events through a website or application. For example, if a user inputs "birth", the system takes that information and searches the database for related procedure and ancillary information. This search process is done using SQL queries and full-text search engines (e.g. Elasticsearch).

[0306] The server displays the search results to the user using an HTML template engine (e.g., Jinja2 (registered trademark)) or a front-end framework (e.g., React, Vue.js).

[0307] When a user speaks to the system, the emotion engine uses voice recognition technology to estimate emotions from the tone, strength, speed, etc. of the voice. Specific software used is Google (registered trademark) Cloud Speech-to-Text and IBM Watson (registered trademark) Speech to Text (registered trademark).

[0308] When a user shows their face to the system through a webcam, the system uses facial expression recognition technology to estimate emotions. Specific software used is OpenCV (registered trademark) and Microsoft (registered trademark) Azure (registered trademark) Face API.

[0309] When a user enters text, the system infers emotions from the vocabulary and context of the text. Hugging Face's Transformers library and Google Cloud Natural Language API are used to analyze emotions using natural language processing techniques.

[0310] Examples and prompts

[0311] As a specific example, the process when the user inputs "birth" will be described.

[0312] 1. The user enters "birth" into the website's input form and clicks the submit button.

[0313] 2. The terminal sends this input to the server.

[0314] 3. The server searches the database based on the received event information.

[0315] 4. The server embeds the search results into an HTML template and sends it to the terminal.

[0316] 5. The device displays the received HTML in the browser.

[0317] Example prompt:

[0318] When a user enters "birth", search for and display information on related procedures and assistance.

[0319] In this way, the system of the present invention can quickly provide the user with the information they need. In addition, by using the emotion engine, it is possible to provide information that takes into account the user's emotions, which is expected to improve the user experience.

[0320] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0321] Program processing flow

[0322] Step 1: Gather information

[0323] The server collects information from government websites and official documents.

[0324] Input: Government agency website URL or API endpoint

[0325] Specific behavior:

[0326] The server periodically accesses the government agency's website.

[0327] The server uses web scraping technologies (e.g. BeautifulSoup, Scrapy) to parse the HTML document and extract the required information.

[0328] The server uses the API client library to retrieve data from the API.

[0329] Output: Extracted information (procedure and auxiliary details)

[0330] Step 2: Saving to the Database

[0331] The server stores the collected information in a database.

[0332] Input: Extracted information (procedure and supporting details)

[0333] Specific behavior:

[0334] The server establishes a database connection.

[0335] The server generates SQL queries and inserts the extracted information into a database.

[0336] Output: Information stored in the database

[0337] Step 3: Accepting User Input

[0338] Users enter their events through a website or application.

[0339] Input: Event information entered by the user (e.g. "birth")

[0340] Specific behavior:

[0341] The user enters event information into the input form on the website and clicks the submit button.

[0342] The terminal transmits the input data to the server.

[0343] Output: Event information sent to the server

[0344] Step 4: Database search

[0345] The server searches the database based on the event information received from the user.

[0346] Input: Event information sent by the user

[0347] Specific behavior:

[0348] The server analyzes the received event information and extracts related keywords.

[0349] The server generates the SQL query and performs the search against the database.

[0350] Output: Search results (related procedures and supporting information)

[0351] Step 5: View the results

[0352] The server displays the search results to the user.

[0353] Input: Search results (related procedures and supporting information)

[0354] Specific behavior:

[0355] The server embeds the search results into an HTML template.

[0356] The server transmits the generated HTML to the terminal.

[0357] The terminal displays the received HTML in the browser.

[0358] Output: The search results displayed to the user

[0359] Step 6: Emotion Recognition

[0360] When a user speaks to the system, the emotion engine uses voice recognition technology to infer emotions from the tone, strength, speed, etc. of the voice.

[0361] Input: User's voice data

[0362] Specific behavior:

[0363] The user speaks to the system through a microphone.

[0364] The terminal transmits the voice data to the server.

[0365] The server sends the voice data to a speech recognition API (e.g., Google Cloud Speech-to-Text) and converts it into text.

[0366] The server analyzes the converted text and estimates the sentiment.

[0367] Output: Estimated emotion data

[0368] Step 7: Tailor your message based on emotion

[0369] The server appropriately changes the information and guidance it provides based on the recognized user's emotions.

[0370] Input: Estimated emotion data

[0371] Specific behavior:

[0372] The server analyzes the emotion data to determine the user's emotional state.

[0373] The server adjusts the guidance content (e.g., gentler language, additional support information) depending on the emotional state.

[0374] Output: Adjusted guidance content

[0375] In this way, the system of the present invention is not only able to quickly provide the user with the necessary information, but also able to provide information that takes into consideration the user's feelings.

[0376] (Application example 1)

[0377] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0378] Conventional systems for providing administrative procedures and auxiliary information have the problem that it is difficult for users to quickly and accurately obtain the information they need. In addition, they are unable to respond flexibly to the user's emotions and circumstances, which can result in a poor user experience. In particular, in brick-and-mortar stores, there is a need to grasp the emotions and needs of customers in real time and provide appropriate services, but current systems have difficulty in achieving this.

[0379] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0380] In this invention, the server includes a means for centrally reading information on procedures and various subsidies from each government agency, a means for accepting event input from the user, a means for providing guidance on procedures based on the input event, a means for recognizing the user's emotions, and a means for adjusting the guidance content based on the recognized emotions. This allows the user to quickly and accurately obtain the information he or she needs, and also enables flexible responses according to the user's emotions and circumstances. In particular, in physical stores, it becomes possible to grasp the emotions and needs of customers in real time and provide appropriate services.

[0381] "A means of centrally reading information on procedures and various subsidies from each administrative agency" refers to a system for centrally collecting information on procedures and subsidies provided by multiple administrative agencies and storing it in a database.

[0382] The "means for accepting event input from the user" is a system that provides an interface for the user to input life events that have occurred to him or her (such as birth, injury, illness, or death).

[0383] The "means for providing guidance regarding procedures based on an input event" is a system that searches for the necessary procedures and auxiliary information corresponding to the life event input by the user and provides them to the user.

[0384] "Means for recognizing user emotions" refers to a system that detects the user's emotional state using technologies such as voice recognition, facial expression recognition, and text analysis.

[0385] The "means for adjusting the guidance content based on the recognized emotion" is a system that appropriately changes the information and guidance content provided depending on the user's emotional state.

[0386] "Speech recognition" is a technology that converts a user's voice into text data and analyzes the content.

[0387] "Facial expression recognition" is a technology that captures a user's facial expressions using a camera or other device and infers emotions from those expressions.

[0388] "Text analysis" is a technology that analyzes text data entered by the user and understands its content and sentiment.

[0389] A "generative AI model" is a model that uses artificial intelligence to generate appropriate responses and guidance based on user input and emotions.

[0390] A "prompt" is an instruction given to a generative AI model that serves as the basis for generating a specific response or guidance.

[0391] A system for implementing the present invention has the following configuration.

[0392] System Configuration

[0393] 1. Hardware:

[0394] Smartphone or smart glasses: Used as a user interface.

[0395] Webcam: Built into the smart glasses and used to recognize the user's facial expressions.

[0396] Microphone: Built into the smart glasses and used to recognize the user's voice.

[0397] 2. Software:

[0398] Speech recognition engine: Uses Google Cloud Speech-to-Text to convert user speech into text.

[0399] Facial Expression Recognition Engine: Uses Microsoft Azure Face API to recognize emotions from the user's facial expressions.

[0400] Text Analysis Engine: Uses OpenAI(R) GPT-4(R) to analyze the content and sentiment of the text entered by the user.

[0401] Database management system: Uses MySQL to store procedures and supporting information for each government agency.

[0402] Processing flow

[0403] 1. User Interface:

[0404] Users access the system via a smartphone or smart glasses.

[0405] The user enters their own life events (e.g. birth, injury, illness, death, etc.).

[0406] 2. Data collection and analysis:

[0407] The speech recognition engine converts the user's speech into text.

[0408] The facial expression recognition engine analyzes the user's facial expressions through the webcam and recognizes their emotions.

[0409] The text analytics engine analyzes the user's input text to understand their sentiments and needs.

[0410] 3. Information provision:

[0411] The database management system is used to search for procedures and supporting information related to the user's life events.

[0412] Based on the recognized emotions, the generative AI model generates appropriate prompts and tailors the information provided to the user.

[0413] Examples

[0414] For example, if a user says, "I recently had a baby," the following processing occurs:

[0415] 1. Voice Recognition:

[0416] A speech recognition engine converts what the user says into text.

[0417] 2. Emotion recognition:

[0418] The facial expression recognition engine recognizes the emotion of joy from the user's facial expression.

[0419] The text analysis engine extracts the keyword "childbirth" and analyzes associated sentiment.

[0420] 3. Information provision:

[0421] Search the database for childbirth-related procedures and supporting information.

[0422] The generative AI model generates a prompt like this:

[0423] If a customer says, "I recently had a baby," suggest products and services related to childbirth. Recognize the emotion of joy from the customer's tone of voice and facial expression, and make appropriate suggestions.

[0424] The suggestions are displayed on the smart glasses display and guided to the user.

[0425] In this way, it becomes possible to respond flexibly to users' emotions and needs, improving the quality of customer service in physical stores.

[0426] The flow of the specific process in the application example 1 will be described with reference to FIG.

[0427] Step 1:

[0428] A user accesses the system through a smartphone or smart glasses. The user inputs his / her own life events (e.g. birth, injury, illness, death, etc.). The input event data is sent to the server.

[0429] Step 2:

[0430] The server uses a speech recognition engine (Google Cloud Speech-to-Text) to convert the user's voice into text. The input is voice data, and the output is text data. The server analyzes the voice data and generates the corresponding text data.

[0431] Step 3:

[0432] The server uses a facial expression recognition engine (Microsoft Azure Face API) to analyze facial expressions from the user's facial image captured through a webcam. The input is facial image data, and the output is emotion data. The facial image data is analyzed to estimate the user's emotional state.

[0433] Step 4:

[0434] The server uses a text analysis engine (OpenAI GPT-4) to analyze the text data entered by the user. The input is text data, and the output is emotion data and needs data. The text data is analyzed to understand the user's emotions and needs.

[0435] Step 5:

[0436] The server searches the database management system (MySQL) for procedures and auxiliary information related to the user's life events. The input is life event data, and the output is procedure information and auxiliary information. Based on the life event data, related information is retrieved from the database.

[0437] Step 6:

[0438] The server generates an appropriate prompt sentence using a generative AI model based on the recognized emotion. The input is emotion data and need data, and the output is a prompt sentence. Based on the emotion data and need data, a prompt sentence is generated to adjust the information provided to the user.

[0439] Step 7:

[0440] The server adjusts the information to be provided to the user based on the generated prompt text and displays it on the smart glasses display. The input is the prompt text and procedural information, and the output is the display information. Based on the prompt text and procedural information, the server provides the user with the most appropriate information.

[0441] Example 2

[0442] Next, a second embodiment of the second embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0443] In conventional systems, when users tried to obtain information on procedures and assistance related to life events, they were not provided with appropriate guidance based on their emotions, which often left users feeling anxious or confused. In addition, the system did not provide enough information based on individual needs, such as information on subsidies by region. This made it difficult for users to complete the necessary procedures and receive appropriate assistance.

[0444] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0445] In this invention, the server includes a means for centrally reading information on procedures and various types of assistance from each administrative agency, a means for accepting event input from the user, a means for providing guidance on procedures based on the input event, a means for analyzing the user's emotions, and a means for adjusting the content and method of guidance based on the emotion analysis result. This enables optimal guidance according to the user's emotions, allowing the user to reliably carry out the necessary procedures and receive appropriate assistance.

[0446] "Each administrative agency" refers to a public institution such as the national or local government, which is an organization that handles procedures and provides subsidies.

[0447] A "procedure" refers to a formal procedure or method required to accomplish a particular objective.

[0448] "Subsidy" refers to financial or material support provided to individuals or organizations that meet certain criteria.

[0449] "Means for centrally reading information" refers to a method or device for centrally collecting and storing necessary data from multiple sources.

[0450] "User" refers to any individual or entity that uses the System.

[0451] "Event input" refers to the act of a user inputting information about a specific life event (e.g. birth, injury, illness, death, etc.) into the system.

[0452] "Means for providing information" refers to a method or device for providing a user with necessary procedures or assistance information.

[0453] "Means for analyzing emotions" refers to a method or device for determining a user's emotional state based on the user's input and / or dialogue history.

[0454] "Means for adjusting the content and method of guidance based on the results of sentiment analysis" refers to a method or device for optimizing the content and method of providing information to a user based on the results of sentiment analysis.

[0455] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0456] This invention is a system that provides information on necessary procedures and assistance when a user inputs information related to a life event. The system includes a means for centrally reading information on procedures and various assistance from various government agencies, a means for accepting event input from a user, a means for providing guidance on procedures based on the input event, a means for analyzing the user's emotions, and a means for adjusting the content and method of guidance based on the emotion analysis results.

[0457] Hardware and Software Used

[0458] The server uses a database (e.g., MySQL or PostgreSQL) to store and search information on procedures and assistance for each government agency. For sentiment analysis, it uses a sentiment engine (e.g., IBM Watson or Microsoft Azure sentiment analysis API). The terminal provides an interface for users to input information and uses the HTTPS protocol to communicate with the server.

[0459] Explanation of program processing

[0460] The user uses a terminal (e.g., a smartphone or a PC) to input information related to childbirth. Specifically, the user inputs the keyword "childbirth." The terminal sends the information the user input to the server. The server searches a database based on the received keyword "childbirth" to obtain information such as the deadline and place to submit the birth notification, how to apply for a lump-sum childbirth allowance, and subsidy information for each region.

[0461] At the same time, the server uses an emotion engine to analyze the user's emotions. For example, if the user enters "I'm worried because I don't know how to go about childbirth," the emotion engine will determine that the user is feeling anxious. The server generates information including more detailed explanations for the user based on the acquired information and the emotion analysis results. For example, it generates information such as, "Please submit a birth notification to your city, ward, town, or village office within 14 days of giving birth. To apply for a lump-sum birth allowance, submit an application to your health insurance association. If you live in Tokyo, there is also information on specific subsidies, so please check the city hall's website for details."

[0462] Finally, the server transmits the generated information to the terminal, which then displays it to the user, who can then reliably carry out the necessary procedures based on the displayed information.

[0463] Examples and prompts

[0464] As a concrete example, if the user inputs "birth", the server provides the following information:

[0465] The deadline for submitting a birth notification is within 14 days of the birth.

[0466] The application should be submitted to the city, town or village office.

[0467] To apply for the maternity benefit, you must submit an application to your health insurance association.

[0468] If the user lives in Tokyo, it also provides information on specific subsidies for Tokyo.

[0469] Example prompt:

[0470] If the user types "childbirth," provide information about procedures and subsidies related to childbirth. Specifically, include the deadline and place to submit the childbirth notification, how to apply for the childbirth lump-sum payment, differences in subsidies by region, etc. Also, adjust the content and method of guidance according to the user's feelings.

[0471] This system allows users to carry out the necessary procedures reliably and receive appropriate assistance. The introduction of an emotion engine makes it possible to provide optimal guidance according to the user's emotions.

[0472] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0473] Step 1:

[0474] The user enters the information.

[0475] The user uses a terminal (e.g., a smartphone or a PC) to input information related to childbirth. Specifically, the user inputs the keyword "childbirth." The input information is saved in an input field on the terminal.

[0476] Step 2:

[0477] The terminal transmits the input information to the server.

[0478] The terminal transmits the information input by the user to the server. At this time, the data is transmitted securely using the HTTPS protocol. The input data is the keyword "birth" and is transmitted to the server.

[0479] Step 3:

[0480] The server searches the database.

[0481] The server searches the database based on the received keyword "birth." The database contains information such as the deadline for submitting birth notifications, where to submit them, how to apply for a lump-sum birth benefit, and subsidy information by region. The server uses an SQL query to retrieve the necessary information. The output is information on the applicable procedures and subsidies.

[0482] Step 4:

[0483] The server analyzes the user's emotions using an emotion engine.

[0484] The server uses an emotion engine to analyze the user's emotions based on the user's input and past dialogue history. For example, the emotion engine determines that the user is feeling anxious based on the input, "I'm anxious because I don't know how to handle childbirth." The input is the user's text data, and the output is the result of emotion analysis.

[0485] Step 5:

[0486] The server generates information based on the search results and sentiment analysis results.

[0487] The server generates information to provide to the user based on the information retrieved from the database and the analysis results of the emotion engine. For example, if it is determined that the user is confused, the server generates information containing a more detailed explanation. The input is the information in the database and the emotion analysis results, and the output is optimized information to provide to the user.

[0488] Step 6:

[0489] The server transmits the generated information to the terminal.

[0490] The server sends the generated information to the terminal. At this time, the data is sent securely using the HTTPS protocol. The input is the generated information, and the output is the data sent to the terminal.

[0491] Step 7:

[0492] The terminal displays the information to the user.

[0493] The terminal displays the information received from the server to the user. Specifically, it displays the deadline for submitting birth notification and where to submit it, how to apply for a lump-sum birth allowance, subsidy information by region, etc. The input is the information from the server, and the output is the information displayed to the user.

[0494] (Application example 2)

[0495] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0496] In conventional systems, when users were trying to obtain procedures or supplementary information related to a particular event, they were often left feeling anxious or confused because appropriate guidance based on emotions was not provided. In addition, information related to payment procedures and information on regional subsidies and discounts were not provided in a centralized manner, making it difficult for users to efficiently obtain the information they needed. This reduced user convenience and could lead to delays in procedures and misunderstandings.

[0497] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0498] In this invention, the server includes a means for centrally reading information on procedures and various subsidies from each government agency, a means for accepting an event input from a user, a means for providing guidance on the procedures based on the input event, a means for recognizing the user's emotions, a means for adjusting the content and method of the guidance based on the recognized emotions, a means for providing information related to payment procedures, and a means for providing information on regional subsidies and discounts. This allows optimal guidance to be provided according to the user's emotions, and makes it possible to centrally obtain information related to payment procedures and information on regional subsidies and discounts.

[0499] "Each administrative agency" refers to a public institution such as the national or local government, which is an organization that carries out specific procedures or provides subsidies.

[0500] A "procedure" refers to a formal step or process required to achieve a particular objective.

[0501] "Assistance" refers to financial or material assistance provided in support of a particular purpose or activity.

[0502] "Means of centrally loading information" refers to the function of centrally collecting necessary data from multiple sources and making it available within the system.

[0503] "User" refers to any individual or entity that uses the System.

[0504] "Event input" refers to the act of a user inputting a specific occurrence or situation into the system.

[0505] "Means of providing guidance" refers to the function of explaining necessary information and procedures to users.

[0506] "Means of recognizing emotions" refers to the ability to analyze and identify emotions from user input and actions.

[0507] "Means for adjusting the content and method of guidance" refers to the ability to change the information provided and the way it is conveyed based on recognized emotions.

[0508] "Payment Process" refers to the formal procedure for paying for a particular service or product.

[0509] "Regional subsidy and discount information" refers to information about financial assistance or price discounts available to users who live in a particular region.

[0510] A system for carrying out the present invention has the following configuration: A server includes means for centrally reading information on procedures and various subsidies of each government agency, means for accepting event input from a user, means for providing guidance on procedures based on the input event, means for recognizing the user's emotions, means for adjusting the content and method of guidance based on the recognized emotions, means for providing information related to payment procedures, and means for providing information on local subsidies and discounts.

[0511] Hardware and Software Used

[0512] Hardware: Servers, user devices (smartphones, tablets, PCs)

[0513] Software: emotion recognition libraries (e.g., EmotionEngine), databases (e.g., PaymentDatabase®), generative AI models

[0514] Data processing and calculation

[0515] emotion recognition

[0516] The text data entered by the user through the terminal is sent to the server. The server uses an emotion recognition library (EmotionEngine) to analyze and identify the user's emotions. This emotion data is used to adjust subsequent guidance.

[0517] Information Search

[0518] The server retrieves relevant transaction and subsidy information from a database (PaymentDatabase) based on the user's location and event input. This information forms the basis of the guidance provided to the user.

[0519] Guide Adjustment

[0520] The server then adapts the content and manner of guidance based on the perceived emotion: for example, if the user is perceived to be confused, it will provide a detailed explanation, and if the user is angry or frustrated, it will provide polite guidance.

[0521] Examples

[0522] If a user types "I don't know how to pay my utility bills," the server uses an emotion recognition library to recognize the user's emotions. For example, if the server detects that the user is confused, it will respond with "Don't worry. Here's how to pay your utility bills: [More info]."

[0523] Examples of prompt statements

[0524] If a user types "I don't know how to pay my utility bills," use an emotion recognition engine to recognize the user's emotion and provide appropriate guidance. If the user is confused, provide more information.

[0525] In this way, optimal guidance based on the user's emotions can be provided, and information related to payment procedures and local subsidies and discounts can be obtained in a centralized manner.

[0526] The flow of the specific process in the application example 2 will be described with reference to FIG.

[0527] Step 1:

[0528] The user inputs events through the terminal.

[0529] Input: User types, "I don't know how to pay my utility bill."

[0530] Output: The entered text data is sent to the server.

[0531] Step 2:

[0532] The server uses an emotion recognition library (EmotionEngine) to analyze the user's emotions.

[0533] Input: Text data submitted by the user.

[0534] Data processing: The text data is passed to an emotion recognition library to analyze emotions.

[0535] Output: Parsed emotion data (e.g. confusion, anxiety, anger, etc.).

[0536] Step 3:

[0537] The server searches for relevant procedural and subsidy information from a database (PaymentDatabase) based on the user's regional information and event input.

[0538] Input: User location information and event input (e.g. "how do I pay my utility bill").

[0539] Data retrieval: Searching for relevant information from databases.

[0540] Output: Procedural and grant information (e.g. payment method, submission deadline, grant availability, etc.).

[0541] Step 4:

[0542] The server adjusts the content and method of guidance based on the recognized emotion.

[0543] Input: Parsed emotion data and retrieved procedural information.

[0544] Data processing: Adjust the content and method of guidance based on emotion data.

[0545] Output: Tailored informational message (e.g. "Don't worry, here's how to pay your utility bill: [More info]").

[0546] Step 5:

[0547] The server transmits the adjusted announcement message to the user terminal.

[0548] Input: Adjusted informational message.

[0549] Output: An informational message that is displayed on the user's terminal.

[0550] Step 6:

[0551] The user checks the guidance message via the terminal and carries out the necessary procedures.

[0552] Input: The informational message displayed on the user's terminal.

[0553] Output: The action the user takes to complete the transaction.

[0554] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires a voice indicating a user input for the result of the specific processing. The control unit 46A transmits the voice data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[0555] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by making a neural network perform deep learning. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating a voice, text data indicating a text, and image data indicating an image is input. The data generation model 58 performs inference on the input inference data according to the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0556] Another example of generative AI is Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) are mentioned.

[0557] In the above embodiment, an example has been given in which the specific process is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0558] [Second embodiment]

[0559] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0560] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0561] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a wide area network (WAN) and / or a local area network (LAN).

[0562] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0563] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs the voice according to instructions from the processor 46.

[0564] Camera 42 is a small digital camera equipped with an optical system including a lens, an aperture, and a shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (e.g., an imaging range defined by an angle of view equivalent to the width of the field of vision of an average healthy person).

[0565] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for transmitting and receiving various types of information between the processor 46 and the processor 28 via the network 54. The transmission and reception of various types of information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is performed in a secure state.

[0566] Fig. 4 shows an example of main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0567] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32, and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0568] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0569] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50, and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0570] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0571] "Example 1"

[0572] The system of the present invention is equipped with a database that centrally reads information on procedures and various types of assistance from each government agency. This database can collect and update information from government agency websites and official documents. It also has an interface that accepts event input from users. This interface is provided in the form of a website or application, and allows users to input events that have occurred to them (birth, injury, illness, death, etc.). It then has the function of searching the database for information on necessary procedures and assistance based on the input event, and providing guidance to the user.

[0573] "Example 2"

[0574] As a specific example, when a user enters that they have given birth, the system searches the database for information on procedures and subsidies related to childbirth. For example, it provides information such as the deadline for submitting a birth notification, where to submit it, and how to apply for a lump-sum childbirth allowance. It also provides information on the area where the user lives, taking into account differences in subsidies by region. This allows users to be sure to complete the necessary procedures and receive assistance.

[0575] The process flow of each embodiment will be described below.

[0576] "Example 1"

[0577] Step 1: The system collects procedural and subsidy information from each government agency's website, official documents, etc. and stores it in a database.

[0578] Step 2: The user enters events that have occurred to them (birth, injury, illness, death, etc.) through an interface such as a website or application.

[0579] Step 3: Based on the entered event, the system searches the database for the necessary procedures and auxiliary information.

[0580] Step 4: The system guides the user through the search results, allowing them to take the necessary steps and receive assistance.

[0581] "Example 2"

[0582] Step 1: If the user enters birth, the system searches the database for information on procedures and ancillary care related to birth.

[0583] Step 2: The system will provide information such as the deadline for submitting the birth notification, where to submit it, and how to apply for the maternity benefit.

[0584] Step 3: The system also provides information about the area where the user lives, taking into account differences in subsidies depending on the region.

[0585] Step 4: This allows the user to ensure they take the necessary steps and receive assistance.

[0586] Example 1

[0587] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[0588] In conventional systems, users had to collect information on procedures and assistance from each government agency individually, making it difficult for users to quickly obtain the information they needed. In addition, there was a lack of a means to centrally provide information on procedures and assistance according to life events, increasing the time and effort required for users to carry out appropriate procedures. Furthermore, information had to be updated manually, making it difficult to provide the latest information.

[0589] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0590] In this invention, the server includes a means for centrally reading information on procedures and various assistance from each administrative agency, a means for accepting event input from a user, a means for providing guidance on procedures based on the input event, a means for storing collected information in a database and periodically updating it, a means for providing an interface accessible to the user, a means for searching the database based on the input event information, and a means for notifying the user of the search results. This allows the user to quickly obtain the latest information on procedures and assistance from a centralized location, and to efficiently carry out appropriate procedures.

[0591] "Each administrative agency" refers to a public institution such as the national government or a local government, which is an organization that provides information on procedures and subsidies.

[0592] A "procedure" refers to a formal procedure or method required to accomplish a particular objective.

[0593] "Subsidy" refers to financial or material support provided to individuals or organizations that meet certain criteria.

[0594] "Means of centrally loading information" refers to methods and technologies for centrally collecting information on procedures and subsidies from each administrative agency and storing it in a database.

[0595] "User" refers to an individual or organization that uses this system to obtain information and carry out procedures.

[0596] "Means for accepting event input" refers to an interface or method for a user to input life events that have occurred to them (such as birth, injury, illness, or death).

[0597] "Guidance means" refers to methods or technologies for providing relevant procedural or assistance information based on event information entered by a user.

[0598] A "database" refers to an information management system that stores collected information in an organized manner and allows it to be searched and updated.

[0599] "Interface" refers to the screens and applications through which a user accesses a system and enters or retrieves information.

[0600] "Search means" refers to methods and technologies for extracting relevant information from a database based on event information entered by a user.

[0601] "Means of presenting search results" refers to methods and technologies for presenting searched information to users in an easy-to-understand manner.

[0602] This invention is a system that centrally collects information on procedures and various subsidies from various government agencies and provides information on necessary procedures and subsidies based on event information entered by a user. A specific embodiment of this system will be described below.

[0603] Information collection and database updates

[0604] The server collects procedural and auxiliary information from the websites and official documents of each government agency. This collection is done using web scraping tools (e.g. Beautiful Soup and Scrapy) and APIs. The collected information is stored in a database such as MySQL or PostgreSQL. The server periodically runs the crawler to update the information.

[0605] Providing a user interface

[0606] The server provides an interface where users can input event information, either in the form of a web interface using React or Vue.js, or a mobile application using Flutter, and the device displays these interfaces when accessed by the user.

[0607] Accepting event input

[0608] The user inputs events that have occurred to them (birth, injury, illness, death, etc.) through the provided interface. For example, if the user inputs the event "birth," they can enter the expected date of birth and hospital information. The terminal sends the input event information to the server. The HTTPS protocol is used for transmission to ensure data security.

[0609] Search and find the information you need

[0610] The server searches the database using SQL queries and Elasticsearch based on the event information entered by the user. For example, it searches for information on procedures and subsidies related to "childbirth." The server then presents the search results to the user. For example, it displays information on procedures related to childbirth (submitting a birth notification, applying for child allowance, etc.) and subsidies (lump-sum childbirth and child care grants, etc.).

[0611] Examples

[0612] For example, if a user enters the event "birth," the server searches the database for information on birth-related procedures (submitting a birth notification, applying for child allowance, etc.) and subsidies (lump-sum childbirth and child care grants, etc.) and provides guidance to the user.

[0613] Examples of prompt statements

[0614] Examples of prompts to be input to a generative AI model include the following:

[0615] "When a user inputs the event of childbirth, please explain the system process that guides them to relevant procedures and support information."

[0616] By inputting this prompt sentence into a generative AI model, a sentence is generated that explains the specific processing content of the system in natural language.

[0617] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0618] Step 1: Collect information and update the database

[0619] The server collects procedural and auxiliary information from the websites and official documents of each government agency. Specifically, the information is obtained using web scraping tools (e.g. Beautiful Soup and Scrapy) and APIs. The collected information is stored in a database such as MySQL or PostgreSQL. The server periodically runs the crawler to update the information.

[0620] Input: Websites and official documents of each government agency

[0621] Output: Procedure and auxiliary information stored in a database

[0622] Step 2: Providing a User Interface

[0623] The server provides an interface that allows users to input event information. Specifically, it develops and provides a web interface using React or Vue.js, or a mobile application using Flutter. The terminal displays these interfaces when the user accesses them.

[0624] Input: User access

[0625] Output: Event information input screen

[0626] Step 3: Accepting event input

[0627] The user inputs events that have occurred to them (birth, injury, illness, death, etc.) through the provided interface. For example, if the user inputs the event "birth," they can enter the expected date of birth and hospital information. The terminal sends the input event information to the server. The HTTPS protocol is used for transmission to ensure data security.

[0628] Input: User-entered event information

[0629] Output: Event information sent to the server

[0630] Step 4: Finding the information you need

[0631] The server uses SQL queries and Elasticsearch to search the database based on the event information entered by the user, for example, to search for information about procedures and assistance related to "birth."

[0632] Input: User-entered event information

[0633] Output: Procedures and supporting information as search results

[0634] Step 5: Navigate through search results

[0635] The server informs the user of the search results. Specifically, it uses methods and technologies to present the searched information to the user in an easy-to-understand manner. For example, it displays information on procedures related to childbirth (submitting a birth notification, applying for child allowance, etc.) and subsidies (lump-sum childbirth and childcare grants, etc.).

[0636] Input: Procedure and auxiliary information as search results

[0637] Output: Information about the procedure or assistance provided to the user

[0638] Step 6: Update your information

[0639] The server periodically runs a crawler to keep the information in the database up to date, ensuring that the information provided to users is always up to date.

[0640] Input: Latest information from each government agency

[0641] Output: Updated database

[0642] (Application example 1)

[0643] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[0644] In the conventional system, it was difficult to centrally manage the procedures and supplementary information of each government agency, making it difficult for users to quickly obtain the information they needed. In addition, there was a lack of means to provide appropriate procedures and supplementary information in real time for events occurring in physical stores, which reduced user convenience. This caused problems such as users being unable to use procedures and supplementary information appropriately.

[0645] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0646] In this invention, the server includes a means for centrally reading information on procedures and various assistance from each government agency, a means for accepting event input from a user, a means for providing information on procedures based on the input event, a means for inputting an event that occurred in a real store by the user, and a means for providing information on procedures and assistance in real time based on the input event. This enables a user to quickly obtain necessary procedure and assistance information for an event that occurred in a real store and take appropriate action.

[0647] "Each administrative agency" refers to a public institution such as the national or local government, which is an organization that handles procedures and provides subsidies.

[0648] A "procedure" refers to a formal procedure or method required to accomplish a particular objective.

[0649] "Assistance" refers to financial or material support provided to achieve a specific purpose.

[0650] "Means for centrally reading information" refers to a method or device for centrally collecting and managing data from multiple sources.

[0651] "User" refers to any individual or entity that uses the System.

[0652] "Means for accepting event input" refers to a method or device that allows a user to input an occurrence or situation into the system.

[0653] "Means for providing information" refers to a method or device for providing the user with the necessary information.

[0654] "Brick and mortar store" refers to a commercial establishment that exists in a physical location and offers goods and services.

[0655] "Real-time" refers to immediate processing or response without delay.

[0656] "Procedure or assistance information" refers to detailed data or instructions relating to a particular procedure or assistance.

[0657] A system for implementing this invention includes means for centrally reading information on procedures and various assistance from each government agency, means for accepting event input from a user, means for providing guidance on procedures based on the input events, means for inputting events that occur in a physical store by a user, and means for providing information on procedures and assistance in real time based on the input events.

[0658] System Programming

[0659] The server collects procedures and supporting information from the websites and official documents of each government agency and stores it in a database. When a user inputs an event using a smartphone or smart glasses, the information is sent to the server. The server searches the database for related procedures and supporting information based on the input event and provides the user with guidance in real time.

[0660] Hardware and software used

[0661] Hardware: Smartphones, smart glasses

[0662] Software: Flask (a Python web framework), requests (a Python library for sending HTTP requests)

[0663] Data processing and calculation

[0664] 1. Event input: The user inputs an event via a smartphone or smart glasses.

[0665] 2. Database integration: Based on the entered event information, the server sends a request to the database API.

[0666] 3. Information retrieval: Retrieve relevant procedure and assistance information from the database.

[0667] 4. Real-time guidance: The acquired information is provided to the user in real time.

[0668] Examples

[0669] When a user enters "return product" on their smartphone, the server retrieves information about the return procedure from the database and provides it to the user, allowing the user to quickly complete the necessary procedures.

[0670] Examples of prompt statements

[0671] The user has entered "return product" on their smartphone. Retrieve information about the return procedure from the database and guide the user.

[0672] In this way, a system can be realized that improves the user experience in a physical store.

[0673] The flow of the specific process in the application example 1 will be described with reference to FIG.

[0674] Step 1:

[0675] Users input events using a smartphone or smart glasses.

[0676] Input: The event the user has occurred (e.g. "returned product")

[0677] Output: Event information is sent from the device to the server.

[0678] Specific operation: The user opens the smartphone application, enters an event such as "product return" on the event input screen, and presses the send button.

[0679] Step 2:

[0680] The server analyzes the received event information.

[0681] Input: Event information sent from the device

[0682] Output: Parsed event information

[0683] Specific operation: The server analyzes the received event information and identifies the type of event (e.g., "product return").

[0684] Step 3:

[0685] The server sends a request to the database API to retrieve relevant procedures and auxiliary information.

[0686] Input: Parsed event information

[0687] Output: Procedures and auxiliary information retrieved from the database

[0688] Specific operation: The server requests procedures and auxiliary information related to "product returns" from the database API and retrieves the relevant information from the database.

[0689] Step 4:

[0690] The server provides the user with real-time information on procedures and auxiliary information obtained.

[0691] Input: Procedures and supporting information retrieved from the database

[0692] Output: Instructions and support information provided to the user

[0693] Specific operation: The server sends the acquired information to a smartphone or smart glasses application, and displays the procedure details and auxiliary information to the user.

[0694] Step 5:

[0695] The user carries out the procedure based on the information provided.

[0696] Input: Procedures and auxiliary information provided by the server

[0697] Output: Specific steps that the user will take

[0698] Specific actions: The user checks the details of the procedure displayed on their smartphone or smart glasses and performs the necessary procedures (e.g., going to the returns counter, preparing the necessary documents).

[0699] Example 2

[0700] Next, a description will be given of Example 2 of the embodiment 2. In the following description, the data processing device 12 is referred to as a "server" and the smart glasses 214 are referred to as a "terminal".

[0701] In the conventional system, users had to search multiple government agencies and information sources individually to obtain procedures and supplementary information related to life events, which was time-consuming and laborious. In addition, because supplementary information differs by region, it was difficult for users to obtain information appropriate to their own area of ​​residence.

[0702] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0703] In this invention, the server includes a means for centrally reading information on procedures and various assistance from each administrative agency, a means for accepting an event input from a user, a means for providing procedure information based on the input event, a means for accepting information on the user's residential area, a means for providing assistance information for each area based on the accepted residential area information, a means for searching a database to obtain related information, and a means for providing the obtained information to the user. This allows the user to easily obtain procedures and assistance information related to life events through one system, and assistance information for each area is also provided appropriately.

[0704] "Each administrative agency" refers to a public agency such as the national or local government, which is responsible for providing information on procedures and subsidies.

[0705] A "procedure" refers to a formal procedure or method required to accomplish a particular objective.

[0706] "Subsidy" refers to financial or material support provided to individuals or organizations that meet certain criteria.

[0707] "Means for centrally reading information" refers to a method or device for centrally collecting necessary data from multiple sources.

[0708] "User" refers to an individual or entity that uses the System to input information and obtain required procedures and supporting information.

[0709] "Event input" refers to the act of a user inputting information about a specific life event (e.g. birth, injury, illness, death, etc.) into the system.

[0710] "Means for providing guidance" refers to a method or device for providing appropriate procedures or auxiliary information based on information input by a user.

[0711] "Residence area information" refers to information about the area where the user currently lives, and is used to provide auxiliary information for each area.

[0712] "Database" refers to a system for efficiently storing, retrieving, and managing information.

[0713] "Means for searching and obtaining relevant information" refers to a method or device for searching information in a database and obtaining the data required by the user.

[0714] "Means for providing" refers to a method or device for displaying the acquired information in a format that is easy for the user to understand.

[0715] The present invention provides a system that allows a user to easily obtain procedures and auxiliary information related to a life event. A specific embodiment of this system will be described below.

[0716] System Configuration

[0717] This system is composed of three main elements: a server, a terminal, and a user. The server includes a means for centrally reading information on procedures and various assistance from each government agency, a means for accepting event input from the user, a means for providing procedure guidance based on the input event, a means for accepting information on the user's residential area, a means for providing assistance information for each area based on the accepted residential area information, a means for searching a database to obtain related information, and a means for providing the obtained information to the user.

[0718] Hardware and Software Used

[0719] The server uses MySQL as a database management system and executes programs to process information entered by users. The terminal is a device such as a PC or smartphone that provides an interface for users to enter information. Users use the terminal to access the system and enter the required information.

[0720] Data processing and calculation

[0721] The server takes the information entered by the user and searches the MySQL database to retrieve any relevant procedures or auxiliary information, by executing SQL queries such as:

[0722] sql

[0723] SELECT FROM procedures WHERE keyword = 'birth' AND region = 'Tokyo';

[0724] The server organizes the acquired information and provides it to the user in an easy-to-understand format.

[0725] Examples

[0726] For example, if a user enters "birth" and selects "Tokyo" as their place of residence, the server provides the following information:

[0727] Deadline for submitting birth notification: Within 14 days after birth

[0728] Submit to: City / ward / town / village office

[0729] How to apply for maternity benefits: Apply to your health insurance association

[0730] Tokyo Metropolitan Government Subsidy Information: In addition to the lump-sum childbirth allowance, Tokyo Metropolitan Government provides additional subsidies if certain conditions are met.

[0731] Examples of prompt statements

[0732] If a user enters "birth" and selects "Tokyo" as their area of ​​residence, please provide information on the deadline and place to submit the birth notification, how to apply for the lump-sum birth allowance, and information on Tokyo's subsidies.

[0733] This system allows users to easily obtain procedures and supplementary information related to life events through a single interface. In addition, supplementary information for each region is provided appropriately, so users can obtain information appropriate for their own area.

[0734] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0735] Step 1:

[0736] The user enters the information.

[0737] The user opens a browser on the terminal, accesses the web page of the system, enters information related to the birth into the input form, and clicks the "Search" button.

[0738] Input: Information related to birth (e.g. birth, place of residence)

[0739] Output: User input is sent to the server

[0740] Step 2:

[0741] The server receives the input information.

[0742] The server receives the information entered by the user, which includes birth-related keywords and the area of ​​residence.

[0743] Input: User input information

[0744] Output: The database is ready to be searched based on the input information received.

[0745] Step 3:

[0746] The server searches the database.

[0747] The server connects to a MySQL database and executes a query based on the information entered by the user, for example executing a SQL query like this:

[0748] sql

[0749] SELECT FROM procedures WHERE keyword = 'birth' AND region = 'Tokyo';

[0750] Input: User input information (keywords and area of ​​residence)

[0751] Output: Relevant information retrieved from the database

[0752] Step 4:

[0753] The server processes the search results.

[0754] The server processes the information retrieved from the database, such as the deadline for submitting birth notification, where to submit it, how to apply for a lump-sum birth allowance, and information on subsidies by region.

[0755] Input: Relevant information retrieved from the database

[0756] Output: Organized information (e.g. deadline for submitting birth notification, where to submit it, how to apply for childbirth lump sum payment, subsidy information by region)

[0757] Step 5:

[0758] The server provides the information to the user.

[0759] The server then presents the organized information to the user, typically in the form of a web page that displays information such as:

[0760] Deadline for submitting birth notification: Within 14 days after birth

[0761] Submit to: City / ward / town / village office

[0762] How to apply for maternity benefits: Apply to your health insurance association

[0763] Tokyo Metropolitan Government Subsidy Information: In addition to the lump-sum childbirth allowance, Tokyo Metropolitan Government provides additional subsidies if certain conditions are met.

[0764] Input: Organized information

[0765] Output: Information provided to the user

[0766] In this way, the user can be sure to take the necessary steps and receive appropriate assistance.

[0767] (Application example 2)

[0768] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server", and the smart glasses 214 will be referred to as a "terminal".

[0769] When users face life events such as childbirth, it is difficult for them to quickly and accurately obtain information on necessary procedures and subsidies. In addition, there is a lack of a centralized means of providing information on subsidies and related services by region, making it difficult for users to receive appropriate support.

[0770] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0771] In this invention, the server includes a means for centrally reading information on procedures and various subsidies of each government agency, a means for accepting event input from a user, a means for guiding the procedures based on the input event, a means for providing subsidy information for each region based on the user's residential area, and a means for displaying related services based on the user's input. This allows the user to quickly and accurately obtain information on procedures and subsidies related to life events such as childbirth, and to centrally receive information on subsidies for each region and information on related services.

[0772] "A means of centrally reading information on procedures and various subsidies from each administrative agency" is a function for centrally collecting information on procedures and subsidies provided by multiple administrative agencies and storing it in a database.

[0773] The "means for accepting event input from a user" refers to an interface that enables a user to input a specific life event (e.g., birth, injury, illness, death, etc.) into the system.

[0774] The "means for providing guidance regarding procedures based on an input event" is a function for searching for procedure information related to a life event input by the user and providing it to the user.

[0775] The "means for providing regional subsidy information based on the user's region of residence" is a function for searching for subsidy information specific to that region based on the region of residence input by the user and providing it to the user.

[0776] "Means for displaying related services based on user input" refers to a function for searching for related services (e.g. obstetricians, baby goods stores, childcare support centers, etc.) based on information entered by the user and displaying them to the user.

[0777] The system for carrying out the present invention includes a server, a user terminal, and a database. The server includes a means for centrally reading information on procedures and various subsidies of each government agency, a means for accepting event input from a user, a means for providing procedure information based on the input event, a means for providing subsidy information by region based on the user's residential area, and a means for displaying related services based on the user's input.

[0778] Explanation of program processing

[0779] 1. A way to centrally read information on procedures and various subsidies from various government agencies

[0780] The server periodically collects information on procedures and assistance provided by each government agency and stores it in a database, so that users can always receive the latest information.

[0781] 2. A means of accepting event input from the user

[0782] Through a user terminal (such as a smartphone or smart glasses), the user inputs a specific life event (e.g., childbirth). The input interface is designed to be intuitive and easy to use.

[0783] 3. A means of providing procedural guidance based on entered events

[0784] The server searches the database for relevant procedural information based on the life event entered by the user and provides it to the user. For example, in the case of childbirth, information such as the deadline for submitting a birth notification, where to submit it, and how to apply for a lump-sum birth benefit are displayed.

[0785] 4. A way to provide local grant information based on where a user lives

[0786] Based on the user's input of the residential area information, the server searches the database for subsidy information specific to that area and provides it to the user, allowing the user to easily check the subsidies available in his / her area.

[0787] 5. How to display relevant services based on user input

[0788] The server searches for related services (e.g. obstetricians, baby goods stores, childcare support centers, etc.) based on the information entered by the user and displays them to the user, allowing the user to quickly find the services they need.

[0789] Examples

[0790] For example, if a user enters "birth" and "Tokyo," the server provides the following information:

[0791] Deadline and place to submit birth notification

[0792] How to apply for maternity benefits

[0793] Tokyo-specific subsidy information

[0794] Information on nearby obstetrics and gynecology clinics, baby goods stores, and childcare support centers

[0795] Example prompts to be input to the generative AI model

[0796] "Create an application that provides information on procedures and subsidies related to childbirth when a user enters their expected delivery date and area of ​​residence. For example, it displays the deadline and place to submit the birth notification, how to apply for the lump-sum childbirth allowance, and subsidy information by area."

[0797] In this way, users can quickly and accurately obtain the information they need and take the appropriate steps.

[0798] The flow of the specific process in the application example 2 will be described with reference to FIG.

[0799] Step 1:

[0800] The server periodically collects information on procedures and assistance provided by each government agency and stores it in a database. Specifically, it uses APIs and web scraping technology to obtain information from the websites and databases of each government agency. The input is data from the websites and databases of each government agency, and the output is information on procedures and assistance stored in the server's database.

[0801] Step 2:

[0802] A user inputs a specific life event (e.g., childbirth) using a terminal such as a smartphone or smart glasses. The input interface is designed to be intuitive and easy to use. The input is the life event information that the user enters into the terminal, and the output is the life event information sent to the server.

[0803] Step 3:

[0804] The server searches the database for relevant procedure information based on the life event input by the user and provides it to the user. Specifically, it uses an SQL query to search the database and obtains the relevant procedure information. The input is the life event information input by the user, and the output is the procedure information provided to the user.

[0805] Step 4:

[0806] The user inputs the residential area information into the terminal. The input interface is designed to allow the user to easily input the area information. The input is the residential area information that the user inputs into the terminal, and the output is the residential area information that is sent to the server.

[0807] Step 5:

[0808] The server searches the database for subsidy information specific to the region based on the residential area information entered by the user, and provides it to the user. Specifically, it uses an SQL query to search the database and obtains the relevant subsidy information. The input is the residential area information entered by the user, and the output is the subsidy information provided to the user.

[0809] Step 6:

[0810] The server searches for related services (e.g. obstetricians, baby goods stores, childcare support centers, etc.) based on the information entered by the user and displays them to the user. Specifically, it retrieves related service information from a database and displays it on the user's terminal. The input is the life event information and residential area information entered by the user, and the output is related service information provided to the user.

[0811] In this way, the user can quickly and accurately obtain the necessary information and take the appropriate steps.

[0812] In addition, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0813] "Example 1"

[0814] In one embodiment of the present invention, an emotion engine is incorporated. This emotion engine recognizes emotions from the user's tone of voice, facial expression, text input, etc. Specifically, the emotion is estimated from the tone, strength, speed, etc. of the voice when the user speaks to the system. In addition, when the user shows the system his or her face through a webcam, etc., emotion is estimated using facial expression recognition technology. Furthermore, when the user inputs text, emotion is estimated from the wording and context of the text.

[0815] "Example 2"

[0816] In addition, in one embodiment of the present invention, the content and method of guidance are adjusted based on the emotion recognized by the emotion engine. Specifically, if the system estimates that the user is angry or frustrated, the system uses more polite language to provide guidance. If the system estimates that the user is confused or anxious, the system provides a more detailed explanation. This allows optimal guidance to be provided according to the user's emotions.

[0817] The process flow of each embodiment will be described below.

[0818] "Example 1"

[0819] Step 1: The user speaks to the system. At this time, the emotion engine captures the tone, strength, and speed of the user's voice.

[0820] Step 2: The emotion engine estimates the user's emotion from voice characteristics.

[0821] Step 3: The user shows the system their face via a webcam or other device. At this time, the user's facial expressions are captured by the emotion engine.

[0822] Step 4: The emotion engine uses facial expression recognition technology to estimate the user's emotions.

[0823] Step 5: The user enters text, whose phrasing and context are captured by the emotion engine.

[0824] Step 6: The sentiment engine infers the user's sentiment from the text content.

[0825] "Example 2"

[0826] Step 1: The emotion engine recognizes the user's emotion.

[0827] Step 2: The system adjusts the content and method of guidance based on the emotions recognized by the emotion engine.

[0828] Step 3: If the system estimates that the user is angry or frustrated, it will provide more polite guidance.

[0829] Step 4: If the system estimates that the user is confused or anxious, it will provide a more detailed explanation.

[0830] Example 1

[0831] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[0832] Conventional systems for providing administrative procedures and auxiliary information have the problem that it is difficult for users to quickly and accurately obtain the information they need. In addition, the user experience can be poor because information is provided without considering the user's feelings. This creates an issue that makes it difficult for users to carry out appropriate procedures, especially during stressful life events.

[0833] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0834] In this invention, the server includes a means for centrally reading information on procedures and various subsidies of each government agency, a means for accepting event input from the user, a means for providing guidance on procedures based on the input event, a means for recognizing the user's emotions, and a means for adjusting the guidance content based on the emotions. This not only enables the user to quickly and accurately obtain the information he or she needs, but also makes it possible to provide information that takes the user's emotions into consideration.

[0835] "Each administrative agency" refers to a public institution such as a national or local government, which is an organization that provides specific administrative services or procedures.

[0836] A "procedure" refers to a formal step or process required to achieve a particular objective.

[0837] "Subsidy" refers to financial or material support provided to individuals or organizations that meet certain criteria.

[0838] "Means of centrally loading information" refers to technologies and methods for collecting data from multiple sources and managing it centrally.

[0839] "User" refers to any individual or organization that uses this system.

[0840] "Event input" refers to the act of a user inputting a specific occurrence or situation into the system.

[0841] "Means of guidance" refers to technologies and methods for providing users with the necessary information and encouraging them to go through the appropriate procedures.

[0842] "Means of recognizing emotions" refers to technologies and methods for inferring emotions from a user's tone of voice, facial expressions, text input, etc.

[0843] "Means for adjusting guidance content based on emotions" refers to techniques or methods for appropriately changing the information or guidance content provided in response to the recognized emotions of the user.

[0844] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0845] The system of the present invention is equipped with a database that centrally reads information on procedures and various types of assistance from each government agency. This database can collect and update information from government agency websites and official documents. It also has an interface that accepts event input from users. This interface is provided in the form of a website or application, and allows users to input events that have occurred to them (birth, injury, illness, death, etc.). It then has the function of searching the database for information on necessary procedures and assistance based on the input event, and providing guidance to the user.

[0846] In one embodiment of the present invention, an emotion engine is incorporated. This emotion engine recognizes emotions from the user's tone of voice, facial expression, text input, etc. Specifically, the emotion is estimated from the tone, strength, speed, etc. of the voice when the user speaks to the system. In addition, when the user shows the system his or her face through a webcam, etc., emotion is estimated using facial expression recognition technology. Furthermore, when the user inputs text, emotion is estimated from the wording and context of the text.

[0847] Hardware and Software Used

[0848] The server collects information from government websites and official documents and stores it in a database. This is done using web scraping technology and APIs. Specific software used includes Python's BeautifulSoup and Scrapy, and API client libraries.

[0849] Users input their events through a website or application. For example, if a user inputs "birth", the system takes that information and searches the database for related procedure and ancillary information. This search process is done using SQL queries and full-text search engines (e.g. Elasticsearch).

[0850] The server displays the search results to the user using an HTML template engine (e.g. Jinja2) and a front-end framework (e.g. React, Vue.js).

[0851] When a user speaks to the system, the emotion engine uses voice recognition technology to estimate emotions from the tone, strength, speed, etc. Specific software used is Google Cloud Speech-to-Text and IBM Watson Speech to Text.

[0852] When a user shows their face to the system through a webcam, the system uses facial expression recognition technology to estimate emotions, using OpenCV and Microsoft Azure Face API as the specific software.

[0853] When a user enters text, the system infers emotions from the vocabulary and context of the text. Hugging Face's Transformers library and Google Cloud Natural Language API are used to analyze emotions using natural language processing techniques.

[0854] Examples and prompts

[0855] As a specific example, the process when the user inputs "birth" will be described.

[0856] 1. The user enters "birth" into the website's input form and clicks the submit button.

[0857] 2. The terminal sends this input to the server.

[0858] 3. The server searches the database based on the received event information.

[0859] 4. The server embeds the search results into an HTML template and sends it to the terminal.

[0860] 5. The device displays the received HTML in the browser.

[0861] Example prompt:

[0862] When a user enters "birth", search for and display information on related procedures and assistance.

[0863] In this way, the system of the present invention can quickly provide the user with the information they need. In addition, by using the emotion engine, it is possible to provide information that takes into account the user's emotions, which is expected to improve the user experience.

[0864] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0865] Program processing flow

[0866] Step 1: Gather information

[0867] The server collects information from government websites and official documents.

[0868] Input: Government agency website URL or API endpoint

[0869] Specific behavior:

[0870] The server periodically accesses the government agency's website.

[0871] The server uses web scraping technologies (e.g. BeautifulSoup, Scrapy) to parse the HTML document and extract the required information.

[0872] The server uses the API client library to retrieve data from the API.

[0873] Output: Extracted information (procedure and auxiliary details)

[0874] Step 2: Saving to the Database

[0875] The server stores the collected information in a database.

[0876] Input: Extracted information (procedure and supporting details)

[0877] Specific behavior:

[0878] The server establishes a database connection.

[0879] The server generates SQL queries and inserts the extracted information into a database.

[0880] Output: Information stored in the database

[0881] Step 3: Accepting User Input

[0882] Users enter their events through a website or application.

[0883] Input: Event information entered by the user (e.g. "birth")

[0884] Specific behavior:

[0885] The user enters event information into the input form on the website and clicks the submit button.

[0886] The terminal transmits the input data to the server.

[0887] Output: Event information sent to the server

[0888] Step 4: Database search

[0889] The server searches the database based on the event information received from the user.

[0890] Input: Event information sent by the user

[0891] Specific behavior:

[0892] The server analyzes the received event information and extracts related keywords.

[0893] The server generates the SQL query and performs the search against the database.

[0894] Output: Search results (related procedures and supporting information)

[0895] Step 5: View the results

[0896] The server displays the search results to the user.

[0897] Input: Search results (related procedures and supporting information)

[0898] Specific behavior:

[0899] The server embeds the search results into an HTML template.

[0900] The server transmits the generated HTML to the terminal.

[0901] The terminal displays the received HTML in the browser.

[0902] Output: The search results displayed to the user

[0903] Step 6: Emotion Recognition

[0904] When a user speaks to the system, the emotion engine uses voice recognition technology to infer emotions from the tone, strength, speed, etc. of the voice.

[0905] Input: User's voice data

[0906] Specific behavior:

[0907] The user speaks to the system through a microphone.

[0908] The terminal transmits the voice data to the server.

[0909] The server sends the voice data to a speech recognition API (e.g., Google Cloud Speech-to-Text) and converts it into text.

[0910] The server analyzes the converted text and estimates the sentiment.

[0911] Output: Estimated emotion data

[0912] Step 7: Tailor your message based on emotion

[0913] The server appropriately changes the information and guidance it provides based on the recognized user's emotions.

[0914] Input: Estimated emotion data

[0915] Specific behavior:

[0916] The server analyzes the emotion data to determine the user's emotional state.

[0917] The server adjusts the guidance content (e.g., gentler language, additional support information) depending on the emotional state.

[0918] Output: Adjusted guidance content

[0919] In this way, the system of the present invention is not only able to quickly provide the user with the necessary information, but also able to provide information that takes into consideration the user's feelings.

[0920] (Application example 1)

[0921] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[0922] Conventional systems for providing administrative procedures and auxiliary information have the problem that it is difficult for users to quickly and accurately obtain the information they need. In addition, they are unable to respond flexibly to the user's emotions and circumstances, which can result in a poor user experience. In particular, in brick-and-mortar stores, there is a need to grasp the emotions and needs of customers in real time and provide appropriate services, but current systems have difficulty in achieving this.

[0923] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0924] In this invention, the server includes a means for centrally reading information on procedures and various subsidies from each government agency, a means for accepting event input from the user, a means for providing guidance on procedures based on the input event, a means for recognizing the user's emotions, and a means for adjusting the guidance content based on the recognized emotions. This allows the user to quickly and accurately obtain the information he or she needs, and also enables flexible responses according to the user's emotions and circumstances. In particular, in physical stores, it becomes possible to grasp the emotions and needs of customers in real time and provide appropriate services.

[0925] "A means of centrally reading information on procedures and various subsidies from each administrative agency" refers to a system for centrally collecting information on procedures and subsidies provided by multiple administrative agencies and storing it in a database.

[0926] The "means for accepting event input from the user" is a system that provides an interface for the user to input life events that have occurred to him or her (such as birth, injury, illness, or death).

[0927] The "means for providing guidance regarding procedures based on an input event" is a system that searches for the necessary procedures and auxiliary information corresponding to the life event input by the user and provides them to the user.

[0928] "Means for recognizing user emotions" refers to a system that detects the user's emotional state using technologies such as voice recognition, facial expression recognition, and text analysis.

[0929] The "means for adjusting the guidance content based on the recognized emotion" is a system that appropriately changes the information and guidance content provided depending on the user's emotional state.

[0930] "Speech recognition" is a technology that converts a user's voice into text data and analyzes the content.

[0931] "Facial expression recognition" is a technology that captures a user's facial expressions using a camera or other device and infers emotions from those expressions.

[0932] "Text analysis" is a technology that analyzes text data entered by the user and understands its content and sentiment.

[0933] A "generative AI model" is a model that uses artificial intelligence to generate appropriate responses and guidance based on user input and emotions.

[0934] A "prompt" is an instruction given to a generative AI model that serves as the basis for generating a specific response or guidance.

[0935] A system for implementing the present invention has the following configuration.

[0936] System Configuration

[0937] 1. Hardware:

[0938] Smartphone or smart glasses: Used as a user interface.

[0939] Webcam: Built into the smart glasses and used to recognize the user's facial expressions.

[0940] Microphone: Built into the smart glasses and used to recognize the user's voice.

[0941] 2. Software:

[0942] Speech recognition engine: Uses Google Cloud Speech-to-Text to convert user speech into text.

[0943] Facial Expression Recognition Engine: Uses Microsoft Azure Face API to recognize emotions from the user's facial expressions.

[0944] Text Analysis Engine: Uses OpenAI GPT-4 to analyze the content and sentiment of text entered by the user.

[0945] Database management system: Uses MySQL to store procedures and supporting information for each government agency.

[0946] Processing flow

[0947] 1. User Interface:

[0948] Users access the system via a smartphone or smart glasses.

[0949] The user enters their own life events (e.g. birth, injury, illness, death, etc.).

[0950] 2. Data collection and analysis:

[0951] The speech recognition engine converts the user's speech into text.

[0952] The facial expression recognition engine analyzes the user's facial expressions through the webcam and recognizes their emotions.

[0953] The text analytics engine analyzes the user's input text to understand their sentiments and needs.

[0954] 3. Information provision:

[0955] The database management system is used to search for procedures and supporting information related to the user's life events.

[0956] Based on the recognized emotions, the generative AI model generates appropriate prompts and tailors the information provided to the user.

[0957] Examples

[0958] For example, if a user says, "I recently had a baby," the following processing occurs:

[0959] 1. Voice Recognition:

[0960] A speech recognition engine converts what the user says into text.

[0961] 2. Emotion recognition:

[0962] The facial expression recognition engine recognizes the emotion of joy from the user's facial expression.

[0963] The text analysis engine extracts the keyword "childbirth" and analyzes associated sentiment.

[0964] 3. Information provision:

[0965] Search the database for childbirth-related procedures and supporting information.

[0966] The generative AI model generates a prompt like this:

[0967] If a customer says, "I recently had a baby," suggest products and services related to childbirth. Recognize the emotion of joy from the customer's tone of voice and facial expression, and make appropriate suggestions.

[0968] The suggestions are displayed on the smart glasses display and guided to the user.

[0969] In this way, it becomes possible to respond flexibly to users' emotions and needs, improving the quality of customer service in physical stores.

[0970] The flow of the specific process in the application example 1 will be described with reference to FIG.

[0971] Step 1:

[0972] A user accesses the system through a smartphone or smart glasses. The user inputs his / her own life events (e.g. birth, injury, illness, death, etc.). The input event data is sent to the server.

[0973] Step 2:

[0974] The server uses a speech recognition engine (Google Cloud Speech-to-Text) to convert the user's voice into text. The input is voice data, and the output is text data. The server analyzes the voice data and generates the corresponding text data.

[0975] Step 3:

[0976] The server uses a facial expression recognition engine (Microsoft Azure Face API) to analyze facial expressions from the user's facial image captured through a webcam. The input is facial image data, and the output is emotion data. The facial image data is analyzed to estimate the user's emotional state.

[0977] Step 4:

[0978] The server uses a text analysis engine (OpenAI GPT-4) to analyze the text data entered by the user. The input is text data, and the output is emotion data and needs data. The text data is analyzed to understand the user's emotions and needs.

[0979] Step 5:

[0980] The server searches the database management system (MySQL) for procedures and auxiliary information related to the user's life events. The input is life event data, and the output is procedure information and auxiliary information. Based on the life event data, related information is retrieved from the database.

[0981] Step 6:

[0982] The server generates an appropriate prompt sentence using a generative AI model based on the recognized emotion. The input is emotion data and need data, and the output is a prompt sentence. Based on the emotion data and need data, a prompt sentence is generated to adjust the information provided to the user.

[0983] Step 7:

[0984] The server adjusts the information to be provided to the user based on the generated prompt text and displays it on the smart glasses display. The input is the prompt text and procedural information, and the output is the display information. Based on the prompt text and procedural information, the server provides the user with the most appropriate information.

[0985] Example 2

[0986] Next, a description will be given of Example 2 of the embodiment 2. In the following description, the data processing device 12 is referred to as a "server" and the smart glasses 214 are referred to as a "terminal".

[0987] In conventional systems, when users tried to obtain information on procedures and assistance related to life events, they were not provided with appropriate guidance based on their emotions, which often left users feeling anxious or confused. In addition, the system did not provide enough information based on individual needs, such as information on subsidies by region. This made it difficult for users to complete the necessary procedures and receive appropriate assistance.

[0988] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0989] In this invention, the server includes a means for centrally reading information on procedures and various types of assistance from each administrative agency, a means for accepting event input from the user, a means for providing guidance on procedures based on the input event, a means for analyzing the user's emotions, and a means for adjusting the content and method of guidance based on the emotion analysis result. This enables optimal guidance according to the user's emotions, allowing the user to reliably carry out the necessary procedures and receive appropriate assistance.

[0990] "Each administrative agency" refers to a public institution such as the national or local government, which is an organization that handles procedures and provides subsidies.

[0991] A "procedure" refers to a formal procedure or method required to accomplish a particular objective.

[0992] "Subsidy" refers to financial or material support provided to individuals or organizations that meet certain criteria.

[0993] "Means for centrally reading information" refers to a method or device for centrally collecting and storing necessary data from multiple sources.

[0994] "User" refers to any individual or entity that uses the System.

[0995] "Event input" refers to the act of a user inputting information about a specific life event (e.g. birth, injury, illness, death, etc.) into the system.

[0996] "Means for providing information" refers to a method or device for providing a user with necessary procedures or assistance information.

[0997] "Means for analyzing emotions" refers to a method or device for determining a user's emotional state based on the user's input and / or dialogue history.

[0998] "Means for adjusting the content and method of guidance based on the results of sentiment analysis" refers to a method or device for optimizing the content and method of providing information to a user based on the results of sentiment analysis.

[0999] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[1000] This invention is a system that provides information on necessary procedures and assistance when a user inputs information related to a life event. The system includes a means for centrally reading information on procedures and various assistance from various government agencies, a means for accepting event input from a user, a means for providing guidance on procedures based on the input event, a means for analyzing the user's emotions, and a means for adjusting the content and method of guidance based on the emotion analysis results.

[1001] Hardware and Software Used

[1002] The server uses a database (e.g., MySQL or PostgreSQL) to store and search information on procedures and assistance for each government agency. For sentiment analysis, it uses a sentiment engine (e.g., IBM Watson or Microsoft Azure sentiment analysis API). The terminal provides an interface for users to input information and uses the HTTPS protocol to communicate with the server.

[1003] Explanation of program processing

[1004] The user uses a terminal (e.g., a smartphone or a PC) to input information related to childbirth. Specifically, the user inputs the keyword "childbirth." The terminal sends the information the user input to the server. The server searches a database based on the received keyword "childbirth" to obtain information such as the deadline and place to submit the birth notification, how to apply for a lump-sum childbirth allowance, and subsidy information for each region.

[1005] At the same time, the server uses an emotion engine to analyze the user's emotions. For example, if the user enters "I'm worried because I don't know how to go about childbirth," the emotion engine will determine that the user is feeling anxious. The server generates information including more detailed explanations for the user based on the acquired information and the emotion analysis results. For example, it generates information such as, "Please submit a birth notification to your city, ward, town, or village office within 14 days of giving birth. To apply for a lump-sum birth allowance, submit an application to your health insurance association. If you live in Tokyo, there is also information on specific subsidies, so please check the city hall's website for details."

[1006] Finally, the server transmits the generated information to the terminal, which then displays it to the user, who can then reliably carry out the necessary procedures based on the displayed information.

[1007] Examples and prompts

[1008] As a concrete example, if the user inputs "birth", the server provides the following information:

[1009] The deadline for submitting a birth notification is within 14 days of the birth.

[1010] The application should be submitted to the city, town or village office.

[1011] To apply for the maternity benefit, you must submit an application to your health insurance association.

[1012] If the user lives in Tokyo, it also provides information on specific subsidies for Tokyo.

[1013] Example prompt:

[1014] If the user types "childbirth," provide information about procedures and subsidies related to childbirth. Specifically, include the deadline and place to submit the childbirth notification, how to apply for the childbirth lump-sum payment, differences in subsidies by region, etc. Also, adjust the content and method of guidance according to the user's feelings.

[1015] This system allows users to carry out the necessary procedures reliably and receive appropriate assistance. The introduction of an emotion engine makes it possible to provide optimal guidance according to the user's emotions.

[1016] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1017] Step 1:

[1018] The user enters the information.

[1019] The user uses a terminal (e.g., a smartphone or a PC) to input information related to childbirth. Specifically, the user inputs the keyword "childbirth." The input information is saved in an input field on the terminal.

[1020] Step 2:

[1021] The terminal transmits the input information to the server.

[1022] The terminal transmits the information input by the user to the server. At this time, the data is transmitted securely using the HTTPS protocol. The input data is the keyword "birth" and is transmitted to the server.

[1023] Step 3:

[1024] The server searches the database.

[1025] The server searches the database based on the received keyword "birth." The database contains information such as the deadline for submitting birth notifications, where to submit them, how to apply for a lump-sum birth benefit, and subsidy information by region. The server uses an SQL query to retrieve the necessary information. The output is information on the applicable procedures and subsidies.

[1026] Step 4:

[1027] The server analyzes the user's emotions using an emotion engine.

[1028] The server uses an emotion engine to analyze the user's emotions based on the user's input and past dialogue history. For example, the emotion engine determines that the user is feeling anxious based on the input, "I'm anxious because I don't know how to handle childbirth." The input is the user's text data, and the output is the result of emotion analysis.

[1029] Step 5:

[1030] The server generates information based on the search results and sentiment analysis results.

[1031] The server generates information to provide to the user based on the information retrieved from the database and the analysis results of the emotion engine. For example, if it is determined that the user is confused, the server generates information containing a more detailed explanation. The input is the information in the database and the emotion analysis results, and the output is optimized information to provide to the user.

[1032] Step 6:

[1033] The server transmits the generated information to the terminal.

[1034] The server sends the generated information to the terminal. At this time, the data is sent securely using the HTTPS protocol. The input is the generated information, and the output is the data sent to the terminal.

[1035] Step 7:

[1036] The terminal displays the information to the user.

[1037] The terminal displays the information received from the server to the user. Specifically, it displays the deadline for submitting birth notification and where to submit it, how to apply for a lump-sum birth allowance, subsidy information by region, etc. The input is the information from the server, and the output is the information displayed to the user.

[1038] (Application example 2)

[1039] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server", and the smart glasses 214 will be referred to as a "terminal".

[1040] In conventional systems, when users were trying to obtain procedures or supplementary information related to a particular event, they were often left feeling anxious or confused because appropriate guidance based on emotions was not provided. In addition, information related to payment procedures and information on regional subsidies and discounts were not provided in a centralized manner, making it difficult for users to efficiently obtain the information they needed. This reduced user convenience and could lead to delays in procedures and misunderstandings.

[1041] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1042] In this invention, the server includes a means for centrally reading information on procedures and various subsidies from each government agency, a means for accepting an event input from a user, a means for providing guidance on the procedures based on the input event, a means for recognizing the user's emotions, a means for adjusting the content and method of the guidance based on the recognized emotions, a means for providing information related to payment procedures, and a means for providing information on regional subsidies and discounts. This allows optimal guidance to be provided according to the user's emotions, and makes it possible to centrally obtain information related to payment procedures and information on regional subsidies and discounts.

[1043] "Each administrative agency" refers to a public institution such as the national or local government, which is an organization that carries out specific procedures or provides subsidies.

[1044] A "procedure" refers to a formal step or process required to achieve a particular objective.

[1045] "Assistance" refers to financial or material assistance provided in support of a particular purpose or activity.

[1046] "Means of centrally loading information" refers to the function of centrally collecting necessary data from multiple sources and making it available within the system.

[1047] "User" refers to any individual or entity that uses the System.

[1048] "Event input" refers to the act of a user inputting a specific occurrence or situation into the system.

[1049] "Means of providing guidance" refers to the function of explaining necessary information and procedures to users.

[1050] "Means of recognizing emotions" refers to the ability to analyze and identify emotions from user input and actions.

[1051] "Means for adjusting the content and method of guidance" refers to the ability to change the information provided and the way it is conveyed based on recognized emotions.

[1052] "Payment Process" refers to the formal procedure for paying for a particular service or product.

[1053] "Regional subsidy and discount information" refers to information about financial assistance or price discounts available to users who live in a particular region.

[1054] A system for carrying out the present invention has the following configuration: A server includes means for centrally reading information on procedures and various subsidies of each government agency, means for accepting event input from a user, means for providing guidance on procedures based on the input event, means for recognizing the user's emotions, means for adjusting the content and method of guidance based on the recognized emotions, means for providing information related to payment procedures, and means for providing information on local subsidies and discounts.

[1055] Hardware and Software Used

[1056] Hardware: Servers, user devices (smartphones, tablets, PCs)

[1057] Software: emotion recognition libraries (e.g. EmotionEngine), databases (e.g. PaymentDatabase), generative AI models

[1058] Data processing and calculation

[1059] emotion recognition

[1060] The text data entered by the user through the terminal is sent to the server. The server uses an emotion recognition library (EmotionEngine) to analyze and identify the user's emotions. This emotion data is used to adjust subsequent guidance.

[1061] Information Search

[1062] The server retrieves relevant transaction and subsidy information from a database (PaymentDatabase) based on the user's location and event input. This information forms the basis of the guidance provided to the user.

[1063] Guide Adjustment

[1064] The server then adapts the content and manner of guidance based on the perceived emotion: for example, if the user is perceived to be confused, it will provide a detailed explanation, and if the user is angry or frustrated, it will provide polite guidance.

[1065] Examples

[1066] If a user types "I don't know how to pay my utility bills," the server uses an emotion recognition library to recognize the user's emotions. For example, if the server detects that the user is confused, it will respond with "Don't worry. Here's how to pay your utility bills: [More info]."

[1067] Examples of prompt statements

[1068] If a user types "I don't know how to pay my utility bills," use an emotion recognition engine to recognize the user's emotion and provide appropriate guidance. If the user is confused, provide more information.

[1069] In this way, optimal guidance based on the user's emotions can be provided, and information related to payment procedures and local subsidies and discounts can be obtained in a centralized manner.

[1070] The flow of the specific process in the application example 2 will be described with reference to FIG.

[1071] Step 1:

[1072] The user inputs events through the terminal.

[1073] Input: User types, "I don't know how to pay my utility bill."

[1074] Output: The entered text data is sent to the server.

[1075] Step 2:

[1076] The server uses an emotion recognition library (EmotionEngine) to analyze the user's emotions.

[1077] Input: Text data submitted by the user.

[1078] Data processing: The text data is passed to an emotion recognition library to analyze emotions.

[1079] Output: Parsed emotion data (e.g. confusion, anxiety, anger, etc.).

[1080] Step 3:

[1081] The server searches for relevant procedural and subsidy information from a database (PaymentDatabase) based on the user's regional information and event input.

[1082] Input: User location information and event input (e.g. "how do I pay my utility bill").

[1083] Data retrieval: Searching for relevant information from databases.

[1084] Output: Procedural and grant information (e.g. payment method, submission deadline, grant availability, etc.).

[1085] Step 4:

[1086] The server adjusts the content and method of guidance based on the recognized emotion.

[1087] Input: Parsed emotion data and retrieved procedural information.

[1088] Data processing: Adjust the content and method of guidance based on emotion data.

[1089] Output: Tailored informational message (e.g. "Don't worry, here's how to pay your utility bill: [More info]").

[1090] Step 5:

[1091] The server transmits the adjusted announcement message to the user terminal.

[1092] Input: Adjusted informational message.

[1093] Output: An informational message that is displayed on the user's terminal.

[1094] Step 6:

[1095] The user checks the guidance message via the terminal and carries out the necessary procedures.

[1096] Input: The informational message displayed on the user's terminal.

[1097] Output: The action the user takes to complete the transaction.

[1098] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires a voice indicating a user input for the result of the specific processing. The control unit 46A transmits the voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1099] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by making a neural network perform deep learning. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating a voice, text data indicating a text, and image data indicating an image is input. The data generation model 58 performs inference on the input inference data according to the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1100] Another example of generative AI is Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) are mentioned.

[1101] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1102] [Third embodiment]

[1103] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1104] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1105] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a wide area network (WAN) and / or a local area network (LAN).

[1106] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1107] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs the voice according to instructions from the processor 46.

[1108] Camera 42 is a small digital camera equipped with an optical system including a lens, an aperture, and a shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (e.g., an imaging range defined by an angle of view equivalent to the width of the field of vision of an average healthy person).

[1109] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for transmitting and receiving various types of information between the processor 46 and the processor 28 via the network 54. The transmission and reception of various types of information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is performed in a secure state.

[1110] Fig. 6 shows an example of main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1111] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32, and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1112] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1113] In the headset type terminal 314, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50, and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1114] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[1115] "Example 1"

[1116] The system of the present invention is equipped with a database that centrally reads information on procedures and various types of assistance from each government agency. This database can collect and update information from government agency websites and official documents. It also has an interface that accepts event input from users. This interface is provided in the form of a website or application, and allows users to input events that have occurred to them (birth, injury, illness, death, etc.). It then has the function of searching the database for information on necessary procedures and assistance based on the input event, and providing guidance to the user.

[1117] "Example 2"

[1118] As a specific example, when a user enters that they have given birth, the system searches the database for information on procedures and subsidies related to childbirth. For example, it provides information such as the deadline for submitting a birth notification, where to submit it, and how to apply for a lump-sum childbirth allowance. It also provides information on the area where the user lives, taking into account differences in subsidies by region. This allows users to be sure to complete the necessary procedures and receive assistance.

[1119] The process flow of each embodiment will be described below.

[1120] "Example 1"

[1121] Step 1: The system collects procedural and subsidy information from each government agency's website, official documents, etc. and stores it in a database.

[1122] Step 2: The user enters events that have occurred to them (birth, injury, illness, death, etc.) through an interface such as a website or application.

[1123] Step 3: Based on the entered event, the system searches the database for the necessary procedures and auxiliary information.

[1124] Step 4: The system guides the user through the search results, allowing them to take the necessary steps and receive assistance.

[1125] "Example 2"

[1126] Step 1: If the user enters birth, the system searches the database for information on procedures and ancillary care related to birth.

[1127] Step 2: The system will provide information such as the deadline for submitting the birth notification, where to submit it, and how to apply for the maternity benefit.

[1128] Step 3: The system also provides information about the area where the user lives, taking into account differences in subsidies depending on the region.

[1129] Step 4: This allows the user to ensure they take the necessary steps and receive assistance.

[1130] Example 1

[1131] Next, a description will be given of Example 1 of the embodiment 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal".

[1132] In conventional systems, users had to collect information on procedures and assistance from each government agency individually, making it difficult for users to quickly obtain the information they needed. In addition, there was a lack of a means to centrally provide information on procedures and assistance according to life events, increasing the time and effort required for users to carry out appropriate procedures. Furthermore, information had to be updated manually, making it difficult to provide the latest information.

[1133] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1134] In this invention, the server includes a means for centrally reading information on procedures and various assistance from each administrative agency, a means for accepting event input from a user, a means for providing guidance on procedures based on the input event, a means for storing collected information in a database and periodically updating it, a means for providing an interface accessible to the user, a means for searching the database based on the input event information, and a means for notifying the user of the search results. This allows the user to quickly obtain the latest information on procedures and assistance from a centralized location, and to efficiently carry out appropriate procedures.

[1135] "Each administrative agency" refers to a public institution such as the national government or a local government, which is an organization that provides information on procedures and subsidies.

[1136] A "procedure" refers to a formal procedure or method required to accomplish a particular objective.

[1137] "Subsidy" refers to financial or material support provided to individuals or organizations that meet certain criteria.

[1138] "Means of centrally loading information" refers to methods and technologies for centrally collecting information on procedures and subsidies from each administrative agency and storing it in a database.

[1139] "User" refers to an individual or organization that uses this system to obtain information and carry out procedures.

[1140] "Means for accepting event input" refers to an interface or method for a user to input life events that have occurred to them (such as birth, injury, illness, or death).

[1141] "Guidance means" refers to methods or technologies for providing relevant procedural or assistance information based on event information entered by a user.

[1142] A "database" refers to an information management system that stores collected information in an organized manner and allows it to be searched and updated.

[1143] "Interface" refers to the screens and applications through which a user accesses a system and enters or retrieves information.

[1144] "Search means" refers to methods and technologies for extracting relevant information from a database based on event information entered by a user.

[1145] "Means of presenting search results" refers to methods and technologies for presenting searched information to users in an easy-to-understand manner.

[1146] This invention is a system that centrally collects information on procedures and various subsidies from various government agencies and provides information on necessary procedures and subsidies based on event information entered by a user. A specific embodiment of this system will be described below.

[1147] Information collection and database updates

[1148] The server collects procedural and auxiliary information from the websites and official documents of each government agency. This collection is done using web scraping tools (e.g. Beautiful Soup and Scrapy) and APIs. The collected information is stored in a database such as MySQL or PostgreSQL. The server periodically runs the crawler to update the information.

[1149] Providing a user interface

[1150] The server provides an interface where users can input event information, either in the form of a web interface using React or Vue.js, or a mobile application using Flutter, and the device displays these interfaces when accessed by the user.

[1151] Accepting event input

[1152] The user inputs events that have occurred to them (birth, injury, illness, death, etc.) through the provided interface. For example, if the user inputs the event "birth," they can enter the expected date of birth and hospital information. The terminal sends the input event information to the server. The HTTPS protocol is used for transmission to ensure data security.

[1153] Search and find the information you need

[1154] The server searches the database using SQL queries and Elasticsearch based on the event information entered by the user. For example, it searches for information on procedures and subsidies related to "childbirth." The server then presents the search results to the user. For example, it displays information on procedures related to childbirth (submitting a birth notification, applying for child allowance, etc.) and subsidies (lump-sum childbirth and child care grants, etc.).

[1155] Examples

[1156] For example, if a user enters the event "birth," the server searches the database for information on birth-related procedures (submitting a birth notification, applying for child allowance, etc.) and subsidies (lump-sum childbirth and child care grants, etc.) and provides guidance to the user.

[1157] Examples of prompt statements

[1158] Examples of prompts to be input to a generative AI model include the following:

[1159] "When a user inputs the event of childbirth, please explain the system process that guides them to relevant procedures and support information."

[1160] By inputting this prompt sentence into a generative AI model, a sentence is generated that explains the specific processing content of the system in natural language.

[1161] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1162] Step 1: Collect information and update the database

[1163] The server collects procedural and auxiliary information from the websites and official documents of each government agency. Specifically, the information is obtained using web scraping tools (e.g. Beautiful Soup and Scrapy) and APIs. The collected information is stored in a database such as MySQL or PostgreSQL. The server periodically runs the crawler to update the information.

[1164] Input: Websites and official documents of each government agency

[1165] Output: Procedure and auxiliary information stored in a database

[1166] Step 2: Providing a User Interface

[1167] The server provides an interface that allows users to input event information. Specifically, it develops and provides a web interface using React or Vue.js, or a mobile application using Flutter. The terminal displays these interfaces when the user accesses them.

[1168] Input: User access

[1169] Output: Event information input screen

[1170] Step 3: Accepting event input

[1171] The user inputs events that have occurred to them (birth, injury, illness, death, etc.) through the provided interface. For example, if the user inputs the event "birth," they can enter the expected date of birth and hospital information. The terminal sends the input event information to the server. The HTTPS protocol is used for transmission to ensure data security.

[1172] Input: User-entered event information

[1173] Output: Event information sent to the server

[1174] Step 4: Finding the information you need

[1175] The server uses SQL queries and Elasticsearch to search the database based on the event information entered by the user, for example, to search for information about procedures and assistance related to "birth."

[1176] Input: User-entered event information

[1177] Output: Procedures and supporting information as search results

[1178] Step 5: Navigate through search results

[1179] The server informs the user of the search results. Specifically, it uses methods and technologies to present the searched information to the user in an easy-to-understand manner. For example, it displays information on procedures related to childbirth (submitting a birth notification, applying for child allowance, etc.) and subsidies (lump-sum childbirth and childcare grants, etc.).

[1180] Input: Procedure and auxiliary information as search results

[1181] Output: Information about the procedure or assistance provided to the user

[1182] Step 6: Update your information

[1183] The server periodically runs a crawler to keep the information in the database up to date, ensuring that the information provided to users is always up to date.

[1184] Input: Latest information from each government agency

[1185] Output: Updated database

[1186] (Application example 1)

[1187] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server", and the headset type terminal 314 will be referred to as a "terminal".

[1188] In the conventional system, it was difficult to centrally manage the procedures and supplementary information of each government agency, making it difficult for users to quickly obtain the information they needed. In addition, there was a lack of means to provide appropriate procedures and supplementary information in real time for events occurring in physical stores, which reduced user convenience. This caused problems such as users being unable to use procedures and supplementary information appropriately.

[1189] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1190] In this invention, the server includes a means for centrally reading information on procedures and various assistance from each government agency, a means for accepting event input from a user, a means for providing information on procedures based on the input event, a means for inputting an event that occurred in a real store by the user, and a means for providing information on procedures and assistance in real time based on the input event. This enables a user to quickly obtain necessary procedure and assistance information for an event that occurred in a real store and take appropriate action.

[1191] "Each administrative agency" refers to a public institution such as the national or local government, which is an organization that handles procedures and provides subsidies.

[1192] A "procedure" refers to a formal procedure or method required to accomplish a particular objective.

[1193] "Assistance" refers to financial or material support provided to achieve a specific purpose.

[1194] "Means for centrally reading information" refers to a method or device for centrally collecting and managing data from multiple sources.

[1195] "User" refers to any individual or entity that uses the System.

[1196] "Means for accepting event input" refers to a method or device that allows a user to input an occurrence or situation into the system.

[1197] "Means for providing information" refers to a method or device for providing the user with the necessary information.

[1198] "Brick and mortar store" refers to a commercial establishment that exists in a physical location and offers goods and services.

[1199] "Real-time" refers to immediate processing or response without delay.

[1200] "Procedure or assistance information" refers to detailed data or instructions relating to a particular procedure or assistance.

[1201] A system for implementing this invention includes means for centrally reading information on procedures and various assistance from each government agency, means for accepting event input from a user, means for providing guidance on procedures based on the input events, means for inputting events that occur in a physical store by a user, and means for providing information on procedures and assistance in real time based on the input events.

[1202] System Programming

[1203] The server collects procedures and supporting information from the websites and official documents of each government agency and stores it in a database. When a user inputs an event using a smartphone or smart glasses, the information is sent to the server. The server searches the database for related procedures and supporting information based on the input event and provides the user with guidance in real time.

[1204] Hardware and software used

[1205] Hardware: Smartphones, smart glasses

[1206] Software: Flask (a Python web framework), requests (a Python library for sending HTTP requests)

[1207] Data processing and calculation

[1208] 1. Event input: The user inputs an event via a smartphone or smart glasses.

[1209] 2. Database integration: Based on the entered event information, the server sends a request to the database API.

[1210] 3. Information retrieval: Retrieve relevant procedure and assistance information from the database.

[1211] 4. Real-time guidance: The acquired information is provided to the user in real time.

[1212] Examples

[1213] When a user enters "return product" on their smartphone, the server retrieves information about the return procedure from the database and guides the user through it, allowing the user to quickly complete the necessary procedures.

[1214] Examples of prompt statements

[1215] The user has entered "return product" on their smartphone. Retrieve information about the return procedure from the database and guide the user.

[1216] In this way, a system can be realized that improves the user experience in a physical store.

[1217] The flow of the specific process in the application example 1 will be described with reference to FIG.

[1218] Step 1:

[1219] Users input events using a smartphone or smart glasses.

[1220] Input: The event the user occurred (e.g. "return product")

[1221] Output: Event information is sent from the device to the server.

[1222] Specific operation: The user opens the smartphone application, enters an event such as "product return" on the event input screen, and presses the send button.

[1223] Step 2:

[1224] The server analyzes the received event information.

[1225] Input: Event information sent from the device

[1226] Output: Parsed event information

[1227] Specific operation: The server analyzes the received event information and identifies the type of event (e.g., "product return").

[1228] Step 3:

[1229] The server sends a request to the database API to retrieve relevant procedures and auxiliary information.

[1230] Input: Parsed event information

[1231] Output: Procedures and auxiliary information retrieved from the database

[1232] Specific operation: The server requests procedures and auxiliary information related to "product returns" from the database API and retrieves the relevant information from the database.

[1233] Step 4:

[1234] The server provides the user with real-time information on procedures and auxiliary information obtained.

[1235] Input: Procedures and supporting information retrieved from the database

[1236] Output: Instructions and support information provided to the user

[1237] Specific operation: The server sends the acquired information to a smartphone or smart glasses application, and displays the procedure details and auxiliary information to the user.

[1238] Step 5:

[1239] The user carries out the procedure based on the information provided.

[1240] Input: Procedures and auxiliary information provided by the server

[1241] Output: Specific steps that the user will take

[1242] Specific actions: The user checks the details of the procedure displayed on their smartphone or smart glasses and carries out the necessary procedures (e.g., going to the returns counter, preparing the necessary documents).

[1243] Example 2

[1244] Next, a second embodiment of the second form will be described. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal".

[1245] In the conventional system, users had to search multiple government agencies and information sources individually to obtain procedures and supplementary information related to life events, which was time-consuming and laborious. In addition, because supplementary information differs by region, it was difficult for users to obtain information appropriate to their own area of ​​residence.

[1246] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1247] In this invention, the server includes a means for centrally reading information on procedures and various assistance from each administrative agency, a means for accepting an event input from a user, a means for providing procedure information based on the input event, a means for accepting information on the user's residential area, a means for providing assistance information for each area based on the accepted residential area information, a means for searching a database to obtain related information, and a means for providing the obtained information to the user. This allows the user to easily obtain procedures and assistance information related to life events through one system, and assistance information for each area is also provided appropriately.

[1248] "Each administrative agency" refers to a public agency such as the national or local government, which is responsible for providing information on procedures and subsidies.

[1249] A "procedure" refers to a formal procedure or method required to accomplish a particular objective.

[1250] "Subsidy" refers to financial or material support provided to individuals or organizations that meet certain criteria.

[1251] "Means for centrally reading information" refers to a method or device for centrally collecting necessary data from multiple sources.

[1252] "User" refers to an individual or entity that uses the System to input information and obtain required procedures and supporting information.

[1253] "Event input" refers to the act of a user inputting information about a specific life event (e.g. birth, injury, illness, death, etc.) into the system.

[1254] "Means for providing guidance" refers to a method or device for providing appropriate procedures or auxiliary information based on information input by a user.

[1255] "Residence area information" refers to information about the area where the user currently lives, and is used to provide auxiliary information for each area.

[1256] "Database" refers to a system for efficiently storing, retrieving, and managing information.

[1257] "Means for searching and obtaining relevant information" refers to a method or device for searching information in a database and obtaining the data required by the user.

[1258] "Means for providing" refers to a method or device for displaying the acquired information in a format that is easy for the user to understand.

[1259] The present invention provides a system that allows a user to easily obtain procedures and auxiliary information related to a life event. A specific embodiment of this system will be described below.

[1260] System Configuration

[1261] This system is composed of three main elements: a server, a terminal, and a user. The server includes a means for centrally reading information on procedures and various assistance from each government agency, a means for accepting event input from the user, a means for providing procedure guidance based on the input event, a means for accepting information on the user's residential area, a means for providing assistance information for each area based on the accepted residential area information, a means for searching a database to obtain related information, and a means for providing the obtained information to the user.

[1262] Hardware and Software Used

[1263] The server uses MySQL as a database management system and executes programs to process information entered by users. The terminal is a device such as a PC or smartphone that provides an interface for users to enter information. Users use the terminal to access the system and enter the required information.

[1264] Data processing and calculation

[1265] The server takes the information entered by the user and searches the MySQL database to retrieve any relevant procedures or auxiliary information, by executing SQL queries such as:

[1266] sql

[1267] SELECT FROM procedures WHERE keyword = 'birth' AND region = 'Tokyo';

[1268] The server organizes the acquired information and provides it to the user in an easy-to-understand format.

[1269] Examples

[1270] For example, if a user enters "birth" and selects "Tokyo" as their place of residence, the server provides the following information:

[1271] Deadline for submitting birth notification: Within 14 days after birth

[1272] Submit to: City / ward / town / village office

[1273] How to apply for maternity benefits: Apply to your health insurance association

[1274] Tokyo Metropolitan Government Subsidy Information: In addition to the lump-sum childbirth allowance, Tokyo Metropolitan Government provides additional subsidies if certain conditions are met.

[1275] Examples of prompt statements

[1276] If a user enters "birth" and selects "Tokyo" as their area of ​​residence, please provide information on the deadline and place to submit the birth notification, how to apply for the lump-sum birth allowance, and information on Tokyo's subsidies.

[1277] This system allows users to easily obtain procedures and supplementary information related to life events through a single interface. In addition, supplementary information for each region is provided appropriately, so users can obtain information appropriate for their own area.

[1278] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1279] Step 1:

[1280] The user enters the information.

[1281] The user opens a browser on the terminal, accesses the web page of the system, enters information related to the birth into the input form, and clicks the "Search" button.

[1282] Input: Information related to birth (e.g. birth, place of residence)

[1283] Output: User input is sent to the server

[1284] Step 2:

[1285] The server receives the input information.

[1286] The server receives the information entered by the user, which includes birth-related keywords and the area of ​​residence.

[1287] Input: User input information

[1288] Output: The database is ready to be searched based on the input information received.

[1289] Step 3:

[1290] The server searches the database.

[1291] The server connects to a MySQL database and executes a query based on the information entered by the user, for example executing a SQL query like this:

[1292] sql

[1293] SELECT FROM procedures WHERE keyword = 'birth' AND region = 'Tokyo';

[1294] Input: User input information (keywords and area of ​​residence)

[1295] Output: Relevant information retrieved from the database

[1296] Step 4:

[1297] The server processes the search results.

[1298] The server processes the information retrieved from the database, such as the deadline for submitting birth notification, where to submit it, how to apply for a lump-sum birth allowance, and information on subsidies by region.

[1299] Input: Relevant information retrieved from the database

[1300] Output: Organized information (e.g. deadline for submitting birth notification, where to submit it, how to apply for childbirth lump sum payment, subsidy information by region)

[1301] Step 5:

[1302] The server provides the information to the user.

[1303] The server then presents the organized information to the user, typically in the form of a web page that displays information such as:

[1304] Deadline for submitting birth notification: Within 14 days after birth

[1305] Submit to: City / ward / town / village office

[1306] How to apply for maternity benefits: Apply to your health insurance association

[1307] Tokyo Metropolitan Government Subsidy Information: In addition to the lump-sum childbirth allowance, Tokyo Metropolitan Government provides additional subsidies if certain conditions are met.

[1308] Input: Organized information

[1309] Output: Information provided to the user

[1310] In this way, the user can be sure to take the necessary steps and receive appropriate assistance.

[1311] (Application example 2)

[1312] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server", and the headset type terminal 314 will be referred to as a "terminal".

[1313] When users face life events such as childbirth, it is difficult for them to quickly and accurately obtain information on necessary procedures and subsidies. In addition, there is a lack of a centralized means of providing information on subsidies and related services by region, making it difficult for users to receive appropriate support.

[1314] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1315] In this invention, the server includes a means for centrally reading information on procedures and various subsidies of each government agency, a means for accepting event input from a user, a means for guiding the procedures based on the input event, a means for providing subsidy information for each region based on the user's residential area, and a means for displaying related services based on the user's input. This allows the user to quickly and accurately obtain information on procedures and subsidies related to life events such as childbirth, and to centrally receive information on subsidies for each region and information on related services.

[1316] "A means of centrally reading information on procedures and various subsidies from each administrative agency" is a function for centrally collecting information on procedures and subsidies provided by multiple administrative agencies and storing it in a database.

[1317] The "means for accepting event input from a user" refers to an interface that enables a user to input a specific life event (e.g., birth, injury, illness, death, etc.) into the system.

[1318] The "means for providing guidance regarding procedures based on an input event" is a function for searching for procedure information related to a life event input by the user and providing it to the user.

[1319] The "means for providing regional subsidy information based on the user's region of residence" is a function for searching for subsidy information specific to that region based on the region of residence input by the user and providing it to the user.

[1320] "Means for displaying related services based on user input" refers to a function for searching for related services (e.g. obstetricians, baby goods stores, childcare support centers, etc.) based on information entered by the user and displaying them to the user.

[1321] The system for carrying out the present invention includes a server, a user terminal, and a database. The server includes a means for centrally reading information on procedures and various subsidies of each government agency, a means for accepting event input from a user, a means for providing procedure information based on the input event, a means for providing subsidy information by region based on the user's residential area, and a means for displaying related services based on the user's input.

[1322] Explanation of program processing

[1323] 1. A way to centrally read information on procedures and various subsidies from various government agencies

[1324] The server periodically collects information on procedures and assistance provided by each government agency and stores it in a database, so that users can always receive the latest information.

[1325] 2. A means of accepting event input from the user

[1326] Through a user terminal (such as a smartphone or smart glasses), the user inputs a specific life event (e.g., childbirth). The input interface is designed to be intuitive and easy to use.

[1327] 3. A means of providing procedural guidance based on entered events

[1328] The server searches the database for relevant procedural information based on the life event entered by the user and provides it to the user. For example, in the case of childbirth, information such as the deadline for submitting a birth notification, where to submit it, and how to apply for a lump-sum birth benefit are displayed.

[1329] 4. A way to provide local grant information based on where a user lives

[1330] Based on the user's input of the residential area information, the server searches the database for subsidy information specific to that area and provides it to the user, allowing the user to easily check the subsidies available in his / her area.

[1331] 5. How to display relevant services based on user input

[1332] The server searches for related services (e.g. obstetricians, baby goods stores, childcare support centers, etc.) based on the information entered by the user and displays them to the user, allowing the user to quickly find the services they need.

[1333] Examples

[1334] For example, if a user enters "birth" and "Tokyo," the server provides the following information:

[1335] Deadline and place to submit birth notification

[1336] How to apply for maternity benefits

[1337] Tokyo-specific subsidy information

[1338] Information on nearby obstetrics and gynecology clinics, baby goods stores, and childcare support centers

[1339] Example prompts to be input to the generative AI model

[1340] "Create an application that provides information on procedures and subsidies related to childbirth when a user enters their expected delivery date and area of ​​residence. For example, it displays the deadline and place to submit the birth notification, how to apply for the lump-sum childbirth allowance, and subsidy information by area."

[1341] In this way, users can quickly and accurately obtain the information they need and take the appropriate steps.

[1342] The flow of the specific process in the application example 2 will be described with reference to FIG.

[1343] Step 1:

[1344] The server periodically collects information on procedures and assistance provided by each government agency and stores it in a database. Specifically, it uses APIs and web scraping technology to obtain information from the websites and databases of each government agency. The input is data from the websites and databases of each government agency, and the output is information on procedures and assistance stored in the server's database.

[1345] Step 2:

[1346] A user inputs a specific life event (e.g., childbirth) using a terminal such as a smartphone or smart glasses. The input interface is designed to be intuitive and easy to use. The input is the life event information that the user enters into the terminal, and the output is the life event information sent to the server.

[1347] Step 3:

[1348] The server searches the database for relevant procedure information based on the life event input by the user and provides it to the user. Specifically, it uses an SQL query to search the database and obtains the relevant procedure information. The input is the life event information input by the user, and the output is the procedure information provided to the user.

[1349] Step 4:

[1350] The user inputs the residential area information into the terminal. The input interface is designed to allow the user to easily input the area information. The input is the residential area information that the user inputs into the terminal, and the output is the residential area information that is sent to the server.

[1351] Step 5:

[1352] The server searches the database for subsidy information specific to the region based on the residential area information entered by the user, and provides it to the user. Specifically, it uses an SQL query to search the database and obtains the relevant subsidy information. The input is the residential area information entered by the user, and the output is the subsidy information provided to the user.

[1353] Step 6:

[1354] The server searches for related services (e.g. obstetricians, baby goods stores, childcare support centers, etc.) based on the information entered by the user and displays them to the user. Specifically, it retrieves related service information from a database and displays it on the user's terminal. The input is the life event information and residential area information entered by the user, and the output is related service information provided to the user.

[1355] In this way, the user can quickly and accurately obtain the necessary information and take the appropriate steps.

[1356] In addition, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1357] "Example 1"

[1358] In one embodiment of the present invention, an emotion engine is incorporated. This emotion engine recognizes emotions from the user's tone of voice, facial expression, text input, etc. Specifically, the emotion is estimated from the tone, strength, speed, etc. of the voice when the user speaks to the system. In addition, when the user shows the system his or her face through a webcam, etc., emotion is estimated using facial expression recognition technology. Furthermore, when the user inputs text, emotion is estimated from the wording and context of the text.

[1359] "Example 2"

[1360] In addition, in one embodiment of the present invention, the content and method of guidance are adjusted based on the emotion recognized by the emotion engine. Specifically, if the system estimates that the user is angry or frustrated, the system uses more polite language to provide guidance. If the system estimates that the user is confused or anxious, the system provides a more detailed explanation. This allows optimal guidance to be provided according to the user's emotions.

[1361] The process flow of each embodiment will be described below.

[1362] "Example 1"

[1363] Step 1: The user speaks to the system. At this time, the emotion engine captures the tone, strength, and speed of the user's voice.

[1364] Step 2: The emotion engine estimates the user's emotion from voice characteristics.

[1365] Step 3: The user shows the system their face via a webcam or other device. At this time, the user's facial expressions are captured by the emotion engine.

[1366] Step 4: The emotion engine uses facial expression recognition technology to estimate the user's emotions.

[1367] Step 5: The user enters text, whose phrasing and context are captured by the emotion engine.

[1368] Step 6: The sentiment engine infers the user's sentiment from the text content.

[1369] "Example 2"

[1370] Step 1: The emotion engine recognizes the user's emotion.

[1371] Step 2: The system adjusts the content and method of guidance based on the emotions recognized by the emotion engine.

[1372] Step 3: If the system estimates that the user is angry or frustrated, it will provide more polite guidance.

[1373] Step 4: If the system estimates that the user is confused or anxious, it will provide a more detailed explanation.

[1374] Example 1

[1375] Next, a description will be given of Example 1 of the embodiment 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal".

[1376] Conventional systems for providing administrative procedures and auxiliary information have the problem that it is difficult for users to quickly and accurately obtain the information they need. In addition, the user experience can be poor because information is provided without considering the user's feelings. This creates an issue that makes it difficult for users to carry out appropriate procedures, especially during stressful life events.

[1377] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1378] In this invention, the server includes a means for centrally reading information on procedures and various subsidies of each government agency, a means for accepting event input from the user, a means for providing guidance on procedures based on the input event, a means for recognizing the user's emotions, and a means for adjusting the guidance content based on the emotions. This not only enables the user to quickly and accurately obtain the information he or she needs, but also makes it possible to provide information that takes the user's emotions into consideration.

[1379] "Each administrative agency" refers to a public institution such as a national or local government, which is an organization that provides specific administrative services or procedures.

[1380] A "procedure" refers to a formal step or process required to achieve a particular objective.

[1381] "Subsidy" refers to financial or material support provided to individuals or organizations that meet certain criteria.

[1382] "Means of centrally loading information" refers to technologies and methods for collecting data from multiple sources and managing it centrally.

[1383] "User" refers to any individual or organization that uses this system.

[1384] "Event input" refers to the act of a user inputting a specific occurrence or situation into the system.

[1385] "Means of guidance" refers to technologies and methods for providing users with the necessary information and encouraging them to go through the appropriate procedures.

[1386] "Means of recognizing emotions" refers to technologies and methods for inferring emotions from a user's tone of voice, facial expressions, text input, etc.

[1387] "Means for adjusting guidance content based on emotions" refers to techniques or methods for appropriately changing the information or guidance content provided in response to the recognized emotions of the user.

[1388] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[1389] The system of the present invention is equipped with a database that centrally reads information on procedures and various types of assistance from each government agency. This database can collect and update information from government agency websites and official documents. It also has an interface that accepts event input from users. This interface is provided in the form of a website or application, and allows users to input events that have occurred to them (birth, injury, illness, death, etc.). It then has the function of searching the database for information on necessary procedures and assistance based on the input event, and providing guidance to the user.

[1390] In one embodiment of the present invention, an emotion engine is incorporated. This emotion engine recognizes emotions from the user's tone of voice, facial expression, text input, etc. Specifically, the emotion is estimated from the tone, strength, speed, etc. of the voice when the user speaks to the system. In addition, when the user shows the system his or her face through a webcam, etc., emotion is estimated using facial expression recognition technology. Furthermore, when the user inputs text, emotion is estimated from the wording and context of the text.

[1391] Hardware and Software Used

[1392] The server collects information from government websites and official documents and stores it in a database. This is done using web scraping technology and APIs. Specific software used includes Python's BeautifulSoup and Scrapy, and API client libraries.

[1393] Users input their events through a website or application. For example, if a user inputs "birth", the system takes that information and searches the database for related procedure and ancillary information. This search process is done using SQL queries and full-text search engines (e.g. Elasticsearch).

[1394] The server displays the search results to the user using an HTML template engine (e.g. Jinja2) and a front-end framework (e.g. React, Vue.js).

[1395] When a user speaks to the system, the emotion engine uses voice recognition technology to estimate emotions from the tone, strength, speed, etc. Specific software used is Google Cloud Speech-to-Text and IBM Watson Speech to Text.

[1396] When a user shows their face to the system through a webcam, the system uses facial expression recognition technology to estimate emotions, using OpenCV and Microsoft Azure Face API as the specific software.

[1397] When a user enters text, the system infers emotions from the vocabulary and context of the text. Hugging Face's Transformers library and Google Cloud Natural Language API are used to analyze emotions using natural language processing techniques.

[1398] Examples and prompts

[1399] As a specific example, the process when the user inputs "birth" will be described.

[1400] 1. The user enters "birth" into the website's input form and clicks the submit button.

[1401] 2. The terminal sends this input to the server.

[1402] 3. The server searches the database based on the received event information.

[1403] 4. The server embeds the search results into an HTML template and sends it to the terminal.

[1404] 5. The device displays the received HTML in the browser.

[1405] Example prompt:

[1406] When a user enters "birth", search for and display information on related procedures and assistance.

[1407] In this way, the system of the present invention can quickly provide the user with the information they need. In addition, by using the emotion engine, it is possible to provide information that takes into account the user's emotions, which is expected to improve the user experience.

[1408] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1409] Program processing flow

[1410] Step 1: Gather information

[1411] The server collects information from government websites and official documents.

[1412] Input: Government agency website URL or API endpoint

[1413] Specific behavior:

[1414] The server periodically accesses the government agency's website.

[1415] The server uses web scraping technologies (e.g. BeautifulSoup, Scrapy) to parse the HTML document and extract the required information.

[1416] The server uses the API client library to retrieve data from the API.

[1417] Output: Extracted information (procedure and auxiliary details)

[1418] Step 2: Saving to the Database

[1419] The server stores the collected information in a database.

[1420] Input: Extracted information (procedure and supporting details)

[1421] Specific behavior:

[1422] The server establishes a database connection.

[1423] The server generates SQL queries and inserts the extracted information into a database.

[1424] Output: Information stored in the database

[1425] Step 3: Accepting User Input

[1426] Users enter their events through a website or application.

[1427] Input: Event information entered by the user (e.g. "birth")

[1428] Specific behavior:

[1429] The user enters event information into the input form on the website and clicks the submit button.

[1430] The terminal transmits the input data to the server.

[1431] Output: Event information sent to the server

[1432] Step 4: Database search

[1433] The server searches the database based on the event information received from the user.

[1434] Input: Event information sent by the user

[1435] Specific behavior:

[1436] The server analyzes the received event information and extracts related keywords.

[1437] The server generates the SQL query and performs the search against the database.

[1438] Output: Search results (related procedures and supporting information)

[1439] Step 5: View the results

[1440] The server displays the search results to the user.

[1441] Input: Search results (related procedures and supporting information)

[1442] Specific behavior:

[1443] The server embeds the search results into an HTML template.

[1444] The server transmits the generated HTML to the terminal.

[1445] The terminal displays the received HTML in the browser.

[1446] Output: The search results displayed to the user

[1447] Step 6: Emotion Recognition

[1448] When a user speaks to the system, the emotion engine uses voice recognition technology to infer emotions from the tone, strength, speed, etc. of the voice.

[1449] Input: User's voice data

[1450] Specific behavior:

[1451] The user speaks to the system through a microphone.

[1452] The terminal transmits the voice data to the server.

[1453] The server sends the voice data to a speech recognition API (e.g., Google Cloud Speech-to-Text) and converts it into text.

[1454] The server analyzes the converted text and estimates the sentiment.

[1455] Output: Estimated emotion data

[1456] Step 7: Tailor your message based on emotion

[1457] The server appropriately changes the information and guidance it provides based on the recognized user's emotions.

[1458] Input: Estimated emotion data

[1459] Specific behavior:

[1460] The server analyzes the emotion data to determine the user's emotional state.

[1461] The server adjusts the guidance content (e.g., gentler language, additional support information) depending on the emotional state.

[1462] Output: Adjusted guidance content

[1463] In this way, the system of the present invention is not only able to quickly provide the user with the necessary information, but also able to provide information that takes into consideration the user's feelings.

[1464] (Application example 1)

[1465] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server", and the headset type terminal 314 will be referred to as a "terminal".

[1466] Conventional systems for providing administrative procedures and auxiliary information have the problem that it is difficult for users to quickly and accurately obtain the information they need. In addition, they are unable to respond flexibly to the user's emotions and circumstances, which can result in a poor user experience. In particular, in brick-and-mortar stores, there is a need to grasp the emotions and needs of customers in real time and provide appropriate services, but current systems have difficulty in achieving this.

[1467] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1468] In this invention, the server includes a means for centrally reading information on procedures and various subsidies from each government agency, a means for accepting event input from the user, a means for providing guidance on procedures based on the input event, a means for recognizing the user's emotions, and a means for adjusting the guidance content based on the recognized emotions. This allows the user to quickly and accurately obtain the information he or she needs, and also enables flexible responses according to the user's emotions and circumstances. In particular, in physical stores, it becomes possible to grasp the emotions and needs of customers in real time and provide appropriate services.

[1469] "A means of centrally reading information on procedures and various subsidies from each administrative agency" refers to a system for centrally collecting information on procedures and subsidies provided by multiple administrative agencies and storing it in a database.

[1470] The "means for accepting event input from the user" is a system that provides an interface for the user to input life events that have occurred to him or her (such as birth, injury, illness, or death).

[1471] The "means for providing guidance regarding procedures based on an input event" is a system that searches for the necessary procedures and auxiliary information corresponding to the life event input by the user and provides them to the user.

[1472] "Means for recognizing user emotions" refers to a system that detects the user's emotional state using technologies such as voice recognition, facial expression recognition, and text analysis.

[1473] The "means for adjusting the guidance content based on the recognized emotion" is a system that appropriately changes the information and guidance content provided depending on the user's emotional state.

[1474] "Speech recognition" is a technology that converts a user's voice into text data and analyzes the content.

[1475] "Facial expression recognition" is a technology that captures a user's facial expressions using a camera or other device and infers emotions from those expressions.

[1476] "Text analysis" is a technology that analyzes text data entered by the user and understands its content and sentiment.

[1477] A "generative AI model" is a model that uses artificial intelligence to generate appropriate responses and guidance based on user input and emotions.

[1478] A "prompt" is an instruction given to a generative AI model that serves as the basis for generating a specific response or guidance.

[1479] A system for implementing the present invention has the following configuration.

[1480] System Configuration

[1481] 1. Hardware:

[1482] Smartphone or smart glasses: Used as a user interface.

[1483] Webcam: Built into the smart glasses and used to recognize the user's facial expressions.

[1484] Microphone: Built into the smart glasses and used to recognize the user's voice.

[1485] 2. Software:

[1486] Speech recognition engine: Uses Google Cloud Speech-to-Text to convert user speech into text.

[1487] Facial Expression Recognition Engine: Uses Microsoft Azure Face API to recognize emotions from the user's facial expressions.

[1488] Text Analysis Engine: Uses OpenAI GPT-4 to analyze the content and sentiment of text entered by the user.

[1489] Database management system: Uses MySQL to store procedures and supporting information for each government agency.

[1490] Processing flow

[1491] 1. User Interface:

[1492] Users access the system via a smartphone or smart glasses.

[1493] The user enters their own life events (e.g. birth, injury, illness, death, etc.).

[1494] 2. Data collection and analysis:

[1495] The speech recognition engine converts the user's speech into text.

[1496] The facial expression recognition engine analyzes the user's facial expressions through the webcam and recognizes their emotions.

[1497] The text analytics engine analyzes the user's input text to understand their sentiments and needs.

[1498] 3. Information provision:

[1499] The database management system is used to search for procedures and supporting information related to the user's life events.

[1500] Based on the recognized emotions, the generative AI model generates appropriate prompts and tailors the information provided to the user.

[1501] Examples

[1502] For example, if a user says, "I recently had a baby," the following processing occurs:

[1503] 1. Voice Recognition:

[1504] A speech recognition engine converts what the user says into text.

[1505] 2. Emotion recognition:

[1506] The facial expression recognition engine recognizes the emotion of joy from the user's facial expression.

[1507] The text analysis engine extracts the keyword "childbirth" and analyzes associated sentiment.

[1508] 3. Information provision:

[1509] Search the database for childbirth-related procedures and supporting information.

[1510] The generative AI model generates a prompt like this:

[1511] If a customer says, "I recently had a baby," suggest products and services related to childbirth. Recognize the emotion of joy from the customer's tone of voice and facial expression, and make appropriate suggestions.

[1512] The suggestions are displayed on the smart glasses display and guided to the user.

[1513] In this way, it becomes possible to respond flexibly to users' emotions and needs, improving the quality of customer service in physical stores.

[1514] The flow of the specific process in the application example 1 will be described with reference to FIG.

[1515] Step 1:

[1516] A user accesses the system through a smartphone or smart glasses. The user inputs his / her own life events (e.g. birth, injury, illness, death, etc.). The input event data is sent to the server.

[1517] Step 2:

[1518] The server uses a speech recognition engine (Google Cloud Speech-to-Text) to convert the user's voice into text. The input is voice data, and the output is text data. The server analyzes the voice data and generates the corresponding text data.

[1519] Step 3:

[1520] The server uses a facial expression recognition engine (Microsoft Azure Face API) to analyze facial expressions from the user's facial image captured through a webcam. The input is facial image data, and the output is emotion data. The facial image data is analyzed to estimate the user's emotional state.

[1521] Step 4:

[1522] The server uses a text analysis engine (OpenAI GPT-4) to analyze the text data entered by the user. The input is text data, and the output is emotion data and needs data. The text data is analyzed to understand the user's emotions and needs.

[1523] Step 5:

[1524] The server searches the database management system (MySQL) for procedures and auxiliary information related to the user's life events. The input is life event data, and the output is procedure information and auxiliary information. Based on the life event data, related information is retrieved from the database.

[1525] Step 6:

[1526] The server generates an appropriate prompt sentence using a generative AI model based on the recognized emotion. The input is emotion data and need data, and the output is a prompt sentence. Based on the emotion data and need data, a prompt sentence is generated to adjust the information provided to the user.

[1527] Step 7:

[1528] The server adjusts the information to be provided to the user based on the generated prompt text and displays it on the smart glasses display. The input is the prompt text and procedural information, and the output is the display information. Based on the prompt text and procedural information, the server provides the user with the most appropriate information.

[1529] Example 2

[1530] Next, a second embodiment of the second form will be described. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal".

[1531] In conventional systems, when users tried to obtain information on procedures and assistance related to life events, they were not provided with appropriate guidance based on their emotions, which often left users feeling anxious or confused. In addition, the system did not provide enough information based on individual needs, such as information on subsidies by region. This made it difficult for users to complete the necessary procedures and receive appropriate assistance.

[1532] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1533] In this invention, the server includes a means for centrally reading information on procedures and various types of assistance from each administrative agency, a means for accepting event input from the user, a means for providing guidance on procedures based on the input event, a means for analyzing the user's emotions, and a means for adjusting the content and method of guidance based on the emotion analysis result. This enables optimal guidance according to the user's emotions, allowing the user to reliably carry out the necessary procedures and receive appropriate assistance.

[1534] "Each administrative agency" refers to a public institution such as the national or local government, which is an organization that handles procedures and provides subsidies.

[1535] A "procedure" refers to a formal procedure or method required to accomplish a particular objective.

[1536] "Subsidy" refers to financial or material support provided to individuals or organizations that meet certain criteria.

[1537] "Means for centrally reading information" refers to a method or device for centrally collecting and storing necessary data from multiple sources.

[1538] "User" refers to any individual or entity that uses the System.

[1539] "Event input" refers to the act of a user inputting information about a specific life event (e.g. birth, injury, illness, death, etc.) into the system.

[1540] "Means for providing information" refers to a method or device for providing a user with necessary procedures or assistance information.

[1541] "Means for analyzing emotions" refers to a method or device for determining a user's emotional state based on the user's input and / or dialogue history.

[1542] "Means for adjusting the content and method of guidance based on the results of sentiment analysis" refers to a method or device for optimizing the content and method of providing information to a user based on the results of sentiment analysis.

[1543] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[1544] This invention is a system that provides information on necessary procedures and assistance when a user inputs information related to a life event. The system includes a means for centrally reading information on procedures and various assistance from various government agencies, a means for accepting event input from a user, a means for providing guidance on procedures based on the input event, a means for analyzing the user's emotions, and a means for adjusting the content and method of guidance based on the emotion analysis results.

[1545] Hardware and Software Used

[1546] The server uses a database (e.g., MySQL or PostgreSQL) to store and search information on procedures and assistance for each government agency. For sentiment analysis, it uses a sentiment engine (e.g., IBM Watson or Microsoft Azure sentiment analysis API). The terminal provides an interface for users to input information and uses the HTTPS protocol to communicate with the server.

[1547] Explanation of program processing

[1548] The user uses a terminal (e.g., a smartphone or a PC) to input information related to childbirth. Specifically, the user inputs the keyword "childbirth." The terminal sends the information the user input to the server. The server searches a database based on the received keyword "childbirth" to obtain information such as the deadline and place to submit the birth notification, how to apply for a lump-sum childbirth allowance, and subsidy information for each region.

[1549] At the same time, the server uses an emotion engine to analyze the user's emotions. For example, if the user enters "I'm worried because I don't know how to go about childbirth," the emotion engine will determine that the user is feeling anxious. The server generates information including more detailed explanations for the user based on the acquired information and the emotion analysis results. For example, it generates information such as, "Please submit a birth notification to your city, ward, town, or village office within 14 days of giving birth. To apply for a lump-sum birth allowance, submit an application to your health insurance association. If you live in Tokyo, there is also information on specific subsidies, so please check the city hall's website for details."

[1550] Finally, the server transmits the generated information to the terminal, which then displays it to the user, who can then reliably carry out the necessary procedures based on the displayed information.

[1551] Examples and prompts

[1552] As a concrete example, if the user inputs "birth", the server provides the following information:

[1553] The deadline for submitting a birth notification is within 14 days of the birth.

[1554] The application should be submitted to the city, town or village office.

[1555] To apply for the maternity benefit, you must submit an application to your health insurance association.

[1556] If the user lives in Tokyo, it also provides information on specific subsidies for Tokyo.

[1557] Example prompt:

[1558] If the user types "childbirth," provide information about procedures and subsidies related to childbirth. Specifically, include the deadline and place to submit the childbirth notification, how to apply for the childbirth lump-sum payment, differences in subsidies by region, etc. Also, adjust the content and method of guidance according to the user's feelings.

[1559] This system allows users to carry out the necessary procedures reliably and receive appropriate assistance. The introduction of an emotion engine makes it possible to provide optimal guidance according to the user's emotions.

[1560] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1561] Step 1:

[1562] The user enters the information.

[1563] The user uses a terminal (e.g., a smartphone or a PC) to input information related to childbirth. Specifically, the user inputs the keyword "childbirth." The input information is saved in an input field on the terminal.

[1564] Step 2:

[1565] The terminal transmits the input information to the server.

[1566] The terminal transmits the information input by the user to the server. At this time, the data is transmitted securely using the HTTPS protocol. The input data is the keyword "birth" and is transmitted to the server.

[1567] Step 3:

[1568] The server searches the database.

[1569] The server searches the database based on the received keyword "birth." The database contains information such as the deadline for submitting birth notifications, where to submit them, how to apply for a lump-sum birth benefit, and subsidy information by region. The server uses an SQL query to retrieve the necessary information. The output is information on the applicable procedures and subsidies.

[1570] Step 4:

[1571] The server analyzes the user's emotions using an emotion engine.

[1572] The server uses an emotion engine to analyze the user's emotions based on the user's input and past dialogue history. For example, the emotion engine determines that the user is feeling anxious based on the input, "I'm anxious because I don't know how to handle childbirth." The input is the user's text data, and the output is the result of emotion analysis.

[1573] Step 5:

[1574] The server generates information based on the search results and sentiment analysis results.

[1575] The server generates information to provide to the user based on the information retrieved from the database and the analysis results of the emotion engine. For example, if it is determined that the user is confused, the server generates information containing a more detailed explanation. The input is the information in the database and the emotion analysis results, and the output is optimized information to provide to the user.

[1576] Step 6:

[1577] The server transmits the generated information to the terminal.

[1578] The server sends the generated information to the terminal. At this time, the data is sent securely using the HTTPS protocol. The input is the generated information, and the output is the data sent to the terminal.

[1579] Step 7:

[1580] The terminal displays the information to the user.

[1581] The terminal displays the information received from the server to the user. Specifically, it displays the deadline for submitting birth notification and where to submit it, how to apply for a lump-sum birth allowance, subsidy information by region, etc. The input is the information from the server, and the output is the information displayed to the user.

[1582] (Application example 2)

[1583] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server", and the headset type terminal 314 will be referred to as a "terminal".

[1584] In conventional systems, when users were trying to obtain procedures or supplementary information related to a particular event, they were often left feeling anxious or confused because appropriate guidance based on emotions was not provided. In addition, information related to payment procedures and information on regional subsidies and discounts were not provided in a centralized manner, making it difficult for users to efficiently obtain the information they needed. This reduced user convenience and could lead to delays in procedures and misunderstandings.

[1585] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1586] In this invention, the server includes a means for centrally reading information on procedures and various subsidies from each government agency, a means for accepting an event input from a user, a means for providing guidance on the procedures based on the input event, a means for recognizing the user's emotions, a means for adjusting the content and method of the guidance based on the recognized emotions, a means for providing information related to payment procedures, and a means for providing information on regional subsidies and discounts. This allows optimal guidance to be provided according to the user's emotions, and makes it possible to centrally obtain information related to payment procedures and information on regional subsidies and discounts.

[1587] "Each administrative agency" refers to a public institution such as the national or local government, which is an organization that carries out specific procedures or provides subsidies.

[1588] A "procedure" refers to a formal step or process required to achieve a particular objective.

[1589] "Assistance" refers to financial or material assistance provided in support of a particular purpose or activity.

[1590] "Means of centrally loading information" refers to the function of centrally collecting necessary data from multiple sources and making it available within the system.

[1591] "User" refers to any individual or entity that uses the System.

[1592] "Event input" refers to the act of a user inputting a specific occurrence or situation into the system.

[1593] "Means of providing guidance" refers to the function of explaining necessary information and procedures to users.

[1594] "Means of recognizing emotions" refers to the ability to analyze and identify emotions from user input and actions.

[1595] "Means for adjusting the content and method of guidance" refers to the ability to change the information provided and the way it is conveyed based on recognized emotions.

[1596] "Payment Process" refers to the formal procedure for paying for a particular service or product.

[1597] "Regional subsidy and discount information" refers to information about financial assistance or price discounts available to users who live in a particular region.

[1598] A system for carrying out the present invention has the following configuration: A server includes means for centrally reading information on procedures and various subsidies of each government agency, means for accepting event input from a user, means for providing guidance on procedures based on the input event, means for recognizing the user's emotions, means for adjusting the content and method of guidance based on the recognized emotions, means for providing information related to payment procedures, and means for providing information on local subsidies and discounts.

[1599] Hardware and Software Used

[1600] Hardware: Servers, user devices (smartphones, tablets, PCs)

[1601] Software: emotion recognition libraries (e.g. EmotionEngine), databases (e.g. PaymentDatabase), generative AI models

[1602] Data processing and calculation

[1603] emotion recognition

[1604] The text data entered by the user through the terminal is sent to the server. The server uses an emotion recognition library (EmotionEngine) to analyze and identify the user's emotions. This emotion data is used to adjust subsequent guidance.

[1605] Information Search

[1606] The server retrieves relevant transaction and subsidy information from a database (PaymentDatabase) based on the user's location and event input. This information forms the basis of the guidance provided to the user.

[1607] Guide Adjustment

[1608] The server then adapts the content and manner of guidance based on the perceived emotion: for example, if the user is perceived to be confused, it will provide a detailed explanation, and if the user is angry or frustrated, it will provide polite guidance.

[1609] Examples

[1610] If a user types "I don't know how to pay my utility bills," the server uses an emotion recognition library to recognize the user's emotions. For example, if the server detects that the user is confused, it will respond with "Don't worry. Here's how to pay your utility bills: [More info]."

[1611] Examples of prompt statements

[1612] If a user types "I don't know how to pay my utility bills," use an emotion recognition engine to recognize the user's emotion and provide appropriate guidance. If the user is confused, provide more information.

[1613] In this way, optimal guidance based on the user's emotions can be provided, and information related to payment procedures and local subsidies and discounts can be obtained in a centralized manner.

[1614] The flow of the specific process in the application example 2 will be described with reference to FIG.

[1615] Step 1:

[1616] The user inputs events through the terminal.

[1617] Input: User types, "I don't know how to pay my utility bill."

[1618] Output: The entered text data is sent to the server.

[1619] Step 2:

[1620] The server uses an emotion recognition library (EmotionEngine) to analyze the user's emotions.

[1621] Input: Text data submitted by the user.

[1622] Data processing: The text data is passed to an emotion recognition library to analyze emotions.

[1623] Output: Parsed emotion data (e.g. confusion, anxiety, anger, etc.).

[1624] Step 3:

[1625] The server searches for relevant procedural and subsidy information from a database (PaymentDatabase) based on the user's regional information and event input.

[1626] Input: User location information and event input (e.g. "how do I pay my utility bill").

[1627] Data retrieval: Searching for relevant information from databases.

[1628] Output: Procedural and grant information (e.g. payment method, submission deadline, grant availability, etc.).

[1629] Step 4:

[1630] The server adjusts the content and method of guidance based on the recognized emotion.

[1631] Input: Parsed emotion data and retrieved procedural information.

[1632] Data processing: Adjust the content and method of guidance based on emotion data.

[1633] Output: Tailored informational message (e.g. "Don't worry, here's how to pay your utility bill: [More info]").

[1634] Step 5:

[1635] The server transmits the adjusted announcement message to the user terminal.

[1636] Input: Adjusted informational message.

[1637] Output: An informational message that is displayed on the user's terminal.

[1638] Step 6:

[1639] The user checks the guidance message via the terminal and carries out the necessary procedures.

[1640] Input: The informational message displayed on the user's terminal.

[1641] Output: The action the user takes to complete the transaction.

[1642] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input for the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1643] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by making a neural network perform deep learning. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating a voice, text data indicating a text, and image data indicating an image is input. The data generation model 58 performs inference on the input inference data according to the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1644] Another example of generative AI is Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) are mentioned.

[1645] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1646] [Fourth embodiment]

[1647] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1648] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1649] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a wide area network (WAN) and / or a local area network (LAN).

[1650] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. In addition, the microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1651] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs the voice according to instructions from the processor 46.

[1652] Camera 42 is a small digital camera equipped with an optical system including a lens, an aperture, and a shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (e.g., an imaging range defined by an angle of view equivalent to the width of the field of vision of an average healthy person).

[1653] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for transmitting and receiving various types of information between the processor 46 and the processor 28 via the network 54. The transmission and reception of various types of information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is performed in a secure state.

[1654] The control target 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, legs, etc. The posture and behavior of the robot 414 are controlled by controlling the motors of the arms, hands, legs, etc. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1655] FIG. 8 shows an example of the main functions of the data processing device 12 and the robot 414.

[1656] 8, in the data processing device 12, a specific process is performed by a processor 28. In the storage 32, a specific process program 56 is stored.

[1657] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32, and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1658] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1659] In the robot 414, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50, and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1660] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[1661] "Example 1"

[1662] The system of the present invention is equipped with a database that centrally reads information on procedures and various types of assistance from each government agency. This database can collect and update information from government agency websites and official documents. It also has an interface that accepts event input from users. This interface is provided in the form of a website or application, and allows users to input events that have occurred to them (birth, injury, illness, death, etc.). It then has the function of searching the database for information on necessary procedures and assistance based on the input event, and providing guidance to the user.

[1663] "Example 2"

[1664] As a specific example, when a user enters that they have given birth, the system searches the database for information on procedures and subsidies related to childbirth. For example, it provides information such as the deadline for submitting a birth notification, where to submit it, and how to apply for a lump-sum childbirth allowance. It also provides information on the area where the user lives, taking into account differences in subsidies by region. This allows users to be sure to complete the necessary procedures and receive assistance.

[1665] The process flow of each embodiment will be described below.

[1666] "Example 1"

[1667] Step 1: The system collects procedural and subsidy information from each government agency's website, official documents, etc. and stores it in a database.

[1668] Step 2: The user enters events that have occurred to them (birth, injury, illness, death, etc.) through an interface such as a website or application.

[1669] Step 3: Based on the entered event, the system searches the database for the necessary procedures and auxiliary information.

[1670] Step 4: The system guides the user through the search results, allowing them to take the necessary steps and receive assistance.

[1671] "Example 2"

[1672] Step 1: If the user enters birth, the system searches the database for information on procedures and ancillary care related to birth.

[1673] Step 2: The system will provide information such as the deadline for submitting the birth notification, where to submit it, and how to apply for the maternity benefit.

[1674] Step 3: The system also provides information about the area where the user lives, taking into account differences in subsidies depending on the region.

[1675] Step 4: This allows the user to ensure they take the necessary steps and receive assistance.

[1676] Example 1

[1677] Next, a description will be given of Example 1 of the embodiment 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal".

[1678] In conventional systems, users had to collect information on procedures and assistance from each government agency individually, making it difficult for users to quickly obtain the information they needed. In addition, there was a lack of a means to centrally provide information on procedures and assistance according to life events, increasing the time and effort required for users to carry out appropriate procedures. Furthermore, information had to be updated manually, making it difficult to provide the latest information.

[1679] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1680] In this invention, the server includes a means for centrally reading information on procedures and various assistance from each administrative agency, a means for accepting event input from a user, a means for providing guidance on procedures based on the input event, a means for storing collected information in a database and periodically updating it, a means for providing an interface accessible to the user, a means for searching the database based on the input event information, and a means for notifying the user of the search results. This allows the user to quickly obtain the latest information on procedures and assistance from a centralized location, and to efficiently carry out appropriate procedures.

[1681] "Each administrative agency" refers to a public institution such as the national government or a local government, which is an organization that provides information on procedures and subsidies.

[1682] A "procedure" refers to a formal procedure or method required to accomplish a particular objective.

[1683] "Subsidy" refers to financial or material support provided to individuals or organizations that meet certain criteria.

[1684] "Means of centrally loading information" refers to methods and technologies for centrally collecting information on procedures and subsidies from each administrative agency and storing it in a database.

[1685] "User" refers to an individual or organization that uses this system to obtain information and carry out procedures.

[1686] "Means for accepting event input" refers to an interface or method for a user to input life events that have occurred to them (such as birth, injury, illness, or death).

[1687] "Guidance means" refers to methods or technologies for providing relevant procedural or assistance information based on event information entered by a user.

[1688] A "database" refers to an information management system that stores collected information in an organized manner and allows it to be searched and updated.

[1689] "Interface" refers to the screens and applications through which a user accesses a system and enters or retrieves information.

[1690] "Search means" refers to methods and technologies for extracting relevant information from a database based on event information entered by a user.

[1691] "Means of presenting search results" refers to methods and technologies for presenting searched information to users in an easy-to-understand manner.

[1692] This invention is a system that centrally collects information on procedures and various subsidies from various government agencies and provides information on necessary procedures and subsidies based on event information entered by a user. A specific embodiment of this system will be described below.

[1693] Information collection and database updates

[1694] The server collects procedural and auxiliary information from the websites and official documents of each government agency. This collection is done using web scraping tools (e.g. Beautiful Soup and Scrapy) and APIs. The collected information is stored in a database such as MySQL or PostgreSQL. The server periodically runs the crawler to update the information.

[1695] Providing a user interface

[1696] The server provides an interface where users can input event information, either in the form of a web interface using React or Vue.js, or a mobile application using Flutter, and the device displays these interfaces when accessed by the user.

[1697] Accepting event input

[1698] The user inputs events that have occurred to them (birth, injury, illness, death, etc.) through the provided interface. For example, if the user inputs the event "birth," they can enter the expected date of birth and hospital information. The terminal sends the input event information to the server. The HTTPS protocol is used for transmission to ensure data security.

[1699] Search and find the information you need

[1700] The server searches the database using SQL queries and Elasticsearch based on the event information entered by the user. For example, it searches for information on procedures and subsidies related to "childbirth." The server then presents the search results to the user. For example, it displays information on procedures related to childbirth (submitting a birth notification, applying for child allowance, etc.) and subsidies (lump-sum childbirth and child care grants, etc.).

[1701] Examples

[1702] For example, if a user enters the event "birth," the server searches the database for information on birth-related procedures (submitting a birth notification, applying for child allowance, etc.) and subsidies (lump-sum childbirth and child care grants, etc.) and provides guidance to the user.

[1703] Examples of prompt statements

[1704] Examples of prompts to be input to a generative AI model include the following:

[1705] "When a user inputs the event of childbirth, please explain the system process that guides them to relevant procedures and support information."

[1706] By inputting this prompt sentence into a generative AI model, a sentence is generated that explains the specific processing content of the system in natural language.

[1707] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1708] Step 1: Collect information and update the database

[1709] The server collects procedural and auxiliary information from the websites and official documents of each government agency. Specifically, the information is obtained using web scraping tools (e.g. Beautiful Soup and Scrapy) and APIs. The collected information is stored in a database such as MySQL or PostgreSQL. The server periodically runs the crawler to update the information.

[1710] Input: Websites and official documents of each government agency

[1711] Output: Procedure and auxiliary information stored in a database

[1712] Step 2: Providing a User Interface

[1713] The server provides an interface that allows users to input event information. Specifically, it develops and provides a web interface using React or Vue.js, or a mobile application using Flutter. The terminal displays these interfaces when the user accesses them.

[1714] Input: User access

[1715] Output: Event information input screen

[1716] Step 3: Accepting event input

[1717] The user inputs events that have occurred to them (birth, injury, illness, death, etc.) through the provided interface. For example, if the user inputs the event "birth," they can enter the expected date of birth and hospital information. The terminal sends the input event information to the server. The HTTPS protocol is used for transmission to ensure data security.

[1718] Input: User-entered event information

[1719] Output: Event information sent to the server

[1720] Step 4: Finding the information you need

[1721] The server uses SQL queries and Elasticsearch to search the database based on the event information entered by the user, for example, to search for information about procedures and assistance related to "birth."

[1722] Input: User-entered event information

[1723] Output: Procedures and supporting information as search results

[1724] Step 5: Navigate through search results

[1725] The server informs the user of the search results. Specifically, it uses methods and technologies to present the searched information to the user in an easy-to-understand manner. For example, it displays information on procedures related to childbirth (submitting a birth notification, applying for child allowance, etc.) and subsidies (lump-sum childbirth and childcare grants, etc.).

[1726] Input: Procedure and auxiliary information as search results

[1727] Output: Information about the procedure or assistance provided to the user

[1728] Step 6: Update your information

[1729] The server periodically runs a crawler to keep the information in the database up to date, ensuring that the information provided to users is always up to date.

[1730] Input: Latest information from each government agency

[1731] Output: Updated database

[1732] (Application example 1)

[1733] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal".

[1734] In the conventional system, it was difficult to centrally manage the procedures and supplementary information of each government agency, making it difficult for users to quickly obtain the information they needed. In addition, there was a lack of means to provide appropriate procedures and supplementary information in real time for events occurring in physical stores, which reduced user convenience. This caused problems such as users being unable to use procedures and supplementary information appropriately.

[1735] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1736] In this invention, the server includes a means for centrally reading information on procedures and various assistance from each government agency, a means for accepting event input from a user, a means for providing information on procedures based on the input event, a means for inputting an event that occurred in a real store by the user, and a means for providing information on procedures and assistance in real time based on the input event. This enables a user to quickly obtain necessary procedure and assistance information for an event that occurred in a real store and take appropriate action.

[1737] "Each administrative agency" refers to a public institution such as the national or local government, which is an organization that handles procedures and provides subsidies.

[1738] A "procedure" refers to a formal procedure or method required to accomplish a particular objective.

[1739] "Assistance" refers to financial or material support provided to achieve a specific purpose.

[1740] "Means for centrally reading information" refers to a method or device for centrally collecting and managing data from multiple sources.

[1741] "User" refers to any individual or entity that uses the System.

[1742] "Means for accepting event input" refers to a method or device that allows a user to input an occurrence or situation into the system.

[1743] "Means for providing information" refers to a method or device for providing the user with the necessary information.

[1744] "Brick and mortar store" refers to a commercial establishment that exists in a physical location and offers goods and services.

[1745] "Real-time" refers to immediate processing or response without delay.

[1746] "Procedure or assistance information" refers to detailed data or instructions relating to a particular procedure or assistance.

[1747] A system for implementing this invention includes means for centrally reading information on procedures and various assistance from each government agency, means for accepting event input from a user, means for providing guidance on procedures based on the input events, means for inputting events that occur in a physical store by a user, and means for providing information on procedures and assistance in real time based on the input events.

[1748] System Programming

[1749] The server collects procedures and supporting information from the websites and official documents of each government agency and stores it in a database. When a user inputs an event using a smartphone or smart glasses, the information is sent to the server. The server searches the database for related procedures and supporting information based on the input event and provides the user with guidance in real time.

[1750] Hardware and software used

[1751] Hardware: Smartphones, smart glasses

[1752] Software: Flask (a Python web framework), requests (a Python library for sending HTTP requests)

[1753] Data processing and calculation

[1754] 1. Event input: The user inputs an event via a smartphone or smart glasses.

[1755] 2. Database integration: Based on the entered event information, the server sends a request to the database API.

[1756] 3. Information retrieval: Retrieve relevant procedure and assistance information from the database.

[1757] 4. Real-time guidance: The acquired information is provided to the user in real time.

[1758] Examples

[1759] When a user enters "return product" on their smartphone, the server retrieves information about the return procedure from the database and provides it to the user, allowing the user to quickly complete the necessary procedures.

[1760] Examples of prompt statements

[1761] The user has entered "return product" on their smartphone. Retrieve information about the return procedure from the database and guide the user.

[1762] In this way, a system can be realized that improves the user experience in a physical store.

[1763] The flow of the specific process in the application example 1 will be described with reference to FIG.

[1764] Step 1:

[1765] Users input events using a smartphone or smart glasses.

[1766] Input: The event the user has occurred (e.g. "returned product")

[1767] Output: Event information is sent from the device to the server.

[1768] Specific operation: The user opens the smartphone application, enters an event such as "product return" on the event input screen, and presses the send button.

[1769] Step 2:

[1770] The server analyzes the received event information.

[1771] Input: Event information sent from the device

[1772] Output: Parsed event information

[1773] Specific operation: The server analyzes the received event information and identifies the type of event (e.g., "product return").

[1774] Step 3:

[1775] The server sends a request to the database API to retrieve relevant procedures and auxiliary information.

[1776] Input: Parsed event information

[1777] Output: Procedures and auxiliary information retrieved from the database

[1778] Specific operation: The server requests procedures and auxiliary information related to "product returns" from the database API and retrieves the relevant information from the database.

[1779] Step 4:

[1780] The server provides the user with real-time information on procedures and auxiliary information obtained.

[1781] Input: Procedures and supporting information retrieved from the database

[1782] Output: Instructions and support information provided to the user

[1783] Specific operation: The server sends the acquired information to a smartphone or smart glasses application, and displays the procedure details and auxiliary information to the user.

[1784] Step 5:

[1785] The user carries out the procedure based on the information provided.

[1786] Input: Procedures and auxiliary information provided by the server

[1787] Output: Specific steps that the user will take

[1788] Specific actions: The user checks the details of the procedure displayed on their smartphone or smart glasses and carries out the necessary procedures (e.g., going to the returns counter, preparing the necessary documents).

[1789] Example 2

[1790] Next, a second embodiment of the second embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal".

[1791] In the conventional system, users had to search multiple government agencies and information sources individually to obtain procedures and supplementary information related to life events, which was time-consuming and laborious. In addition, because supplementary information differs by region, it was difficult for users to obtain information appropriate to their own area of ​​residence.

[1792] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1793] In this invention, the server includes a means for centrally reading information on procedures and various assistance from each administrative agency, a means for accepting an event input from a user, a means for providing procedure information based on the input event, a means for accepting information on the user's residential area, a means for providing assistance information for each area based on the accepted residential area information, a means for searching a database to obtain related information, and a means for providing the obtained information to the user. This allows the user to easily obtain procedures and assistance information related to life events through one system, and assistance information for each area is also provided appropriately.

[1794] "Each administrative agency" refers to a public agency such as the national or local government, which is responsible for providing information on procedures and subsidies.

[1795] A "procedure" refers to a formal procedure or method required to accomplish a particular objective.

[1796] "Subsidy" refers to financial or material support provided to individuals or organizations that meet certain criteria.

[1797] "Means for centrally reading information" refers to a method or device for centrally collecting necessary data from multiple sources.

[1798] "User" refers to an individual or entity that uses the System to input information and obtain required procedures and supporting information.

[1799] "Event input" refers to the act of a user inputting information about a specific life event (e.g. birth, injury, illness, death, etc.) into the system.

[1800] "Means for providing guidance" refers to a method or device for providing appropriate procedures or auxiliary information based on information input by a user.

[1801] "Residence area information" refers to information about the area where the user currently lives, and is used to provide auxiliary information for each area.

[1802] "Database" refers to a system for efficiently storing, retrieving, and managing information.

[1803] "Means for searching and obtaining relevant information" refers to a method or device for searching information in a database and obtaining the data required by the user.

[1804] "Means for providing" refers to a method or device for displaying the acquired information in a format that is easy for the user to understand.

[1805] The present invention provides a system that allows a user to easily obtain procedures and auxiliary information related to a life event. A specific embodiment of this system will be described below.

[1806] System Configuration

[1807] This system is composed of three main elements: a server, a terminal, and a user. The server includes a means for centrally reading information on procedures and various assistance from each government agency, a means for accepting event input from the user, a means for providing procedure guidance based on the input event, a means for accepting information on the user's residential area, a means for providing assistance information for each area based on the accepted residential area information, a means for searching a database to obtain related information, and a means for providing the obtained information to the user.

[1808] Hardware and Software Used

[1809] The server uses MySQL as a database management system and executes programs to process information entered by users. The terminal is a device such as a PC or smartphone that provides an interface for users to enter information. Users use the terminal to access the system and enter the required information.

[1810] Data processing and calculation

[1811] The server takes the information entered by the user and searches the MySQL database to retrieve any relevant procedures or auxiliary information, by executing SQL queries such as:

[1812] sql

[1813] SELECT FROM procedures WHERE keyword = 'birth' AND region = 'Tokyo';

[1814] The server organizes the acquired information and provides it to the user in an easy-to-understand format.

[1815] Examples

[1816] For example, if a user enters "birth" and selects "Tokyo" as their place of residence, the server provides the following information:

[1817] Deadline for submitting birth notification: Within 14 days after birth

[1818] Submit to: City / ward / town / village office

[1819] How to apply for maternity benefits: Apply to your health insurance association

[1820] Tokyo Metropolitan Government Subsidy Information: In addition to the lump-sum childbirth allowance, Tokyo Metropolitan Government provides additional subsidies if certain conditions are met.

[1821] Examples of prompt statements

[1822] If a user enters "birth" and selects "Tokyo" as their area of ​​residence, please provide information on the deadline and place to submit the birth notification, how to apply for the lump-sum birth allowance, and information on Tokyo's subsidies.

[1823] This system allows users to easily obtain procedures and supplementary information related to life events through a single interface. In addition, supplementary information for each region is provided appropriately, so users can obtain information appropriate for their own area.

[1824] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1825] Step 1:

[1826] The user enters the information.

[1827] The user opens a browser on the terminal, accesses the web page of the system, enters information related to the birth into the input form, and clicks the "Search" button.

[1828] Input: Information related to birth (e.g. birth, place of residence)

[1829] Output: User input is sent to the server

[1830] Step 2:

[1831] The server receives the input information.

[1832] The server receives the information entered by the user, which includes birth-related keywords and the area of ​​residence.

[1833] Input: User input information

[1834] Output: The database is ready to be searched based on the input information received.

[1835] Step 3:

[1836] The server searches the database.

[1837] The server connects to a MySQL database and executes a query based on the information entered by the user, for example executing a SQL query like this:

[1838] sql

[1839] SELECT FROM procedures WHERE keyword = 'birth' AND region = 'Tokyo';

[1840] Input: User input information (keywords and area of ​​residence)

[1841] Output: Relevant information retrieved from the database

[1842] Step 4:

[1843] The server processes the search results.

[1844] The server processes the information retrieved from the database, such as the deadline for submitting birth notification, where to submit it, how to apply for a lump-sum birth allowance, and information on subsidies by region.

[1845] Input: Relevant information retrieved from the database

[1846] Output: Organized information (e.g. deadline for submitting birth notification, where to submit it, how to apply for childbirth lump sum payment, subsidy information by region)

[1847] Step 5:

[1848] The server provides the information to the user.

[1849] The server then presents the organized information to the user, typically in the form of a web page that displays information such as:

[1850] Deadline for submitting birth notification: Within 14 days after birth

[1851] Submit to: City / ward / town / village office

[1852] How to apply for maternity benefits: Apply to your health insurance association

[1853] Tokyo Metropolitan Government Subsidy Information: In addition to the lump-sum childbirth allowance, Tokyo Metropolitan Government provides additional subsidies if certain conditions are met.

[1854] Input: Organized information

[1855] Output: Information provided to the user

[1856] In this way, the user can be sure to take the necessary steps and receive appropriate assistance.

[1857] (Application example 2)

[1858] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal".

[1859] When users face life events such as childbirth, it is difficult for them to quickly and accurately obtain information on necessary procedures and subsidies. In addition, there is a lack of a centralized means of providing information on subsidies and related services by region, making it difficult for users to receive appropriate support.

[1860] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1861] In this invention, the server includes a means for centrally reading information on procedures and various subsidies of each government agency, a means for accepting event input from a user, a means for guiding the procedures based on the input event, a means for providing subsidy information for each region based on the user's residential area, and a means for displaying related services based on the user's input. This allows the user to quickly and accurately obtain information on procedures and subsidies related to life events such as childbirth, and to centrally receive information on subsidies for each region and information on related services.

[1862] "A means of centrally reading information on procedures and various subsidies from each administrative agency" is a function for centrally collecting information on procedures and subsidies provided by multiple administrative agencies and storing it in a database.

[1863] The "means for accepting event input from a user" refers to an interface that enables a user to input a specific life event (e.g., birth, injury, illness, death, etc.) into the system.

[1864] The "means for providing guidance regarding procedures based on an input event" is a function for searching for procedure information related to a life event input by the user and providing it to the user.

[1865] The "means for providing regional subsidy information based on the user's region of residence" is a function for searching for subsidy information specific to that region based on the region of residence input by the user and providing it to the user.

[1866] "Means for displaying related services based on user input" refers to a function for searching for related services (e.g. obstetricians, baby goods stores, childcare support centers, etc.) based on information entered by the user and displaying them to the user.

[1867] The system for carrying out the present invention includes a server, a user terminal, and a database. The server includes a means for centrally reading information on procedures and various subsidies of each government agency, a means for accepting event input from a user, a means for providing procedure information based on the input event, a means for providing subsidy information by region based on the user's residential area, and a means for displaying related services based on the user's input.

[1868] Explanation of program processing

[1869] 1. A way to centrally read information on procedures and various subsidies from various government agencies

[1870] The server periodically collects information on procedures and assistance provided by each government agency and stores it in a database, so that users can always receive the latest information.

[1871] 2. A means of accepting event input from the user

[1872] Through a user terminal (such as a smartphone or smart glasses), the user inputs a specific life event (e.g., childbirth). The input interface is designed to be intuitive and easy to use.

[1873] 3. A means of providing procedural guidance based on entered events

[1874] The server searches the database for relevant procedural information based on the life event entered by the user and provides it to the user. For example, in the case of childbirth, information such as the deadline for submitting a birth notification, where to submit it, and how to apply for a lump-sum birth benefit are displayed.

[1875] 4. A way to provide local grant information based on where a user lives

[1876] Based on the user's input of the residential area information, the server searches the database for subsidy information specific to that area and provides it to the user, allowing the user to easily check the subsidies available in his / her area.

[1877] 5. How to display relevant services based on user input

[1878] The server searches for related services (e.g. obstetricians, baby goods stores, childcare support centers, etc.) based on the information entered by the user and displays them to the user, allowing the user to quickly find the services they need.

[1879] Examples

[1880] For example, if a user enters "birth" and "Tokyo," the server provides the following information:

[1881] Deadline and place to submit birth notification

[1882] How to apply for maternity benefits

[1883] Tokyo-specific subsidy information

[1884] Information on nearby obstetrics and gynecology clinics, baby goods stores, and childcare support centers

[1885] Example prompts to be input to the generative AI model

[1886] "Create an application that provides information on procedures and subsidies related to childbirth when a user enters their expected delivery date and area of ​​residence. For example, it displays the deadline and place to submit the birth notification, how to apply for the lump-sum childbirth allowance, and subsidy information by area."

[1887] In this way, users can quickly and accurately obtain the information they need and take the appropriate steps.

[1888] The flow of the specific process in the application example 2 will be described with reference to FIG.

[1889] Step 1:

[1890] The server periodically collects information on procedures and assistance provided by each government agency and stores it in a database. Specifically, it uses APIs and web scraping technology to obtain information from the websites and databases of each government agency. The input is data from the websites and databases of each government agency, and the output is information on procedures and assistance stored in the server's database.

[1891] Step 2:

[1892] A user inputs a specific life event (e.g., childbirth) using a terminal such as a smartphone or smart glasses. The input interface is designed to be intuitive and easy to use. The input is the life event information that the user enters into the terminal, and the output is the life event information sent to the server.

[1893] Step 3:

[1894] The server searches the database for relevant procedure information based on the life event input by the user and provides it to the user. Specifically, it uses an SQL query to search the database and obtains the relevant procedure information. The input is the life event information input by the user, and the output is the procedure information provided to the user.

[1895] Step 4:

[1896] The user inputs the residential area information into the terminal. The input interface is designed to allow the user to easily input the area information. The input is the residential area information that the user inputs into the terminal, and the output is the residential area information that is sent to the server.

[1897] Step 5:

[1898] The server searches the database for subsidy information specific to the region based on the residential area information entered by the user, and provides it to the user. Specifically, it uses an SQL query to search the database and obtains the...

Claims

1. A first means for receiving input information including keywords related to childbirth and a residential area input by a user; a second means for generating a first prompt sentence for outputting a procedure and auxiliary information related to the user's life event based on the input information; A third means for inputting the generated first prompt sentence into a generative AI model to generate procedures and auxiliary information related to the user's life event; A fourth means for providing the user with the generated procedure and auxiliary information related to the user's life event; A system including:

2. a fifth means for estimating the emotion of the user from the tone, strength and rate of the user's voice using an emotion engine; A sixth means for changing the content or manner of information to be provided to the user based on the emotion of the user; The system of claim 1 , comprising:

3. The sixth means provides a detailed explanation when the user's emotion is recognized as being confused, and provides guidance in polite language when the user's emotion is recognized as being angry or frustrated. The system of claim 2.

Images