system

Abstract

We provide the system. [Solution] A means of acquiring basic user information and storing it in a recording device, A means for generating a timeline of necessary tasks based on accumulated information, A means of notifying the user of the start of work and providing detailed instructions according to the generated timeline, A means of advising on identifying the materials needed for the work and obtaining them through digital means, A means of presenting a plan for asset inheritance based on family structure and will documents, A means of intuitively displaying procedural information to the user using visual information devices. A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] With the progress of an aging society, there are various procedures required at the time of a family member's death, and there is a problem that it is a heavy burden for the bereaved family. In particular, the procedures are complicated, and it is difficult to proceed smoothly due to lack of knowledge and time constraints, and it is necessary to solve the problem of increasing mental burden. In addition, since it is also difficult to prepare and organize the documents required for these procedures, a system that comprehensively supports them is required.

Means for Solving the Problems

[0005] The present invention solves the above problems by providing a system that includes means for collecting user information and registering it in a database, means for generating a schedule of necessary procedures based on the registered information, means for notifying the user of the start of the procedures and guiding them through the details according to the generated schedule, means for identifying the documents necessary for the procedures and assisting in obtaining them online, and means for proposing an inheritance plan based on family structure and will information. With this system, users can receive support to proceed smoothly with the procedures and reduce the burden associated with them.

[0006] "Users" refer to individuals who use the system to carry out end-of-life planning or related procedures.

[0007] "Information" refers to basic data about users and data about their preferences.

[0008] A "database" is a place where information is stored systematically and kept in a format that can be accessed as needed.

[0009] "Procedures" refers to the various official procedures and activities required in the event of a family member's death.

[0010] A "schedule" is a timetable set up to carry out procedures and other tasks in a planned manner.

[0011] "Notification" refers to the act of communicating information to users, such as the start date or deadline of a procedure.

[0012] A "guide" refers to providing specific methods and steps for carrying out a procedure.

[0013] "Documents" refer to official documents necessary for carrying out procedures.

[0014] "Obtaining online" refers to the process of obtaining necessary documents using the internet.

[0015] "Family structure" refers to information about the user's family members.

[0016] "The testamentary information" refers to information regarding the legally effective declarations of intention left by users or their families.

[0017] "The inheritance plan" refers to specific plans and guidelines regarding the distribution of property.

Brief Explanation of Drawings

[0018] [Figure 1] It is a conceptual diagram showing an example of the configuration of the data processing system according to the first embodiment. [Figure 2] It is a conceptual diagram showing an example of the main functions of the data processing device and the smart device according to the first embodiment. [Figure 3] It is a conceptual diagram showing an example of the configuration of the data processing system according to the second embodiment. [Figure 4] It is a conceptual diagram showing an example of the main functions of the data processing device and the smart glasses according to the second embodiment. [Figure 5] It is a conceptual diagram showing an example of the configuration of the data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of the data processing device and the headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of the data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of the data processing device and the robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which a plurality of emotions are mapped. [Figure 10] It shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13]It is a sequence diagram showing the processing flow of the data processing system in Embodiment 2 when the emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when the emotion engine is combined.

Mode for Carrying Out the Invention

[0019] Hereinafter, an example of an embodiment of the system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0020] First, the language used in the following description will be explained.

[0021] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0022] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0023] In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0024] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0025] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0026] [First Embodiment]

[0027] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0028] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0029] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0030] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0031] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0032] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0033] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0034] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0035] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0036] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0037] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0038] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0039] This invention is a system designed to facilitate end-of-life planning and procedures following the death of a family member. This system functions through interaction between a server, a terminal, and the user.

[0040] First, the server receives basic information and requested data provided by the user and registers it in the database. This makes the basic data necessary for subsequent procedures available.

[0041] Next, the server automatically generates a schedule of necessary procedures based on the registered data. For example, when a family member dies, the schedule would include filing a death certificate, arranging the funeral, and settling the estate. This schedule is designed to display a list of procedures that the user must complete in chronological order.

[0042] The generated schedule and procedural details will be communicated to the user via the device. The notifications are designed to be timely and support the user in following the procedures without forgetting. For example, if the user feels unsure of what to do next, the device will provide specific guidance such as, "The next step is to submit the death certificate at the city hall. The required documents are XX."

[0043] Furthermore, many procedures require multiple documents. The server has a mechanism that automatically identifies the necessary documents related to a particular procedure and assists in obtaining them online. This frees users from the cumbersome task of collecting documents.

[0044] Furthermore, based on family structure and existing wills, the AI ​​agent proposes an appropriate inheritance plan. This plan is displayed visually and clearly on the device, designed to allow users to proceed with inheritance procedures smoothly.

[0045] As a concrete example, when a user with a complex family structure uses the system, inheritance planning that would normally require consultation with a specialist is largely covered within the system. Based on the presented inheritance plan, the user can proceed with specific distribution plans and procedures.

[0046] Thus, the present invention aims to alleviate the worries and burdens that users face regarding end-of-life planning and post-death procedures, and to support them in proceeding with these procedures more smoothly.

[0047] The following describes the processing flow.

[0048] Step 1:

[0049] Users register with the system and enter basic information such as their name, address, contact information, family structure, and any special wishes regarding end-of-life planning. This information is used for the initial system setup and subsequent procedures.

[0050] Step 2:

[0051] The server receives the information entered in Step 1 and stores it in the database. Based on the registered information, it determines the necessity of the procedure and prepares to generate the optimal schedule.

[0052] Step 3:

[0053] The server generates a post-death procedure schedule. This includes filing the death certificate, scheduling funeral arrangements, and planning procedures for settling the estate. This schedule is arranged in a reasonable order, taking into account necessary deadlines.

[0054] Step 4:

[0055] The device notifies the user of the generated procedure schedule. The notification is sent via email or a dedicated app and includes details of the procedure and required actions. Alerts are also set for the appropriate timing.

[0056] Step 5:

[0057] The user will follow the notifications received via their device and begin specific procedures. For example, they may submit a death certificate to the city hall with the required documents, or they may proceed with arrangements with a funeral home.

[0058] Step 6:

[0059] The server identifies the documents required for each procedure and assists users in retrieving them online upon request. It also provides users with templates and instructions on how to obtain the identified documents.

[0060] Step 7:

[0061] The AI ​​agent analyzes the user's family structure and will contents to generate an optimal inheritance plan. It then presents the generated plan to the user via their device, supporting them in ensuring a smooth inheritance process.

[0062] Step 8:

[0063] Based on the inheritance plan provided by the AI ​​agent, the user will carry out the necessary legal procedures. For example, they will discuss and decide on the method of asset distribution among family members.

[0064] In this way, processing across the entire system is coordinated, allowing users to systematically and efficiently carry out complex procedures.

[0065] (Example 1)

[0066] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0067] In modern times, users must manage a large amount of information to smoothly carry out end-of-life planning and the procedures required after the death of a family member. This includes gathering information, managing the schedule of complex procedures, and identifying and obtaining necessary documents, all of which require a high level of knowledge. The present invention aims to provide a system that automates these complex and burdensome tasks faced by users, and supports them efficiently and effectively.

[0068] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0069] In this invention, the server includes means for collecting basic user information and desired information and registering it in an information storage unit, means for automatically generating a procedure plan based on the registered information, and means for identifying the materials necessary for the procedure and assisting in their electronic acquisition. As a result, users can not only complete all necessary procedures without omission, but also proceed with the entire process without spending time and effort.

[0070] "Users" refers to individuals who use this system to receive support for end-of-life planning and post-death procedures.

[0071] "Basic information" refers to personal information about the user, such as name, address, and contact information, and includes the initial data necessary for the procedure.

[0072] "Desired information" refers to the wishes and conditions that users want to fulfill in future procedures, and includes individual requests regarding end-of-life planning and inheritance.

[0073] The "information storage unit" refers to the database and storage that the server uses to manage and store information.

[0074] "Procedure planning" refers to a schedule that organizes the series of procedures and steps required by the user in chronological order, outlining the items that need to be carried out.

[0075] "Identifying documents" refers to the process of selecting specific documents or evidence necessary for a procedure.

[0076] "Assisting with electronic acquisition" refers to providing support for efficiently downloading necessary materials and documents online.

[0077] A "server" refers to a computer system that handles information processing and data management for the entire system.

[0078] A "generative AI model" refers to an artificial intelligence model that is responsible for the automatic generation and optimization of procedures and plans.

[0079] A "prompt statement" refers to a specific instruction given to operate a generative AI model.

[0080] This invention is a system that facilitates end-of-life planning and post-death procedures, and is realized through the interaction of a server, terminal, and user.

[0081] First, users register their basic information and preferences with the system via an input device. This is done using a web application or a dedicated app, allowing users to provide the necessary information by filling out a simple form.

[0082] Next, the server receives this information and stores it in a database such as MySQL® or PostgreSQL. This accumulates the basic data necessary for subsequent procedures. The server uses a Python script to analyze the information and automatically generate a procedure plan. A generative AI model is used here to generate a detailed procedure schedule based on the registered information.

[0083] The generated schedule is notified to the user via the device. The device is configured to provide users with timely information via a smartphone app or email, so they know what procedures they need to follow. The notification is in the form of a specific action prompt, such as "Please submit the death certificate at the city hall in 3 days."

[0084] Furthermore, the server is configured to automatically identify the documents required for a procedure and assist users in obtaining them online. To achieve this, it utilizes a document analysis API to present a list of available documents and the procedures for obtaining them, thereby saving users time.

[0085] Furthermore, the AI ​​agent proposes an inheritance plan based on family structure and will information. The generative AI model used for this purpose takes various conditions into consideration and displays an optimized inheritance plan on the device. The user can then carry out specific procedures based on the provided plan.

[0086] For example, if a user inputs a prompt such as, "Please suggest a specific procedural schedule for when a family member dies. Please include the necessary items for filing a death certificate, funeral arrangements, and estate settlement," the AI ​​will provide a detailed schedule of the relevant procedures. In this way, the present invention aims to reduce the burden on users and improve the efficiency of procedures.

[0087] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0088] Step 1:

[0089] Users input basic and desired information using a web application or dedicated app as their input device. Specifically, they enter data such as their name, address, contact information, family structure, and end-of-life planning preferences into a form and submit it to the system. The input in this step is information from the user, and the output is that this information is registered in the system.

[0090] Step 2:

[0091] The server stores the received user information in a database. For example, it saves the received information to a database such as MySQL or PostgreSQL to build a basic user profile. This process involves receiving raw data sent by the user, formatting it into an existing data structure, and then storing it. The output is organized user information.

[0092] Step 3:

[0093] The server automatically generates a procedural plan using registered user information. At this stage, a Python script is executed, and an AI model is used to generate an appropriate procedural schedule. Specifically, the system analyzes the information and organizes tasks such as death registration, funeral arrangements, and estate settlement in chronological order. The input is user information, and the output is a detailed procedural schedule.

[0094] Step 4:

[0095] The device notifies the user of the generated procedural schedule. Specifically, reminders are sent to the user via apps on the device or via email. The device then indicates the specific procedures that need to be done next, conveying information to the user such as, "Please submit the death certificate at the city hall in three days." The input is the procedural schedule data, and the output is the notification message to the user.

[0096] Step 5:

[0097] The server identifies the documents required for the procedure and assists in obtaining them online. Using a document analysis API, it creates a list of necessary documents and presents the user with the corresponding online links. Automatic document identification and listing are examples of data processing. The input is key data related to the procedure, and the output is a list of documents accessible to the user.

[0098] Step 6:

[0099] The AI ​​agent proposes an optimal inheritance plan based on family structure and will information. Using the prompt "Please propose a specific procedural schedule in the event of a family member's death," the generation AI model generates an inheritance plan that meets the specified conditions. An optimized inheritance plan tailored to the user's conditions is output and displayed on the terminal. The input for this step is family structure and will information, and the output is a visually presented inheritance plan.

[0100] (Application Example 1)

[0101] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0102] In end-of-life planning and post-death procedures, users typically face numerous complex procedures and a large volume of required documents. A problem exists in the lack of support systems to ensure these procedures are carried out smoothly and at the appropriate time. Furthermore, properly considering family structure and will information in inheritance procedures is difficult, often requiring the assistance of experts, which places a significant burden on users. Additionally, the lack of visually clear and easy-to-understand information systems further increases the burden on users.

[0103] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0104] In this invention, the server includes means for acquiring the user's basic information and storing it in a recording device, means for generating a timeline of necessary tasks based on the stored information, and means for intuitively displaying procedural information to the user using a visual information device. As a result, the user can efficiently manage complex procedures, intuitively understand the necessary information, and smoothly proceed with end-of-life planning and post-death procedures.

[0105] "User basic information" refers to data including the individual's profile and wishes necessary for end-of-life planning and post-death procedures.

[0106] A "recording device" is a data storage device used to store acquired information.

[0107] "Accumulated information" refers to a collection of basic user information stored on a recording device.

[0108] A "work timeline" is a schedule that arranges each step required for a procedure in the order in which it progresses.

[0109] "Visual information devices" are devices that present information to users visually, and examples include smart glasses and head-mounted displays.

[0110] "Procedural information" refers to detailed instructions and guides regarding specific end-of-life and post-death procedures.

[0111] This invention is a system that reduces the various burdens associated with end-of-life planning and post-death procedures, and supports a smooth process. The program includes the following configuration and processing.

[0112] The server retrieves basic information from users via the internet and stores the data in a cloud-based storage device. This ensures that users' personal information and preferences are always accessible. Cloud database management systems (such as Amazon Web Services' RDS or Google Cloud SQL) are used for data management.

[0113] Based on this accumulated information, the program uses an AI model to generate a timeline of the tasks required for the procedure. This generation process utilizes a machine learning framework (e.g., TENSORFLOW®) to efficiently create a schedule.

[0114] Based on this timeline, visual information devices visually present the user with the necessary procedural information. Using visual information devices such as smart glasses or head-mounted displays (e.g., Microsoft® HoloLens®), the user is intuitively shown the progress of the procedure and the next steps to take.

[0115] For example, when a user uses smart glasses to check the next steps, the display on the glasses will show instructions such as, "The next step is a procedure at the government office. The necessary documents are a family register transcript and a resident registration certificate." Based on these instructions, the user can smoothly proceed with preparing for the procedure.

[0116] An example of a prompt is the instruction to a generative AI model: "Create an optimal schedule for procedures after a family member's death." This prompt automatically generates a list of necessary tasks and a timeline.

[0117] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0118] Step 1:

[0119] The server receives basic information from the user as input. This includes personal profile information and wishes related to end-of-life planning. The server stores this data in a cloud-based storage device and organizes it into a structured database for easy access. This data is used as foundational information for subsequent processing.

[0120] Step 2:

[0121] The server receives accumulated basic information as input and uses a generative AI model to generate a timeline of the tasks required for the procedure. Based on historical data and common procedural patterns, the model calculates the optimal order and timing for each task and outputs this as a timeline. This clarifies the overall picture of the procedure that the user needs to perform.

[0122] Step 3:

[0123] Based on the timeline, the device notifies the user to begin the process. The device generates and displays a notification message to guide the user through the details of the next actions to take. If necessary, specific instructions and a list of required documents are displayed to help the user understand the next steps.

[0124] Step 4:

[0125] Visual information devices receive procedural information from a timeline as input and present it to the user in an intuitive visual format. Smart glasses overlay the actions required at each stage to support the user's visual understanding. For example, they display the next procedure and a list of necessary documents to assist the user in preparing for the procedure.

[0126] Step 5:

[0127] The user performs specific procedural actions based on visual information. When ready, the terminal receives feedback from the user and notifies the server that the procedure is complete. The server selects the next procedural step from the timeline and prepares to continue the process.

[0128] The above steps ensure that end-of-life planning and post-death procedures are carried out efficiently and smoothly.

[0129] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0130] This invention is a system designed to facilitate end-of-life planning for users and procedures following the death of a family member, and by incorporating an emotional engine, it also aims to provide psychological support to users. This system is realized through the cooperation of a server, terminal, user, and emotional engine.

[0131] First, the server registers basic information and preference data provided by the user into a database. The emotion engine acquires emotional data from the user in real time using voice input and biosensors. This information is used to adjust how the procedure proceeds.

[0132] Next, the server combines registered data with emotional data to generate a schedule of necessary procedures. Before important procedures or high-stress processes, the emotional engine is used to make adjustments according to the user's mental condition. For example, if the user is feeling pressured, the schedule is moderately eased and necessary mental support information is provided.

[0133] The generated schedule and details of the emotionally-driven procedures are communicated to the user via the device. The device also provides the user with links to special counseling information and life care services as needed. This allows the user to proceed with the procedures while receiving emotional support.

[0134] Furthermore, the server works in conjunction with an emotion engine to reduce user stress and ensure a smooth process by assisting in the identification and online retrieval of necessary documents. The list of identified documents is presented in a user-friendly format.

[0135] The emotion engine monitors the user's emotional state in real time and provides immediate support via the device if a significant emotional shift is detected. This support includes recommending relaxation techniques and providing links to professional counselors. For example, users can receive guidance to regain their composure before making important decisions.

[0136] Thus, the present invention encompasses not only mechanical support for procedures but also support for maintaining emotional stability. This system considers the user's emotional state at every step and enhances engagement, enabling users to perform procedures in the most reassuring way possible.

[0137] The following describes the processing flow.

[0138] Step 1:

[0139] Users log into the system and enter their personal information and end-of-life planning preferences. In particular, they provide voice settings and biosensor information for use by the emotion engine. This step lays the foundation for the information the system needs.

[0140] Step 2:

[0141] The server registers the information entered by the user into the database. Simultaneously, the emotion engine analyzes the user's initial emotional state and prepares to store it in the database. This completes the basic dataset for specific procedural planning.

[0142] Step 3:

[0143] The server analyzes the registered information and automatically generates a procedure schedule. The emotion engine analyzes emotional data in real time and incorporates the emotional state as an adjustment factor for the schedule. At this point, an optimal schedule is created that takes into account the urgency of the procedure.

[0144] Step 4:

[0145] The device notifies the user of the generated procedure schedule. The notification includes the procedure deadline, detailed guides, and emotional support information. In particular, it offers suggestions for relaxation techniques during situations where the user might experience tension or anxiety.

[0146] Step 5:

[0147] Users receive notifications from their devices and follow the instructions to complete the process. An emotion engine monitors any emotional changes that occur during the process and provides support information that the user deems necessary. For example, a guide to exercises or breathing techniques might be sent before a procedure at the city hall.

[0148] Step 6:

[0149] The server lists the documents required for the procedure and identifies those available online. The emotion engine considers the user's emotional state and provides additional support to facilitate the document retrieval process. For example, a reminder function helps to make it easier to collect important documents.

[0150] Step 7:

[0151] The emotion engine optimizes inheritance planning suggestions based on the user's emotional data. During this process, the user receives suggestions that are tailored to their emotional state through their device. The plan is designed to minimize user stress.

[0152] Step 8:

[0153] Users can leverage the emotional analysis provided by the emotion engine to perform inheritance procedures that best suit their feelings. If the emotion engine detects anxiety or confusion, it will provide additional support. This allows users to proceed with the procedures with peace of mind.

[0154] (Example 2)

[0155] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0156] In modern society, it is difficult for individuals to smoothly navigate end-of-life procedures or the procedures required when a family member dies. In particular, organizing the complex information related to these procedures and coping with the emotional stress involved are burdensome for individuals. Furthermore, there are many situations where procedures must be conducted while considering the emotional state of the individual, and there is a need for systems that can effectively support these needs.

[0157] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0158] In this invention, the server includes means for collecting user information and registering it in a database, means for detecting the user's emotional state and acquiring and analyzing relevant information in real time, and means for generating a schedule of necessary procedures based on the registered information and emotional data, and making adjustments according to the user's mental state. This reduces the burden on the user and enables the smooth progress of procedures while taking the emotional state into consideration.

[0159] "User information" refers to basic personal information necessary for the procedure, as well as information including specific wishes and requests.

[0160] A "database" is an information system used to systematically store and manage collected data.

[0161] "Emotional state" refers to data that indicates the user's psychological and mental condition, and is acquired in real time from sources such as voice tone and signals from biosensors.

[0162] A "procedure schedule" is a plan that outlines the order and timing of a series of procedures that a user must perform.

[0163] "Mental support" refers to the provision of support information and activities aimed at reducing the stress and anxiety experienced by users and promoting emotional stability.

[0164] "Document identification" refers to the process of identifying the documents and certificates necessary to carry out a procedure and clearly indicating their contents to the user.

[0165] "User emotional changes" refer to changes in a user's emotional state that occur over time or in response to changes in specific circumstances.

[0166] This system is designed to streamline procedures during end-of-life care for users and in the event of a family member's death, and it also provides psychological support to users through the use of an emotion engine. This system is primarily realized through the coordination of a server, terminals, users, and the emotion engine.

[0167] The server first registers basic information and preference data provided by the user using a database system (e.g., MySQL or PostgreSQL). This allows the server to efficiently organize and store all necessary information about the user.

[0168] Next, the emotion engine acquires the user's emotional data in real time through voice input devices and biosensors (e.g., smartwatches and other wearable devices). This allows the server to continuously monitor the user's emotional state and adjust the way procedures proceed accordingly.

[0169] Utilizing a generative AI model, the server generates a procedure schedule based on registered data and sentiment data. This schedule is automated by an RPA tool, providing the user with the most optimal steps. For example, if a user is experiencing stress, the server adjusts the schedule to make the procedure more flexible.

[0170] The device notifies the user of the generated schedule and details of the procedures. Through a user-friendly application, the device also provides special counseling information and links to relevant life care services. This allows the user to proceed with the procedures while receiving emotional support.

[0171] Furthermore, the server works with an emotion engine to reduce user stress by assisting in identifying and retrieving documents online. The list of identified documents is displayed on the device in a format that is easy for the user to access.

[0172] For example, by using a prompt such as, "Tell me how to relax before filing an insurance claim," the AI ​​model will provide relaxation techniques and advice tailored to the user. This allows the user to make important decisions with a sense of security.

[0173] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0174] Step 1:

[0175] Users input basic information and data regarding their preferences through a terminal. This input includes name, address, contact information, and desired procedures. This information is transmitted via the terminal to a server and stored in a database. The server uses a database system to organize the data structurally. The output of this process is the user information stored in the database.

[0176] Step 2:

[0177] The server works in conjunction with the emotion engine to collect user emotional data. This process utilizes biosensors and voice input devices to obtain real-time input such as the user's heart rate and voice tone. The server analyzes the input data using the emotion engine and evaluates the user's emotional state. The output of this process is the server's evaluation data of the user's emotional state.

[0178] Step 3:

[0179] The server uses a generative AI model to generate a schedule of necessary procedures based on registered user information and emotional data. It utilizes the user's basic information, preferences, and emotional state as input, and the AI ​​algorithm calculates the optimal steps. Specifically, high-stress procedures are incorporated into the schedule with buffer time, and adjustments are made according to the user's needs. The output of this process is the generated procedure schedule.

[0180] Step 4:

[0181] The terminal notifies the user of the generated schedule. The schedule and procedure details obtained as output are sent to the terminal and displayed visually to the user. The terminal sends a push notification to the user's screen, guiding them through the specific date and time, procedure details, and necessary items. The output of this process is procedure information presented in a user-friendly format.

[0182] Step 5:

[0183] The server identifies the documents the user needs and assists in their retrieval. It utilizes scheduled procedural information as input to list documents available online. This list is sent to the terminal and displayed in a user-friendly format. Specifically, links to digital copies and printing guides are also provided. The output of this process is a list of documents prepared for the user.

[0184] Step 6:

[0185] The device continuously monitors changes in the user's emotional state and provides immediate support if an anomaly is detected. It receives real-time data on the user's emotional state as input and selects appropriate actions based on evaluations from the emotion engine. This may include displaying relaxation techniques or providing links to counseling services. The output of this process is support information tailored to the user's emotional changes.

[0186] (Application Example 2)

[0187] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0188] In modern society, the elderly and their families often face a vast amount of paperwork, legal procedures, and emotional burden in end-of-life planning. End-of-life planning not only requires time and effort but also causes significant mental stress, potentially negatively impacting the user's physical and mental health. This invention aims to provide a system that reduces the psychological burden on users during such end-of-life planning and supports the smooth progress of the process.

[0189] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0190] In this invention, the server includes means for registering the user's basic data and preferences in a database, means for adjusting the procedure schedule using collected emotional data, and means for providing mental support information according to the user's emotional state. As a result, the user can reduce the psychological burden of proceeding with end-of-life planning, manage the necessary procedures appropriately, and proceed with the procedures with peace of mind by obtaining relaxation methods and contact information for specialists.

[0191] "User basic data" refers to personal information such as the user's name, age, contact information, and preferences.

[0192] "Emotional data" refers to data obtained through the emotion engine that indicates the user's emotional state.

[0193] The "procedure schedule" refers to a plan outlining the specific procedures related to the user's end-of-life planning, including the necessary steps and their timing.

[0194] "Mental support information" refers to psychological support information provided to reduce the stress and anxiety that users experience during the process.

[0195] "Smart devices" refer to mobile information terminals and network-connected devices that collect, notify, and manage information.

[0196] "Electronically available documents" refer to official documents that are accessible online and can be downloaded or printed as needed.

[0197] "Relaxation techniques" refer to methods and techniques for alleviating mental tension and fatigue, and are means of regulating the autonomic nervous system.

[0198] "Contact information for experts" refers to contact information for professionals who are qualified to provide advice on end-of-life planning or specific processes.

[0199] The system of the present invention supports users in end-of-life planning procedures and functions through the collaboration of a server, a terminal, and an emotion engine. The server registers basic data provided by the user in a database and generates emotion data to use for scheduling. Specific data processing includes real-time emotion data collection by the emotion engine. The emotion engine analyzes the user's emotional state through voice input and biosensors and transmits the results to the server.

[0200] Based on this emotional data and registered basic data, the server automatically adjusts the procedure schedule and generates mental support information. This information is intended to alleviate anxiety and stress experienced by the user during the procedure. For example, it may include suggestions for relaxation techniques and contact information for specialists.

[0201] The terminal notifies the user of procedure details and mental support information sent from the server. Smartphones and other mobile devices are used for these notifications. The terminal also displays a list of documents the user needs and supports their online retrieval.

[0202] Users can utilize the information provided by the server to proceed with end-of-life planning with peace of mind. Furthermore, by using an emotional engine, the system can respond to the user's emotional changes in real time. In particular, when stress levels rise, counseling information is provided to facilitate a swift response.

[0203] For example, if an elderly user experiences stress while performing complex procedures, the server can quickly provide guidance on relaxation techniques and contact information for specialists via the terminal.

[0204] Examples of prompt statements are as follows:

[0205] "Generate notification messages using the provided data, suggesting relaxation methods when the user's stress level is high. The messages should be simple and geared towards the elderly."

[0206] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0207] Step 1:

[0208] The server registers the user's basic data in the database. It receives data such as the user's name, age, contact information, and preferences as input. The server organizes this input data and stores it in the database to manage the information necessary for future procedures. The output is the user's basic data correctly registered.

[0209] Step 2:

[0210] The emotion engine collects user emotional data in real time. It takes voice input and data from biosensors as input. The emotion engine analyzes this data to evaluate the user's current emotional state. The output is emotional data indicating the user's stress and anxiety levels.

[0211] Step 3:

[0212] The server adjusts the procedure schedule using collected emotional and basic data. It receives registered user data and emotional data as input. Based on this data, the server generates an appropriate schedule and determines mental support information. The output is an emotionally adjusted procedure schedule and support information.

[0213] Step 4:

[0214] The terminal notifies the user of schedule and support information sent from the server. It receives schedule information and mental support messages from the server as input. The terminal displays this information in a user-friendly format and issues alerts to draw the user's attention if necessary. The output is a notification displayed on the user's terminal screen.

[0215] Step 5:

[0216] The server identifies the electronic documents necessary for end-of-life planning and provides links to assist in their acquisition. It receives the user's basic data and related procedural information as input. Based on this information, the server searches for electronic documents and generates online access links. The output is a list of documents, including the links.

[0217] Step 6:

[0218] If a user experiences stress during the process, the terminal provides relaxation techniques and contact information for professionals. Inputs include user feedback and alerts from the server. The terminal quickly displays necessary information and provides guidance to help the user relax. Outputs include explanations of relaxation techniques and contact information for professionals.

[0219] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0220] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0221] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0222] [Second Embodiment]

[0223] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0224] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0225] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0226] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0227] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0228] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0229] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0230] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0231] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0232] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0233] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0234] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0235] This invention is a system designed to facilitate end-of-life planning and procedures following the death of a family member. This system functions through interaction between a server, a terminal, and the user.

[0236] First, the server receives basic information and requested data provided by the user and registers it in the database. This makes the basic data necessary for subsequent procedures available.

[0237] Next, the server automatically generates a schedule of necessary procedures based on the registered data. For example, when a family member dies, the schedule would include filing a death certificate, arranging the funeral, and settling the estate. This schedule is designed to display a list of procedures that the user must complete in chronological order.

[0238] The generated schedule and procedural details will be communicated to the user via the device. The notifications are designed to be timely and support the user in following the procedures without forgetting. For example, if the user feels unsure of what to do next, the device will provide specific guidance such as, "The next step is to submit the death certificate at the city hall. The required documents are XX."

[0239] Furthermore, many procedures require multiple documents. The server has a mechanism that automatically identifies the necessary documents related to a particular procedure and assists in obtaining them online. This frees users from the cumbersome task of collecting documents.

[0240] Furthermore, based on family structure and existing wills, the AI ​​agent proposes an appropriate inheritance plan. This plan is displayed visually and clearly on the device, designed to allow users to proceed with inheritance procedures smoothly.

[0241] As a concrete example, when a user with a complex family structure uses the system, inheritance planning that would normally require consultation with a specialist is largely covered within the system. Based on the presented inheritance plan, the user can proceed with specific distribution plans and procedures.

[0242] Thus, the present invention aims to alleviate the worries and burdens that users face regarding end-of-life planning and post-death procedures, and to support them in proceeding with these procedures more smoothly.

[0243] The following describes the processing flow.

[0244] Step 1:

[0245] Users register with the system and enter basic information such as their name, address, contact information, family structure, and any special wishes regarding end-of-life planning. This information is used for the initial system setup and subsequent procedures.

[0246] Step 2:

[0247] The server receives the information entered in Step 1 and stores it in the database. Based on the registered information, it determines the necessity of the procedure and prepares to generate the optimal schedule.

[0248] Step 3:

[0249] The server generates a post-death procedure schedule. This includes filing the death certificate, scheduling funeral arrangements, and planning procedures for settling the estate. This schedule is arranged in a reasonable order, taking into account necessary deadlines.

[0250] Step 4:

[0251] The device notifies the user of the generated procedure schedule. The notification is sent via email or a dedicated app and includes details of the procedure and required actions. Alerts are also set for the appropriate timing.

[0252] Step 5:

[0253] The user will follow the notifications received via their device and begin specific procedures. For example, they may submit a death certificate to the city hall with the required documents, or they may proceed with arrangements with a funeral home.

[0254] Step 6:

[0255] The server identifies the documents required for each procedure and assists users in retrieving them online upon request. It also provides users with templates and instructions on how to obtain the identified documents.

[0256] Step 7:

[0257] The AI ​​agent analyzes the user's family structure and will contents to generate an optimal inheritance plan. It then presents the generated plan to the user via their device, supporting them in ensuring a smooth inheritance process.

[0258] Step 8:

[0259] Based on the inheritance plan provided by the AI ​​agent, the user will carry out the necessary legal procedures. For example, they will discuss and decide on the method of asset distribution among family members.

[0260] In this way, processing across the entire system is coordinated, allowing users to systematically and efficiently carry out complex procedures.

[0261] (Example 1)

[0262] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0263] In modern times, users must manage a large amount of information to smoothly carry out end-of-life planning and the procedures required after the death of a family member. This includes gathering information, managing the schedule of complex procedures, and identifying and obtaining necessary documents, all of which require a high level of knowledge. The present invention aims to provide a system that automates these complex and burdensome tasks faced by users, and supports them efficiently and effectively.

[0264] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0265] In this invention, the server includes means for collecting basic user information and desired information and registering it in an information storage unit, means for automatically generating a procedure plan based on the registered information, and means for identifying the materials necessary for the procedure and assisting in their electronic acquisition. As a result, users can not only complete all necessary procedures without omission, but also proceed with the entire process without spending time and effort.

[0266] "Users" refers to individuals who use this system to receive support for end-of-life planning and post-death procedures.

[0267] "Basic information" refers to personal information about the user, such as name, address, and contact information, and includes the initial data necessary for the procedure.

[0268] "Desired information" refers to the wishes and conditions that users want to fulfill in future procedures, and includes individual requests regarding end-of-life planning and inheritance.

[0269] The "information storage unit" refers to the database and storage that the server uses to manage and store information.

[0270] "Procedure planning" refers to a schedule that organizes the series of procedures and steps required by the user in chronological order, outlining the items that need to be carried out.

[0271] "Identifying documents" refers to the process of selecting specific documents or evidence necessary for a procedure.

[0272] "Assisting with electronic acquisition" refers to providing support for efficiently downloading necessary materials and documents online.

[0273] A "server" refers to a computer system that handles information processing and data management for the entire system.

[0274] A "generative AI model" refers to an artificial intelligence model that is responsible for the automatic generation and optimization of procedures and plans.

[0275] A "prompt statement" refers to a specific instruction given to operate a generative AI model.

[0276] This invention is a system that facilitates end-of-life planning and post-death procedures, and is realized through the interaction of a server, terminal, and user.

[0277] First, users register their basic information and preferences with the system via an input device. This is done using a web application or a dedicated app, allowing users to provide the necessary information by filling out a simple form.

[0278] Next, the server receives this information and stores it in a database such as MySQL or PostgreSQL. This accumulates the basic data necessary for subsequent procedures. The server uses a Python script to analyze the information and automatically generate a procedure plan. A generative AI model is used here to generate a detailed procedure schedule based on the registered information.

[0279] The generated schedule is notified to the user via the device. The device is configured to provide users with timely information via a smartphone app or email, so they know what procedures they need to follow. The notification is in the form of a specific action prompt, such as "Please submit the death certificate at the city hall in 3 days."

[0280] Furthermore, the server is configured to automatically identify the documents required for a procedure and assist users in obtaining them online. To achieve this, it utilizes a document analysis API to present a list of available documents and the procedures for obtaining them, thereby saving users time.

[0281] Furthermore, the AI agent proposes an inheritance plan based on family composition and will information. The generative AI model used for this purpose considers various conditions and displays an optimized inheritance plan on the terminal. The user can perform specific procedures based on the provided plan.

[0282] As a specific example, when the user inputs a prompt sentence such as "Please propose a specific procedure schedule in the case of the death of a family member. Include items necessary for the death certificate, funeral, and estate settlement." into the AI, the AI provides a detailed schedule of the relevant procedures. Thus, the purpose of the present invention is to reduce the burden on the user and improve the efficiency of procedures.

[0283] The flow of the specific process in Example 1 will be described using FIG. 11.

[0284] Step 1:

[0285] The user uses a web application or a dedicated application as an input device to input basic information and desired information. As a specific operation, data such as name, address, contact information, family composition, and wishes regarding end-of-life arrangements are entered into a form and sent to the system. The input in this step is information from the user, and the output is the registration of that information in the system.

[0286] Step 2:

[0287] The server stores the received user information in a database. For example, the received information is saved in a database such as MySQL or PostgreSQL to construct a basic profile of the user. In this process, data processing is performed to receive the raw data sent from the user and format it into an existing data structure for storage. The output is the organized user information.

[0288] [[ID=2,8]]Step 3:

[0289] The server automatically generates a procedural plan using registered user information. At this stage, a Python script is executed, and an AI model is used to generate an appropriate procedural schedule. Specifically, the system analyzes the information and organizes tasks such as death registration, funeral arrangements, and estate settlement in chronological order. The input is user information, and the output is a detailed procedural schedule.

[0290] Step 4:

[0291] The device notifies the user of the generated procedural schedule. Specifically, reminders are sent to the user via apps on the device or via email. The device then indicates the specific procedures that need to be done next, conveying information to the user such as, "Please submit the death certificate at the city hall in three days." The input is the procedural schedule data, and the output is the notification message to the user.

[0292] Step 5:

[0293] The server identifies the documents required for the procedure and assists in obtaining them online. Using a document analysis API, it creates a list of necessary documents and presents the user with the corresponding online links. Automatic document identification and listing are examples of data processing. The input is key data related to the procedure, and the output is a list of documents accessible to the user.

[0294] Step 6:

[0295] The AI ​​agent proposes an optimal inheritance plan based on family structure and will information. Using the prompt "Please propose a specific procedural schedule in the event of a family member's death," the generation AI model generates an inheritance plan that meets the specified conditions. An optimized inheritance plan tailored to the user's conditions is output and displayed on the terminal. The input for this step is family structure and will information, and the output is a visually presented inheritance plan.

[0296] (Application Example 1)

[0297] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0298] In end-of-life planning and post-death procedures, users typically face numerous complex procedures and a large volume of required documents. A problem exists in the lack of support systems to ensure these procedures are carried out smoothly and at the appropriate time. Furthermore, properly considering family structure and will information in inheritance procedures is difficult, often requiring the assistance of experts, which places a significant burden on users. Additionally, the lack of visually clear and easy-to-understand information systems further increases the burden on users.

[0299] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0300] In this invention, the server includes means for acquiring the user's basic information and storing it in a recording device, means for generating a timeline of necessary tasks based on the stored information, and means for intuitively displaying procedural information to the user using a visual information device. As a result, the user can efficiently manage complex procedures, intuitively understand the necessary information, and smoothly proceed with end-of-life planning and post-death procedures.

[0301] "User basic information" refers to data including the individual's profile and wishes necessary for end-of-life planning and post-death procedures.

[0302] A "recording device" is a data storage device used to store acquired information.

[0303] "Accumulated information" refers to a collection of basic user information stored on a recording device.

[0304] A "work timeline" is a schedule that arranges each step required for a procedure in the order in which it progresses.

[0305] A "visual information device" is a device that visually presents information to a user, and examples include smart glasses and head-mounted displays.

[0306] "Procedure information" is detailed instructions and guides regarding specific end-of-life and posthumous procedures.

[0307] This invention is a system that reduces various burdens related to end-of-life and posthumous procedures and supports smooth progress. The program includes the following configurations and processes.

[0308] The server obtains basic information from the user via the Internet and accumulates data in a cloud-based recording device. As a result, the user's personal information and wishes are stored in a state where they can always be accessed. For data management, a cloud database management system (e.g., RDS of Amazon Web Services or Google Cloud SQL) is used.

[0309] Based on this accumulated information, the program uses an AI model to generate a timeline of the tasks required for the procedure. For this generation process, a machine learning framework (e.g., TensorFlow) is utilized to perform efficient schedule assembly.

[0310] Based on this timeline, the visual information device visually presents the necessary procedure information to the user. Using visual information devices such as smart glasses and head-mounted displays (e.g., Microsoft HoloLens), the progress of the procedure and the next steps to be taken are intuitively shown to the user.

[0311] As a specific example, when the user uses smart glasses to check the next procedure to be performed, an instruction such as "Next is the procedure at the government office. The necessary documents are a family register extract and a resident card." is displayed on the display of the glasses. Based on this instruction, the user can smoothly proceed with the preparation for the procedure.

[0312] An example of a prompt is the instruction to a generative AI model: "Create an optimal schedule for procedures after a family member's death." This prompt automatically generates a list of necessary tasks and a timeline.

[0313] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0314] Step 1:

[0315] The server receives basic information from the user as input. This includes personal profile information and wishes related to end-of-life planning. The server stores this data in a cloud-based storage device and organizes it into a structured database for easy access. This data is used as foundational information for subsequent processing.

[0316] Step 2:

[0317] The server receives accumulated basic information as input and uses a generative AI model to generate a timeline of the tasks required for the procedure. Based on historical data and common procedural patterns, the model calculates the optimal order and timing for each task and outputs this as a timeline. This clarifies the overall picture of the procedure that the user needs to perform.

[0318] Step 3:

[0319] Based on the timeline, the device notifies the user to begin the process. The device generates and displays a notification message to guide the user through the details of the next actions to take. If necessary, specific instructions and a list of required documents are displayed to help the user understand the next steps.

[0320] Step 4:

[0321] Visual information devices receive procedural information from a timeline as input and present it to the user in an intuitive visual format. Smart glasses overlay the actions required at each stage to support the user's visual understanding. For example, they display the next procedure and a list of necessary documents to assist the user in preparing for the procedure.

[0322] Step 5:

[0323] The user performs specific procedural actions based on visual information. When ready, the terminal receives feedback from the user and notifies the server that the procedure is complete. The server selects the next procedural step from the timeline and prepares to continue the process.

[0324] The above steps ensure that end-of-life planning and post-death procedures are carried out efficiently and smoothly.

[0325] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0326] This invention is a system designed to facilitate end-of-life planning for users and procedures following the death of a family member, and by incorporating an emotional engine, it also aims to provide psychological support to users. This system is realized through the cooperation of a server, terminal, user, and emotional engine.

[0327] First, the server registers basic information and preference data provided by the user into a database. The emotion engine acquires emotional data from the user in real time using voice input and biosensors. This information is used to adjust how the procedure proceeds.

[0328] Next, the server combines registered data with emotional data to generate a schedule of necessary procedures. Before important procedures or high-stress processes, the emotional engine is used to make adjustments according to the user's mental condition. For example, if the user is feeling pressured, the schedule is moderately eased and necessary mental support information is provided.

[0329] The generated schedule and details of the emotionally-driven procedures are communicated to the user via the device. The device also provides the user with links to special counseling information and life care services as needed. This allows the user to proceed with the procedures while receiving emotional support.

[0330] Furthermore, the server works in conjunction with an emotion engine to reduce user stress and ensure a smooth process by assisting in the identification and online retrieval of necessary documents. The list of identified documents is presented in a user-friendly format.

[0331] The emotion engine monitors the user's emotional state in real time and provides immediate support via the device if a significant emotional shift is detected. This support includes recommending relaxation techniques and providing links to professional counselors. For example, users can receive guidance to regain their composure before making important decisions.

[0332] Thus, the present invention encompasses not only mechanical support for procedures but also support for maintaining emotional stability. This system considers the user's emotional state at every step and enhances engagement, enabling users to perform procedures in the most reassuring way possible.

[0333] The following describes the processing flow.

[0334] Step 1:

[0335] Users log into the system and enter their personal information and end-of-life planning preferences. In particular, they provide voice settings and biosensor information for use by the emotion engine. This step lays the foundation for the information the system needs.

[0336] Step 2:

[0337] The server registers the information entered by the user into the database. Simultaneously, the emotion engine analyzes the user's initial emotional state and prepares to store it in the database. This completes the basic dataset for specific procedural planning.

[0338] Step 3:

[0339] The server analyzes the registered information and automatically generates a procedure schedule. The emotion engine analyzes emotional data in real time and incorporates the emotional state as an adjustment factor for the schedule. At this point, an optimal schedule is created that takes into account the urgency of the procedure.

[0340] Step 4:

[0341] The device notifies the user of the generated procedure schedule. The notification includes the procedure deadline, detailed guides, and emotional support information. In particular, it offers suggestions for relaxation techniques during situations where the user might experience tension or anxiety.

[0342] Step 5:

[0343] Users receive notifications from their devices and follow the instructions to complete the process. An emotion engine monitors any emotional changes that occur during the process and provides support information that the user deems necessary. For example, a guide to exercises or breathing techniques might be sent before a procedure at the city hall.

[0344] Step 6:

[0345] The server lists the documents required for the procedure and identifies those available online. The emotion engine considers the user's emotional state and provides additional support to facilitate the document retrieval process. For example, a reminder function helps to make it easier to collect important documents.

[0346] Step 7:

[0347] The emotion engine optimizes inheritance planning suggestions based on the user's emotional data. During this process, the user receives suggestions that are tailored to their emotional state through their device. The plan is designed to minimize user stress.

[0348] Step 8:

[0349] Users can leverage the emotional analysis provided by the emotion engine to perform inheritance procedures that best suit their feelings. If the emotion engine detects anxiety or confusion, it will provide additional support. This allows users to proceed with the procedures with peace of mind.

[0350] (Example 2)

[0351] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0352] In modern society, it is difficult for individuals to smoothly navigate end-of-life procedures or the procedures required when a family member dies. In particular, organizing the complex information related to these procedures and coping with the emotional stress involved are burdensome for individuals. Furthermore, there are many situations where procedures must be conducted while considering the emotional state of the individual, and there is a need for systems that can effectively support these needs.

[0353] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0354] In this invention, the server includes means for collecting user information and registering it in a database, means for detecting the user's emotional state and acquiring and analyzing relevant information in real time, and means for generating a schedule of necessary procedures based on the registered information and emotional data, and making adjustments according to the user's mental state. This reduces the burden on the user and enables the smooth progress of procedures while taking the emotional state into consideration.

[0355] "User information" refers to basic personal information necessary for the procedure, as well as information including specific wishes and requests.

[0356] A "database" is an information system used to systematically store and manage collected data.

[0357] "Emotional state" refers to data that indicates the user's psychological and mental condition, and is acquired in real time from sources such as voice tone and signals from biosensors.

[0358] A "procedure schedule" is a plan that outlines the order and timing of a series of procedures that a user must perform.

[0359] "Mental support" refers to the provision of support information and activities aimed at reducing the stress and anxiety experienced by users and promoting emotional stability.

[0360] "Document identification" refers to the process of identifying the documents and certificates necessary to carry out a procedure and clearly indicating their contents to the user.

[0361] "User emotional changes" refer to changes in a user's emotional state that occur over time or in response to changes in specific circumstances.

[0362] This system is designed to streamline procedures during end-of-life care for users and in the event of a family member's death, and it also provides psychological support to users through the use of an emotion engine. This system is primarily realized through the coordination of a server, terminals, users, and the emotion engine.

[0363] The server first registers basic information and preference data provided by the user using a database system (e.g., MySQL or PostgreSQL). This allows the server to efficiently organize and store all necessary information about the user.

[0364] Next, the emotion engine acquires the user's emotional data in real time through voice input devices and biosensors (e.g., smartwatches and other wearable devices). This allows the server to continuously monitor the user's emotional state and adjust the way procedures proceed accordingly.

[0365] Utilizing a generative AI model, the server generates a procedure schedule based on registered data and sentiment data. This schedule is automated by an RPA tool, providing the user with the most optimal steps. For example, if a user is experiencing stress, the server adjusts the schedule to make the procedure more flexible.

[0366] The device notifies the user of the generated schedule and details of the procedures. Through a user-friendly application, the device also provides special counseling information and links to relevant life care services. This allows the user to proceed with the procedures while receiving emotional support.

[0367] Furthermore, the server works with an emotion engine to reduce user stress by assisting in identifying and retrieving documents online. The list of identified documents is displayed on the device in a format that is easy for the user to access.

[0368] For example, by using a prompt such as, "Tell me how to relax before filing an insurance claim," the AI ​​model will provide relaxation techniques and advice tailored to the user. This allows the user to make important decisions with a sense of security.

[0369] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0370] Step 1:

[0371] Users input basic information and data regarding their preferences through a terminal. This input includes name, address, contact information, and desired procedures. This information is transmitted via the terminal to a server and stored in a database. The server uses a database system to organize the data structurally. The output of this process is the user information stored in the database.

[0372] Step 2:

[0373] The server works in conjunction with the emotion engine to collect user emotional data. This process utilizes biosensors and voice input devices to obtain real-time input such as the user's heart rate and voice tone. The server analyzes the input data using the emotion engine and evaluates the user's emotional state. The output of this process is the server's evaluation data of the user's emotional state.

[0374] Step 3:

[0375] The server uses a generative AI model to generate a schedule of necessary procedures based on registered user information and emotional data. It utilizes the user's basic information, preferences, and emotional state as input, and the AI ​​algorithm calculates the optimal steps. Specifically, high-stress procedures are incorporated into the schedule with buffer time, and adjustments are made according to the user's needs. The output of this process is the generated procedure schedule.

[0376] Step 4:

[0377] The terminal notifies the user of the generated schedule. The schedule and procedure details obtained as output are sent to the terminal and displayed visually to the user. The terminal sends a push notification to the user's screen, guiding them through the specific date and time, procedure details, and necessary items. The output of this process is procedure information presented in a user-friendly format.

[0378] Step 5:

[0379] The server identifies the documents the user needs and assists in their retrieval. It utilizes scheduled procedural information as input to list documents available online. This list is sent to the terminal and displayed in a user-friendly format. Specifically, links to digital copies and printing guides are also provided. The output of this process is a list of documents prepared for the user.

[0380] Step 6:

[0381] The device continuously monitors changes in the user's emotional state and provides immediate support if an anomaly is detected. It receives real-time data on the user's emotional state as input and selects appropriate actions based on evaluations from the emotion engine. This may include displaying relaxation techniques or providing links to counseling services. The output of this process is support information tailored to the user's emotional changes.

[0382] (Application Example 2)

[0383] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0384] In modern society, the elderly and their families often face a vast amount of paperwork, legal procedures, and emotional burden in end-of-life planning. End-of-life planning not only requires time and effort but also causes significant mental stress, potentially negatively impacting the user's physical and mental health. This invention aims to provide a system that reduces the psychological burden on users during such end-of-life planning and supports the smooth progress of the process.

[0385] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0386] In this invention, the server includes means for registering the user's basic data and preferences in a database, means for adjusting the procedure schedule using collected emotional data, and means for providing mental support information according to the user's emotional state. As a result, the user can reduce the psychological burden of proceeding with end-of-life planning, manage the necessary procedures appropriately, and proceed with the procedures with peace of mind by obtaining relaxation methods and contact information for specialists.

[0387] "User basic data" refers to personal information such as the user's name, age, contact information, and preferences.

[0388] "Emotional data" refers to data obtained through the emotion engine that indicates the user's emotional state.

[0389] The "procedure schedule" refers to a plan outlining the specific procedures related to the user's end-of-life planning, including the necessary steps and their timing.

[0390] "Mental support information" refers to psychological support information provided to reduce the stress and anxiety that users experience during the process.

[0391] "Smart devices" refer to mobile information terminals and network-connected devices that collect, notify, and manage information.

[0392] "Electronically available documents" refer to official documents that are accessible online and can be downloaded or printed as needed.

[0393] "Relaxation techniques" refer to methods and techniques for alleviating mental tension and fatigue, and are means of regulating the autonomic nervous system.

[0394] "Contact information for experts" refers to contact information for professionals who are qualified to provide advice on end-of-life planning or specific processes.

[0395] The system of the present invention supports users in end-of-life planning procedures and functions through the collaboration of a server, a terminal, and an emotion engine. The server registers basic data provided by the user in a database and generates emotion data to use for scheduling. Specific data processing includes real-time emotion data collection by the emotion engine. The emotion engine analyzes the user's emotional state through voice input and biosensors and transmits the results to the server.

[0396] Based on this emotional data and registered basic data, the server automatically adjusts the procedure schedule and generates mental support information. This information is intended to alleviate anxiety and stress experienced by the user during the procedure. For example, it may include suggestions for relaxation techniques and contact information for specialists.

[0397] The terminal notifies the user of procedure details and mental support information sent from the server. Smartphones and other mobile devices are used for these notifications. The terminal also displays a list of documents the user needs and supports their online retrieval.

[0398] Users can utilize the information provided by the server to proceed with end-of-life planning with peace of mind. Furthermore, by using an emotional engine, the system can respond to the user's emotional changes in real time. In particular, when stress levels rise, counseling information is provided to facilitate a swift response.

[0399] For example, if an elderly user experiences stress while performing complex procedures, the server can quickly provide guidance on relaxation techniques and contact information for specialists via the terminal.

[0400] Examples of prompt statements are as follows:

[0401] "Generate notification messages using the provided data, suggesting relaxation methods when the user's stress level is high. The messages should be simple and geared towards the elderly."

[0402] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0403] Step 1:

[0404] The server registers the user's basic data in the database. It receives data such as the user's name, age, contact information, and preferences as input. The server organizes this input data and stores it in the database to manage the information necessary for future procedures. The output is the user's basic data correctly registered.

[0405] Step 2:

[0406] The emotion engine collects user emotional data in real time. It takes voice input and data from biosensors as input. The emotion engine analyzes this data to evaluate the user's current emotional state. The output is emotional data indicating the user's stress and anxiety levels.

[0407] Step 3:

[0408] The server adjusts the procedure schedule using collected emotional and basic data. It receives registered user data and emotional data as input. Based on this data, the server generates an appropriate schedule and determines mental support information. The output is an emotionally adjusted procedure schedule and support information.

[0409] Step 4:

[0410] The terminal notifies the user of schedule and support information sent from the server. It receives schedule information and mental support messages from the server as input. The terminal displays this information in a user-friendly format and issues alerts to draw the user's attention if necessary. The output is a notification displayed on the user's terminal screen.

[0411] Step 5:

[0412] The server identifies the electronic documents necessary for end-of-life planning and provides links to assist in their acquisition. It receives the user's basic data and related procedural information as input. Based on this information, the server searches for electronic documents and generates online access links. The output is a list of documents, including the links.

[0413] Step 6:

[0414] If a user experiences stress during the process, the terminal provides relaxation techniques and contact information for professionals. Inputs include user feedback and alerts from the server. The terminal quickly displays necessary information and provides guidance to help the user relax. Outputs include explanations of relaxation techniques and contact information for professionals.

[0415] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0416] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0417] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0418] [Third Embodiment]

[0419] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0420] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0421] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0422] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0423] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0424] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0425] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0426] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0427] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0428] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0429] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0430] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0431] This invention is a system designed to facilitate end-of-life planning and procedures following the death of a family member. This system functions through interaction between a server, a terminal, and the user.

[0432] First, the server receives basic information and requested data provided by the user and registers it in the database. This makes the basic data necessary for subsequent procedures available.

[0433] Next, the server automatically generates a schedule of necessary procedures based on the registered data. For example, when a family member dies, the schedule would include filing a death certificate, arranging the funeral, and settling the estate. This schedule is designed to display a list of procedures that the user must complete in chronological order.

[0434] The generated schedule and procedural details will be communicated to the user via the device. The notifications are designed to be timely and support the user in following the procedures without forgetting. For example, if the user feels unsure of what to do next, the device will provide specific guidance such as, "The next step is to submit the death certificate at the city hall. The required documents are XX."

[0435] Furthermore, many procedures require multiple documents. The server has a mechanism that automatically identifies the necessary documents related to a particular procedure and assists in obtaining them online. This frees users from the cumbersome task of collecting documents.

[0436] Furthermore, based on family structure and existing wills, the AI ​​agent proposes an appropriate inheritance plan. This plan is displayed visually and clearly on the device, designed to allow users to proceed with inheritance procedures smoothly.

[0437] As a concrete example, when a user with a complex family structure uses the system, inheritance planning that would normally require consultation with a specialist is largely covered within the system. Based on the presented inheritance plan, the user can proceed with specific distribution plans and procedures.

[0438] Thus, the present invention aims to alleviate the worries and burdens that users face regarding end-of-life planning and post-death procedures, and to support them in proceeding with these procedures more smoothly.

[0439] The following describes the processing flow.

[0440] Step 1:

[0441] Users register with the system and enter basic information such as their name, address, contact information, family structure, and any special wishes regarding end-of-life planning. This information is used for the initial system setup and subsequent procedures.

[0442] Step 2:

[0443] The server receives the information entered in Step 1 and stores it in the database. Based on the registered information, it determines the necessity of the procedure and prepares to generate the optimal schedule.

[0444] Step 3:

[0445] The server generates a post-death procedure schedule. This includes filing the death certificate, scheduling funeral arrangements, and planning procedures for settling the estate. This schedule is arranged in a reasonable order, taking into account necessary deadlines.

[0446] Step 4:

[0447] The device notifies the user of the generated procedure schedule. The notification is sent via email or a dedicated app and includes details of the procedure and required actions. Alerts are also set for the appropriate timing.

[0448] Step 5:

[0449] The user will follow the notifications received via their device and begin specific procedures. For example, they may submit a death certificate to the city hall with the required documents, or they may proceed with arrangements with a funeral home.

[0450] Step 6:

[0451] The server identifies the documents required for each procedure and assists users in retrieving them online upon request. It also provides users with templates and instructions on how to obtain the identified documents.

[0452] Step 7:

[0453] The AI ​​agent analyzes the user's family structure and will contents to generate an optimal inheritance plan. It then presents the generated plan to the user via their device, supporting them in ensuring a smooth inheritance process.

[0454] Step 8:

[0455] Based on the inheritance plan provided by the AI ​​agent, the user will carry out the necessary legal procedures. For example, they will discuss and decide on the method of asset distribution among family members.

[0456] In this way, processing across the entire system is coordinated, allowing users to systematically and efficiently carry out complex procedures.

[0457] (Example 1)

[0458] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0459] In modern times, users must manage a large amount of information to smoothly carry out end-of-life planning and the procedures required after the death of a family member. This includes gathering information, managing the schedule of complex procedures, and identifying and obtaining necessary documents, all of which require a high level of knowledge. The present invention aims to provide a system that automates these complex and burdensome tasks faced by users, and supports them efficiently and effectively.

[0460] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0461] In this invention, the server includes means for collecting basic user information and desired information and registering it in an information storage unit, means for automatically generating a procedure plan based on the registered information, and means for identifying the materials necessary for the procedure and assisting in their electronic acquisition. As a result, users can not only complete all necessary procedures without omission, but also proceed with the entire process without spending time and effort.

[0462] "Users" refers to individuals who use this system to receive support for end-of-life planning and post-death procedures.

[0463] "Basic information" refers to personal information about the user, such as name, address, and contact information, and includes the initial data necessary for the procedure.

[0464] "Desired information" refers to the wishes and conditions that users want to fulfill in future procedures, and includes individual requests regarding end-of-life planning and inheritance.

[0465] The "information storage unit" refers to the database and storage that the server uses to manage and store information.

[0466] "Procedure planning" refers to a schedule that organizes the series of procedures and steps required by the user in chronological order, outlining the items that need to be carried out.

[0467] "Identifying documents" refers to the process of selecting specific documents or evidence necessary for a procedure.

[0468] "Assisting with electronic acquisition" refers to providing support for efficiently downloading necessary materials and documents online.

[0469] A "server" refers to a computer system that handles information processing and data management for the entire system.

[0470] A "generative AI model" refers to an artificial intelligence model that is responsible for the automatic generation and optimization of procedures and plans.

[0471] A "prompt statement" refers to a specific instruction given to operate a generative AI model.

[0472] This invention is a system that facilitates end-of-life planning and post-death procedures, and is realized through the interaction of a server, terminal, and user.

[0473] First, users register their basic information and preferences with the system via an input device. This is done using a web application or a dedicated app, allowing users to provide the necessary information by filling out a simple form.

[0474] Next, the server receives this information and stores it in a database such as MySQL or PostgreSQL. This accumulates the basic data necessary for subsequent procedures. The server uses a Python script to analyze the information and automatically generate a procedure plan. A generative AI model is used here to generate a detailed procedure schedule based on the registered information.

[0475] The generated schedule is notified to the user via the device. The device is configured to provide users with timely information via a smartphone app or email, so they know what procedures they need to follow. The notification is in the form of a specific action prompt, such as "Please submit the death certificate at the city hall in 3 days."

[0476] Furthermore, the server is configured to automatically identify the documents required for a procedure and assist users in obtaining them online. To achieve this, it utilizes a document analysis API to present a list of available documents and the procedures for obtaining them, thereby saving users time.

[0477] Furthermore, the AI ​​agent proposes an inheritance plan based on family structure and will information. The generative AI model used for this purpose takes various conditions into consideration and displays an optimized inheritance plan on the device. The user can then carry out specific procedures based on the provided plan.

[0478] For example, if a user inputs a prompt such as, "Please suggest a specific procedural schedule for when a family member dies. Please include the necessary items for filing a death certificate, funeral arrangements, and estate settlement," the AI ​​will provide a detailed schedule of the relevant procedures. In this way, the present invention aims to reduce the burden on users and improve the efficiency of procedures.

[0479] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0480] Step 1:

[0481] Users input basic and desired information using a web application or dedicated app as their input device. Specifically, they enter data such as their name, address, contact information, family structure, and end-of-life planning preferences into a form and submit it to the system. The input in this step is information from the user, and the output is that this information is registered in the system.

[0482] Step 2:

[0483] The server stores the received user information in a database. For example, it saves the received information to a database such as MySQL or PostgreSQL to build a basic user profile. This process involves receiving raw data sent by the user, formatting it into an existing data structure, and then storing it. The output is organized user information.

[0484] Step 3:

[0485] The server automatically generates a procedural plan using registered user information. At this stage, a Python script is executed, and an AI model is used to generate an appropriate procedural schedule. Specifically, the system analyzes the information and organizes tasks such as death registration, funeral arrangements, and estate settlement in chronological order. The input is user information, and the output is a detailed procedural schedule.

[0486] Step 4:

[0487] The device notifies the user of the generated procedural schedule. Specifically, reminders are sent to the user via apps on the device or via email. The device then indicates the specific procedures that need to be done next, conveying information to the user such as, "Please submit the death certificate at the city hall in three days." The input is the procedural schedule data, and the output is the notification message to the user.

[0488] Step 5:

[0489] The server identifies the documents required for the procedure and assists in obtaining them online. Using a document analysis API, it creates a list of necessary documents and presents the user with the corresponding online links. Automatic document identification and listing are examples of data processing. The input is key data related to the procedure, and the output is a list of documents accessible to the user.

[0490] Step 6:

[0491] The AI ​​agent proposes an optimal inheritance plan based on family structure and will information. Using the prompt "Please propose a specific procedural schedule in the event of a family member's death," the generation AI model generates an inheritance plan that meets the specified conditions. An optimized inheritance plan tailored to the user's conditions is output and displayed on the terminal. The input for this step is family structure and will information, and the output is a visually presented inheritance plan.

[0492] (Application Example 1)

[0493] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0494] In end-of-life planning and post-death procedures, users typically face numerous complex procedures and a large volume of required documents. A problem exists in the lack of support systems to ensure these procedures are carried out smoothly and at the appropriate time. Furthermore, properly considering family structure and will information in inheritance procedures is difficult, often requiring the assistance of experts, which places a significant burden on users. Additionally, the lack of visually clear and easy-to-understand information systems further increases the burden on users.

[0495] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0496] In this invention, the server includes means for acquiring the user's basic information and storing it in a recording device, means for generating a timeline of necessary tasks based on the stored information, and means for intuitively displaying procedural information to the user using a visual information device. As a result, the user can efficiently manage complex procedures, intuitively understand the necessary information, and smoothly proceed with end-of-life planning and post-death procedures.

[0497] "User basic information" refers to data including the individual's profile and wishes necessary for end-of-life planning and post-death procedures.

[0498] A "recording device" is a data storage device used to store acquired information.

[0499] "Accumulated information" refers to a collection of basic user information stored on a recording device.

[0500] A "work timeline" is a schedule that arranges each step required for a procedure in the order in which it progresses.

[0501] "Visual information devices" are devices that present information to users visually, and examples include smart glasses and head-mounted displays.

[0502] "Procedural information" refers to detailed instructions and guides regarding specific end-of-life and post-death procedures.

[0503] This invention is a system that reduces the various burdens associated with end-of-life planning and post-death procedures, and supports a smooth process. The program includes the following configuration and processing.

[0504] The server retrieves basic information from users via the internet and stores the data in a cloud-based storage device. This ensures that users' personal information and preferences are always accessible. Cloud database management systems (such as Amazon Web Services' RDS or Google Cloud SQL) are used for data management.

[0505] Based on this accumulated information, the program uses an AI model to generate a timeline of the tasks required for the procedure. This generation process utilizes a machine learning framework (e.g., TensorFlow) to efficiently create a schedule.

[0506] Based on this timeline, visual information devices visually present the user with the necessary procedural information. Using visual information devices such as smart glasses or head-mounted displays (e.g., Microsoft HoloLens), users are intuitively shown the progress of the procedure and the next steps to take.

[0507] For example, when a user uses smart glasses to check the next steps, the display on the glasses will show instructions such as, "The next step is a procedure at the government office. The necessary documents are a family register transcript and a resident registration certificate." Based on these instructions, the user can smoothly proceed with preparing for the procedure.

[0508] An example of a prompt is the instruction to a generative AI model: "Create an optimal schedule for procedures after a family member's death." This prompt automatically generates a list of necessary tasks and a timeline.

[0509] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0510] Step 1:

[0511] The server receives basic information from the user as input. This includes personal profile information and wishes related to end-of-life planning. The server stores this data in a cloud-based storage device and organizes it into a structured database for easy access. This data is used as foundational information for subsequent processing.

[0512] Step 2:

[0513] The server receives accumulated basic information as input and uses a generative AI model to generate a timeline of the tasks required for the procedure. Based on historical data and common procedural patterns, the model calculates the optimal order and timing for each task and outputs this as a timeline. This clarifies the overall picture of the procedure that the user needs to perform.

[0514] Step 3:

[0515] Based on the timeline, the device notifies the user to begin the process. The device generates and displays a notification message to guide the user through the details of the next actions to take. If necessary, specific instructions and a list of required documents are displayed to help the user understand the next steps.

[0516] Step 4:

[0517] Visual information devices receive procedural information from a timeline as input and present it to the user in an intuitive visual format. Smart glasses overlay the actions required at each stage to support the user's visual understanding. For example, they display the next procedure and a list of necessary documents to assist the user in preparing for the procedure.

[0518] Step 5:

[0519] The user performs specific procedural actions based on visual information. When ready, the terminal receives feedback from the user and notifies the server that the procedure is complete. The server selects the next procedural step from the timeline and prepares to continue the process.

[0520] The above steps ensure that end-of-life planning and post-death procedures are carried out efficiently and smoothly.

[0521] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0522] This invention is a system designed to facilitate end-of-life planning for users and procedures following the death of a family member, and by incorporating an emotional engine, it also aims to provide psychological support to users. This system is realized through the cooperation of a server, terminal, user, and emotional engine.

[0523] First, the server registers basic information and preference data provided by the user into a database. The emotion engine acquires emotional data from the user in real time using voice input and biosensors. This information is used to adjust how the procedure proceeds.

[0524] Next, the server combines registered data with emotional data to generate a schedule of necessary procedures. Before important procedures or high-stress processes, the emotional engine is used to make adjustments according to the user's mental condition. For example, if the user is feeling pressured, the schedule is moderately eased and necessary mental support information is provided.

[0525] The generated schedule and details of the emotionally-driven procedures are communicated to the user via the device. The device also provides the user with links to special counseling information and life care services as needed. This allows the user to proceed with the procedures while receiving emotional support.

[0526] Furthermore, the server works in conjunction with an emotion engine to reduce user stress and ensure a smooth process by assisting in the identification and online retrieval of necessary documents. The list of identified documents is presented in a user-friendly format.

[0527] The emotion engine monitors the user's emotional state in real time and provides immediate support via the device if a significant emotional shift is detected. This support includes recommending relaxation techniques and providing links to professional counselors. For example, users can receive guidance to regain their composure before making important decisions.

[0528] Thus, the present invention encompasses not only mechanical support for procedures but also support for maintaining emotional stability. This system considers the user's emotional state at every step and enhances engagement, enabling users to perform procedures in the most reassuring way possible.

[0529] The following describes the processing flow.

[0530] Step 1:

[0531] Users log into the system and enter their personal information and end-of-life planning preferences. In particular, they provide voice settings and biosensor information for use by the emotion engine. This step lays the foundation for the information the system needs.

[0532] Step 2:

[0533] The server registers the information entered by the user into the database. Simultaneously, the emotion engine analyzes the user's initial emotional state and prepares to store it in the database. This completes the basic dataset for specific procedural planning.

[0534] Step 3:

[0535] The server analyzes the registered information and automatically generates a procedure schedule. The emotion engine analyzes emotional data in real time and incorporates the emotional state as an adjustment factor for the schedule. At this point, an optimal schedule is created that takes into account the urgency of the procedure.

[0536] Step 4:

[0537] The device notifies the user of the generated procedure schedule. The notification includes the procedure deadline, detailed guides, and emotional support information. In particular, it offers suggestions for relaxation techniques during situations where the user might experience tension or anxiety.

[0538] Step 5:

[0539] Users receive notifications from their devices and follow the instructions to complete the process. An emotion engine monitors any emotional changes that occur during the process and provides support information that the user deems necessary. For example, a guide to exercises or breathing techniques might be sent before a procedure at the city hall.

[0540] Step 6:

[0541] The server lists the documents required for the procedure and identifies those available online. The emotion engine considers the user's emotional state and provides additional support to facilitate the document retrieval process. For example, a reminder function helps to make it easier to collect important documents.

[0542] Step 7:

[0543] The emotion engine optimizes inheritance planning suggestions based on the user's emotional data. During this process, the user receives suggestions that are tailored to their emotional state through their device. The plan is designed to minimize user stress.

[0544] Step 8:

[0545] Users can leverage the emotional analysis provided by the emotion engine to perform inheritance procedures that best suit their feelings. If the emotion engine detects anxiety or confusion, it will provide additional support. This allows users to proceed with the procedures with peace of mind.

[0546] (Example 2)

[0547] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0548] In modern society, it is difficult for individuals to smoothly navigate end-of-life procedures or the procedures required when a family member dies. In particular, organizing the complex information related to these procedures and coping with the emotional stress involved are burdensome for individuals. Furthermore, there are many situations where procedures must be conducted while considering the emotional state of the individual, and there is a need for systems that can effectively support these needs.

[0549] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0550] In this invention, the server includes means for collecting user information and registering it in a database, means for detecting the user's emotional state and acquiring and analyzing relevant information in real time, and means for generating a schedule of necessary procedures based on the registered information and emotional data, and making adjustments according to the user's mental state. This reduces the burden on the user and enables the smooth progress of procedures while taking the emotional state into consideration.

[0551] "User information" refers to basic personal information necessary for the procedure, as well as information including specific wishes and requests.

[0552] A "database" is an information system used to systematically store and manage collected data.

[0553] "Emotional state" refers to data that indicates the user's psychological and mental condition, and is acquired in real time from sources such as voice tone and signals from biosensors.

[0554] A "procedure schedule" is a plan that outlines the order and timing of a series of procedures that a user must perform.

[0555] "Mental support" refers to the provision of support information and activities aimed at reducing the stress and anxiety experienced by users and promoting emotional stability.

[0556] "Document identification" refers to the process of identifying the documents and certificates necessary to carry out a procedure and clearly indicating their contents to the user.

[0557] "User emotional changes" refer to changes in a user's emotional state that occur over time or in response to changes in specific circumstances.

[0558] This system is designed to streamline procedures during end-of-life care for users and in the event of a family member's death, and it also provides psychological support to users through the use of an emotion engine. This system is primarily realized through the coordination of a server, terminals, users, and the emotion engine.

[0559] The server first registers basic information and preference data provided by the user using a database system (e.g., MySQL or PostgreSQL). This allows the server to efficiently organize and store all necessary information about the user.

[0560] Next, the emotion engine acquires the user's emotional data in real time through voice input devices and biosensors (e.g., smartwatches and other wearable devices). This allows the server to continuously monitor the user's emotional state and adjust the way procedures proceed accordingly.

[0561] Utilizing a generative AI model, the server generates a procedure schedule based on registered data and sentiment data. This schedule is automated by an RPA tool, providing the user with the most optimal steps. For example, if a user is experiencing stress, the server adjusts the schedule to make the procedure more flexible.

[0562] The device notifies the user of the generated schedule and details of the procedures. Through a user-friendly application, the device also provides special counseling information and links to relevant life care services. This allows the user to proceed with the procedures while receiving emotional support.

[0563] Furthermore, the server works with an emotion engine to reduce user stress by assisting in identifying and retrieving documents online. The list of identified documents is displayed on the device in a format that is easy for the user to access.

[0564] For example, by using a prompt such as, "Tell me how to relax before filing an insurance claim," the AI ​​model will provide relaxation techniques and advice tailored to the user. This allows the user to make important decisions with a sense of security.

[0565] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0566] Step 1:

[0567] Users input basic information and data regarding their preferences through a terminal. This input includes name, address, contact information, and desired procedures. This information is transmitted via the terminal to a server and stored in a database. The server uses a database system to organize the data structurally. The output of this process is the user information stored in the database.

[0568] Step 2:

[0569] The server works in conjunction with the emotion engine to collect user emotional data. This process utilizes biosensors and voice input devices to obtain real-time input such as the user's heart rate and voice tone. The server analyzes the input data using the emotion engine and evaluates the user's emotional state. The output of this process is the server's evaluation data of the user's emotional state.

[0570] Step 3:

[0571] The server uses a generative AI model to generate a schedule of necessary procedures based on registered user information and emotional data. It utilizes the user's basic information, preferences, and emotional state as input, and the AI ​​algorithm calculates the optimal steps. Specifically, high-stress procedures are incorporated into the schedule with buffer time, and adjustments are made according to the user's needs. The output of this process is the generated procedure schedule.

[0572] Step 4:

[0573] The terminal notifies the user of the generated schedule. The schedule and procedure details obtained as output are sent to the terminal and displayed visually to the user. The terminal sends a push notification to the user's screen, guiding them through the specific date and time, procedure details, and necessary items. The output of this process is procedure information presented in a user-friendly format.

[0574] Step 5:

[0575] The server identifies the documents the user needs and assists in their retrieval. It utilizes scheduled procedural information as input to list documents available online. This list is sent to the terminal and displayed in a user-friendly format. Specifically, links to digital copies and printing guides are also provided. The output of this process is a list of documents prepared for the user.

[0576] Step 6:

[0577] The device continuously monitors changes in the user's emotional state and provides immediate support if an anomaly is detected. It receives real-time data on the user's emotional state as input and selects appropriate actions based on evaluations from the emotion engine. This may include displaying relaxation techniques or providing links to counseling services. The output of this process is support information tailored to the user's emotional changes.

[0578] (Application Example 2)

[0579] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0580] In modern society, the elderly and their families often face a vast amount of paperwork, legal procedures, and emotional burden in end-of-life planning. End-of-life planning not only requires time and effort but also causes significant mental stress, potentially negatively impacting the user's physical and mental health. This invention aims to provide a system that reduces the psychological burden on users during such end-of-life planning and supports the smooth progress of the process.

[0581] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0582] In this invention, the server includes means for registering the user's basic data and preferences in a database, means for adjusting the procedure schedule using collected emotional data, and means for providing mental support information according to the user's emotional state. As a result, the user can reduce the psychological burden of proceeding with end-of-life planning, manage the necessary procedures appropriately, and proceed with the procedures with peace of mind by obtaining relaxation methods and contact information for specialists.

[0583] "User basic data" refers to personal information such as the user's name, age, contact information, and preferences.

[0584] "Emotional data" refers to data obtained through the emotion engine that indicates the user's emotional state.

[0585] The "procedure schedule" refers to a plan outlining the specific procedures related to the user's end-of-life planning, including the necessary steps and their timing.

[0586] "Mental support information" refers to psychological support information provided to reduce the stress and anxiety that users experience during the process.

[0587] "Smart devices" refer to mobile information terminals and network-connected devices that collect, notify, and manage information.

[0588] "Electronically available documents" refer to official documents that are accessible online and can be downloaded or printed as needed.

[0589] "Relaxation techniques" refer to methods and techniques for alleviating mental tension and fatigue, and are means of regulating the autonomic nervous system.

[0590] "Contact information for experts" refers to contact information for professionals who are qualified to provide advice on end-of-life planning or specific processes.

[0591] The system of the present invention supports users in end-of-life planning procedures and functions through the collaboration of a server, a terminal, and an emotion engine. The server registers basic data provided by the user in a database and generates emotion data to use for scheduling. Specific data processing includes real-time emotion data collection by the emotion engine. The emotion engine analyzes the user's emotional state through voice input and biosensors and transmits the results to the server.

[0592] Based on this emotional data and registered basic data, the server automatically adjusts the procedure schedule and generates mental support information. This information is intended to alleviate anxiety and stress experienced by the user during the procedure. For example, it may include suggestions for relaxation techniques and contact information for specialists.

[0593] The terminal notifies the user of procedure details and mental support information sent from the server. Smartphones and other mobile devices are used for these notifications. The terminal also displays a list of documents the user needs and supports their online retrieval.

[0594] Users can utilize the information provided by the server to proceed with end-of-life planning with peace of mind. Furthermore, by using an emotional engine, the system can respond to the user's emotional changes in real time. In particular, when stress levels rise, counseling information is provided to facilitate a swift response.

[0595] For example, if an elderly user experiences stress while performing complex procedures, the server can quickly provide guidance on relaxation techniques and contact information for specialists via the terminal.

[0596] Examples of prompt statements are as follows:

[0597] "Generate notification messages using the provided data, suggesting relaxation methods when the user's stress level is high. The messages should be simple and geared towards the elderly."

[0598] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0599] Step 1:

[0600] The server registers the user's basic data in the database. It receives data such as the user's name, age, contact information, and preferences as input. The server organizes this input data and stores it in the database to manage the information necessary for future procedures. The output is the user's basic data correctly registered.

[0601] Step 2:

[0602] The emotion engine collects user emotional data in real time. It takes voice input and data from biosensors as input. The emotion engine analyzes this data to evaluate the user's current emotional state. The output is emotional data indicating the user's stress and anxiety levels.

[0603] Step 3:

[0604] The server adjusts the procedure schedule using collected emotional and basic data. It receives registered user data and emotional data as input. Based on this data, the server generates an appropriate schedule and determines mental support information. The output is an emotionally adjusted procedure schedule and support information.

[0605] Step 4:

[0606] The terminal notifies the user of schedule and support information sent from the server. It receives schedule information and mental support messages from the server as input. The terminal displays this information in a user-friendly format and issues alerts to draw the user's attention if necessary. The output is a notification displayed on the user's terminal screen.

[0607] Step 5:

[0608] The server identifies the electronic documents necessary for end-of-life planning and provides links to assist in their acquisition. It receives the user's basic data and related procedural information as input. Based on this information, the server searches for electronic documents and generates online access links. The output is a list of documents, including the links.

[0609] Step 6:

[0610] If a user experiences stress during the process, the terminal provides relaxation techniques and contact information for professionals. Inputs include user feedback and alerts from the server. The terminal quickly displays necessary information and provides guidance to help the user relax. Outputs include explanations of relaxation techniques and contact information for professionals.

[0611] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0612] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0613] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0614] [Fourth Embodiment]

[0615] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0616] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0617] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0618] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0619] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0620] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0621] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0622] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0623] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0624] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0625] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0626] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0627] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0628] This invention is a system designed to facilitate end-of-life planning and procedures following the death of a family member. This system functions through interaction between a server, a terminal, and the user.

[0629] First, the server receives basic information and requested data provided by the user and registers it in the database. This makes the basic data necessary for subsequent procedures available.

[0630] Next, the server automatically generates a schedule of necessary procedures based on the registered data. For example, when a family member dies, the schedule would include filing a death certificate, arranging the funeral, and settling the estate. This schedule is designed to display a list of procedures that the user must complete in chronological order.

[0631] The generated schedule and procedural details will be communicated to the user via the device. The notifications are designed to be timely and support the user in following the procedures without forgetting. For example, if the user feels unsure of what to do next, the device will provide specific guidance such as, "The next step is to submit the death certificate at the city hall. The required documents are XX."

[0632] Furthermore, many procedures require multiple documents. The server has a mechanism that automatically identifies the necessary documents related to a particular procedure and assists in obtaining them online. This frees users from the cumbersome task of collecting documents.

[0633] Furthermore, based on family structure and existing wills, the AI ​​agent proposes an appropriate inheritance plan. This plan is displayed visually and clearly on the device, designed to allow users to proceed with inheritance procedures smoothly.

[0634] As a concrete example, when a user with a complex family structure uses the system, inheritance planning that would normally require consultation with a specialist is largely covered within the system. Based on the presented inheritance plan, the user can proceed with specific distribution plans and procedures.

[0635] Thus, the present invention aims to alleviate the worries and burdens that users face regarding end-of-life planning and post-death procedures, and to support them in proceeding with these procedures more smoothly.

[0636] The following describes the processing flow.

[0637] Step 1:

[0638] Users register with the system and enter basic information such as their name, address, contact information, family structure, and any special wishes regarding end-of-life planning. This information is used for the initial system setup and subsequent procedures.

[0639] Step 2:

[0640] The server receives the information entered in Step 1 and stores it in the database. Based on the registered information, it determines the necessity of the procedure and prepares to generate the optimal schedule.

[0641] Step 3:

[0642] The server generates a post-death procedure schedule. This includes filing the death certificate, scheduling funeral arrangements, and planning procedures for settling the estate. This schedule is arranged in a reasonable order, taking into account necessary deadlines.

[0643] Step 4:

[0644] The device notifies the user of the generated procedure schedule. The notification is sent via email or a dedicated app and includes details of the procedure and required actions. Alerts are also set for the appropriate timing.

[0645] Step 5:

[0646] The user will follow the notifications received via their device and begin specific procedures. For example, they may submit a death certificate to the city hall with the required documents, or they may proceed with arrangements with a funeral home.

[0647] Step 6:

[0648] The server identifies the documents required for each procedure and assists users in retrieving them online upon request. It also provides users with templates and instructions on how to obtain the identified documents.

[0649] Step 7:

[0650] The AI ​​agent analyzes the user's family structure and will contents to generate an optimal inheritance plan. It then presents the generated plan to the user via their device, supporting them in ensuring a smooth inheritance process.

[0651] Step 8:

[0652] Based on the inheritance plan provided by the AI ​​agent, the user will carry out the necessary legal procedures. For example, they will discuss and decide on the method of asset distribution among family members.

[0653] In this way, processing across the entire system is coordinated, allowing users to systematically and efficiently carry out complex procedures.

[0654] (Example 1)

[0655] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0656] In modern times, users must manage a large amount of information to smoothly carry out end-of-life planning and the procedures required after the death of a family member. This includes gathering information, managing the schedule of complex procedures, and identifying and obtaining necessary documents, all of which require a high level of knowledge. The present invention aims to provide a system that automates these complex and burdensome tasks faced by users, and supports them efficiently and effectively.

[0657] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0658] In this invention, the server includes means for collecting basic user information and desired information and registering it in an information storage unit, means for automatically generating a procedure plan based on the registered information, and means for identifying the materials necessary for the procedure and assisting in their electronic acquisition. As a result, users can not only complete all necessary procedures without omission, but also proceed with the entire process without spending time and effort.

[0659] "Users" refers to individuals who use this system to receive support for end-of-life planning and post-death procedures.

[0660] "Basic information" refers to personal information about the user, such as name, address, and contact information, and includes the initial data necessary for the procedure.

[0661] "Desired information" refers to the wishes and conditions that users want to fulfill in future procedures, and includes individual requests regarding end-of-life planning and inheritance.

[0662] The "information storage unit" refers to the database and storage that the server uses to manage and store information.

[0663] "Procedure planning" refers to a schedule that organizes the series of procedures and steps required by the user in chronological order, outlining the items that need to be carried out.

[0664] "Identifying documents" refers to the process of selecting specific documents or evidence necessary for a procedure.

[0665] "Assisting with electronic acquisition" refers to providing support for efficiently downloading necessary materials and documents online.

[0666] A "server" refers to a computer system that handles information processing and data management for the entire system.

[0667] A "generative AI model" refers to an artificial intelligence model that is responsible for the automatic generation and optimization of procedures and plans.

[0668] A "prompt statement" refers to a specific instruction given to operate a generative AI model.

[0669] This invention is a system that facilitates end-of-life planning and post-death procedures, and is realized through the interaction of a server, terminal, and user.

[0670] First, users register their basic information and preferences with the system via an input device. This is done using a web application or a dedicated app, allowing users to provide the necessary information by filling out a simple form.

[0671] Next, the server receives this information and stores it in a database such as MySQL or PostgreSQL. This accumulates the basic data necessary for subsequent procedures. The server uses a Python script to analyze the information and automatically generate a procedure plan. A generative AI model is used here to generate a detailed procedure schedule based on the registered information.

[0672] The generated schedule is notified to the user via the device. The device is configured to provide users with timely information via a smartphone app or email, so they know what procedures they need to follow. The notification is in the form of a specific action prompt, such as "Please submit the death certificate at the city hall in 3 days."

[0673] Furthermore, the server is configured to automatically identify the documents required for a procedure and assist users in obtaining them online. To achieve this, it utilizes a document analysis API to present a list of available documents and the procedures for obtaining them, thereby saving users time.

[0674] Furthermore, the AI ​​agent proposes an inheritance plan based on family structure and will information. The generative AI model used for this purpose takes various conditions into consideration and displays an optimized inheritance plan on the device. The user can then carry out specific procedures based on the provided plan.

[0675] For example, if a user inputs a prompt such as, "Please suggest a specific procedural schedule for when a family member dies. Please include the necessary items for filing a death certificate, funeral arrangements, and estate settlement," the AI ​​will provide a detailed schedule of the relevant procedures. In this way, the present invention aims to reduce the burden on users and improve the efficiency of procedures.

[0676] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0677] Step 1:

[0678] Users input basic and desired information using a web application or dedicated app as their input device. Specifically, they enter data such as their name, address, contact information, family structure, and end-of-life planning preferences into a form and submit it to the system. The input in this step is information from the user, and the output is that this information is registered in the system.

[0679] Step 2:

[0680] The server stores the received user information in a database. For example, it saves the received information to a database such as MySQL or PostgreSQL to build a basic user profile. This process involves receiving raw data sent by the user, formatting it into an existing data structure, and then storing it. The output is organized user information.

[0681] Step 3:

[0682] The server automatically generates a procedural plan using registered user information. At this stage, a Python script is executed, and an AI model is used to generate an appropriate procedural schedule. Specifically, the system analyzes the information and organizes tasks such as death registration, funeral arrangements, and estate settlement in chronological order. The input is user information, and the output is a detailed procedural schedule.

[0683] Step 4:

[0684] The device notifies the user of the generated procedural schedule. Specifically, reminders are sent to the user via apps on the device or via email. The device then indicates the specific procedures that need to be done next, conveying information to the user such as, "Please submit the death certificate at the city hall in three days." The input is the procedural schedule data, and the output is the notification message to the user.

[0685] Step 5:

[0686] The server identifies the documents required for the procedure and assists in obtaining them online. Using a document analysis API, it creates a list of necessary documents and presents the user with the corresponding online links. Automatic document identification and listing are examples of data processing. The input is key data related to the procedure, and the output is a list of documents accessible to the user.

[0687] Step 6:

[0688] The AI ​​agent proposes an optimal inheritance plan based on family structure and will information. Using the prompt "Please propose a specific procedural schedule in the event of a family member's death," the generation AI model generates an inheritance plan that meets the specified conditions. An optimized inheritance plan tailored to the user's conditions is output and displayed on the terminal. The input for this step is family structure and will information, and the output is a visually presented inheritance plan.

[0689] (Application Example 1)

[0690] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0691] In end-of-life planning and post-death procedures, users typically face numerous complex procedures and a large volume of required documents. A problem exists in the lack of support systems to ensure these procedures are carried out smoothly and at the appropriate time. Furthermore, properly considering family structure and will information in inheritance procedures is difficult, often requiring the assistance of experts, which places a significant burden on users. Additionally, the lack of visually clear and easy-to-understand information systems further increases the burden on users.

[0692] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0693] In this invention, the server includes means for acquiring the user's basic information and storing it in a recording device, means for generating a timeline of necessary tasks based on the stored information, and means for intuitively displaying procedural information to the user using a visual information device. As a result, the user can efficiently manage complex procedures, intuitively understand the necessary information, and smoothly proceed with end-of-life planning and post-death procedures.

[0694] "User basic information" refers to data including the individual's profile and wishes necessary for end-of-life planning and post-death procedures.

[0695] A "recording device" is a data storage device used to store acquired information.

[0696] "Accumulated information" refers to a collection of basic user information stored on a recording device.

[0697] A "work timeline" is a schedule that arranges each step required for a procedure in the order in which it progresses.

[0698] "Visual information devices" are devices that present information to users visually, and examples include smart glasses and head-mounted displays.

[0699] "Procedural information" refers to detailed instructions and guides regarding specific end-of-life and post-death procedures.

[0700] This invention is a system that reduces the various burdens associated with end-of-life planning and post-death procedures, and supports a smooth process. The program includes the following configuration and processing.

[0701] The server retrieves basic information from users via the internet and stores the data in a cloud-based storage device. This ensures that users' personal information and preferences are always accessible. Cloud database management systems (such as Amazon Web Services' RDS or Google Cloud SQL) are used for data management.

[0702] Based on this accumulated information, the program uses an AI model to generate a timeline of the tasks required for the procedure. This generation process utilizes a machine learning framework (e.g., TensorFlow) to efficiently create a schedule.

[0703] Based on this timeline, visual information devices visually present the user with the necessary procedural information. Using visual information devices such as smart glasses or head-mounted displays (e.g., Microsoft HoloLens), users are intuitively shown the progress of the procedure and the next steps to take.

[0704] For example, when a user uses smart glasses to check the next steps, the display on the glasses will show instructions such as, "The next step is a procedure at the government office. The necessary documents are a family register transcript and a resident registration certificate." Based on these instructions, the user can smoothly proceed with preparing for the procedure.

[0705] An example of a prompt is the instruction to a generative AI model: "Create an optimal schedule for procedures after a family member's death." This prompt automatically generates a list of necessary tasks and a timeline.

[0706] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0707] Step 1:

[0708] The server receives basic information from the user as input. This includes personal profile information and wishes related to end-of-life planning. The server stores this data in a cloud-based storage device and organizes it into a structured database for easy access. This data is used as foundational information for subsequent processing.

[0709] Step 2:

[0710] The server receives accumulated basic information as input and uses a generative AI model to generate a timeline of the tasks required for the procedure. Based on historical data and common procedural patterns, the model calculates the optimal order and timing for each task and outputs this as a timeline. This clarifies the overall picture of the procedure that the user needs to perform.

[0711] Step 3:

[0712] Based on the timeline, the device notifies the user to begin the process. The device generates and displays a notification message to guide the user through the details of the next actions to take. If necessary, specific instructions and a list of required documents are displayed to help the user understand the next steps.

[0713] Step 4:

[0714] Visual information devices receive procedural information from a timeline as input and present it to the user in an intuitive visual format. Smart glasses overlay the actions required at each stage to support the user's visual understanding. For example, they display the next procedure and a list of necessary documents to assist the user in preparing for the procedure.

[0715] Step 5:

[0716] The user performs specific procedural actions based on visual information. When ready, the terminal receives feedback from the user and notifies the server that the procedure is complete. The server selects the next procedural step from the timeline and prepares to continue the process.

[0717] The above steps ensure that end-of-life planning and post-death procedures are carried out efficiently and smoothly.

[0718] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0719] This invention is a system designed to facilitate end-of-life planning for users and procedures following the death of a family member, and by incorporating an emotional engine, it also aims to provide psychological support to users. This system is realized through the cooperation of a server, terminal, user, and emotional engine.

[0720] First, the server registers basic information and preference data provided by the user into a database. The emotion engine acquires emotional data from the user in real time using voice input and biosensors. This information is used to adjust how the procedure proceeds.

[0721] Next, the server combines registered data with emotional data to generate a schedule of necessary procedures. Before important procedures or high-stress processes, the emotional engine is used to make adjustments according to the user's mental condition. For example, if the user is feeling pressured, the schedule is moderately eased and necessary mental support information is provided.

[0722] The generated schedule and details of the emotionally-driven procedures are communicated to the user via the device. The device also provides the user with links to special counseling information and life care services as needed. This allows the user to proceed with the procedures while receiving emotional support.

[0723] Furthermore, the server works in conjunction with an emotion engine to reduce user stress and ensure a smooth process by assisting in the identification and online retrieval of necessary documents. The list of identified documents is presented in a user-friendly format.

[0724] The emotion engine monitors the user's emotional state in real time and provides immediate support via the device if a significant emotional shift is detected. This support includes recommending relaxation techniques and providing links to professional counselors. For example, users can receive guidance to regain their composure before making important decisions.

[0725] Thus, the present invention encompasses not only mechanical support for procedures but also support for maintaining emotional stability. This system considers the user's emotional state at every step and enhances engagement, enabling users to perform procedures in the most reassuring way possible.

[0726] The following describes the processing flow.

[0727] Step 1:

[0728] Users log into the system and enter their personal information and end-of-life planning preferences. In particular, they provide voice settings and biosensor information for use by the emotion engine. This step lays the foundation for the information the system needs.

[0729] Step 2:

[0730] The server registers the information entered by the user into the database. Simultaneously, the emotion engine analyzes the user's initial emotional state and prepares to store it in the database. This completes the basic dataset for specific procedural planning.

[0731] Step 3:

[0732] The server analyzes the registered information and automatically generates a procedure schedule. The emotion engine analyzes emotional data in real time and incorporates the emotional state as an adjustment factor for the schedule. At this point, an optimal schedule is created that takes into account the urgency of the procedure.

[0733] Step 4:

[0734] The device notifies the user of the generated procedure schedule. The notification includes the procedure deadline, detailed guides, and emotional support information. In particular, it offers suggestions for relaxation techniques during situations where the user might experience tension or anxiety.

[0735] Step 5:

[0736] Users receive notifications from their devices and follow the instructions to complete the process. An emotion engine monitors any emotional changes that occur during the process and provides support information that the user deems necessary. For example, a guide to exercises or breathing techniques might be sent before a procedure at the city hall.

[0737] Step 6:

[0738] The server lists the documents required for the procedure and identifies those available online. The emotion engine considers the user's emotional state and provides additional support to facilitate the document retrieval process. For example, a reminder function helps to make it easier to collect important documents.

[0739] Step 7:

[0740] The emotion engine optimizes inheritance planning suggestions based on the user's emotional data. During this process, the user receives suggestions that are tailored to their emotional state through their device. The plan is designed to minimize user stress.

[0741] Step 8:

[0742] Users can leverage the emotional analysis provided by the emotion engine to perform inheritance procedures that best suit their feelings. If the emotion engine detects anxiety or confusion, it will provide additional support. This allows users to proceed with the procedures with peace of mind.

[0743] (Example 2)

[0744] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0745] In modern society, it is difficult for individuals to smoothly navigate end-of-life procedures or the procedures required when a family member dies. In particular, organizing the complex information related to these procedures and coping with the emotional stress involved are burdensome for individuals. Furthermore, there are many situations where procedures must be conducted while considering the emotional state of the individual, and there is a need for systems that can effectively support these needs.

[0746] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0747] In this invention, the server includes means for collecting user information and registering it in a database, means for detecting the user's emotional state and acquiring and analyzing relevant information in real time, and means for generating a schedule of necessary procedures based on the registered information and emotional data, and making adjustments according to the user's mental state. This reduces the burden on the user and enables the smooth progress of procedures while taking the emotional state into consideration.

[0748] "User information" refers to basic personal information necessary for the procedure, as well as information including specific wishes and requests.

[0749] A "database" is an information system used to systematically store and manage collected data.

[0750] "Emotional state" refers to data that indicates the user's psychological and mental condition, and is acquired in real time from sources such as voice tone and signals from biosensors.

[0751] A "procedure schedule" is a plan that outlines the order and timing of a series of procedures that a user must perform.

[0752] "Mental support" refers to the provision of support information and activities aimed at reducing the stress and anxiety experienced by users and promoting emotional stability.

[0753] "Document identification" refers to the process of identifying the documents and certificates necessary to carry out a procedure and clearly indicating their contents to the user.

[0754] "User emotional changes" refer to changes in a user's emotional state that occur over time or in response to changes in specific circumstances.

[0755] This system is designed to streamline procedures during end-of-life care for users and in the event of a family member's death, and it also provides psychological support to users through the use of an emotion engine. This system is primarily realized through the coordination of a server, terminals, users, and the emotion engine.

[0756] The server first registers basic information and preference data provided by the user using a database system (e.g., MySQL or PostgreSQL). This allows the server to efficiently organize and store all necessary information about the user.

[0757] Next, the emotion engine acquires the user's emotional data in real time through voice input devices and biosensors (e.g., smartwatches and other wearable devices). This allows the server to continuously monitor the user's emotional state and adjust the way procedures proceed accordingly.

[0758] Utilizing a generative AI model, the server generates a procedure schedule based on registered data and sentiment data. This schedule is automated by an RPA tool, providing the user with the most optimal steps. For example, if a user is experiencing stress, the server adjusts the schedule to make the procedure more flexible.

[0759] The device notifies the user of the generated schedule and details of the procedures. Through a user-friendly application, the device also provides special counseling information and links to relevant life care services. This allows the user to proceed with the procedures while receiving emotional support.

[0760] Furthermore, the server works with an emotion engine to reduce user stress by assisting in identifying and retrieving documents online. The list of identified documents is displayed on the device in a format that is easy for the user to access.

[0761] For example, by using a prompt such as, "Tell me how to relax before filing an insurance claim," the AI ​​model will provide relaxation techniques and advice tailored to the user. This allows the user to make important decisions with a sense of security.

[0762] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0763] Step 1:

[0764] Users input basic information and data regarding their preferences through a terminal. This input includes name, address, contact information, and desired procedures. This information is transmitted via the terminal to a server and stored in a database. The server uses a database system to organize the data structurally. The output of this process is the user information stored in the database.

[0765] Step 2:

[0766] The server works in conjunction with the emotion engine to collect user emotional data. This process utilizes biosensors and voice input devices to obtain real-time input such as the user's heart rate and voice tone. The server analyzes the input data using the emotion engine and evaluates the user's emotional state. The output of this process is the server's evaluation data of the user's emotional state.

[0767] Step 3:

[0768] The server uses a generative AI model to generate a schedule of necessary procedures based on registered user information and emotional data. It utilizes the user's basic information, preferences, and emotional state as input, and the AI ​​algorithm calculates the optimal steps. Specifically, high-stress procedures are incorporated into the schedule with buffer time, and adjustments are made according to the user's needs. The output of this process is the generated procedure schedule.

[0769] Step 4:

[0770] The terminal notifies the user of the generated schedule. The schedule and procedure details obtained as output are sent to the terminal and displayed visually to the user. The terminal sends a push notification to the user's screen, guiding them through the specific date and time, procedure details, and necessary items. The output of this process is procedure information presented in a user-friendly format.

[0771] Step 5:

[0772] The server identifies the documents the user needs and assists in their retrieval. It utilizes scheduled procedural information as input to list documents available online. This list is sent to the terminal and displayed in a user-friendly format. Specifically, links to digital copies and printing guides are also provided. The output of this process is a list of documents prepared for the user.

[0773] Step 6:

[0774] The device continuously monitors changes in the user's emotional state and provides immediate support if an anomaly is detected. It receives real-time data on the user's emotional state as input and selects appropriate actions based on evaluations from the emotion engine. This may include displaying relaxation techniques or providing links to counseling services. The output of this process is support information tailored to the user's emotional changes.

[0775] (Application Example 2)

[0776] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0777] In modern society, the elderly and their families often face a vast amount of paperwork, legal procedures, and emotional burden in end-of-life planning. End-of-life planning not only requires time and effort but also causes significant mental stress, potentially negatively impacting the user's physical and mental health. This invention aims to provide a system that reduces the psychological burden on users during such end-of-life planning and supports the smooth progress of the process.

[0778] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0779] In this invention, the server includes means for registering the user's basic data and preferences in a database, means for adjusting the procedure schedule using collected emotional data, and means for providing mental support information according to the user's emotional state. As a result, the user can reduce the psychological burden of proceeding with end-of-life planning, manage the necessary procedures appropriately, and proceed with the procedures with peace of mind by obtaining relaxation methods and contact information for specialists.

[0780] "User basic data" refers to personal information such as the user's name, age, contact information, and preferences.

[0781] "Emotional data" refers to data obtained through the emotion engine that indicates the user's emotional state.

[0782] The "procedure schedule" refers to a plan outlining the specific procedures related to the user's end-of-life planning, including the necessary steps and their timing.

[0783] "Mental support information" refers to psychological support information provided to reduce the stress and anxiety that users experience during the process.

[0784] "Smart devices" refer to mobile information terminals and network-connected devices that collect, notify, and manage information.

[0785] "Electronically available documents" refer to official documents that are accessible online and can be downloaded or printed as needed.

[0786] "Relaxation techniques" refer to methods and techniques for alleviating mental tension and fatigue, and are means of regulating the autonomic nervous system.

[0787] "Contact information for experts" refers to contact information for professionals who are qualified to provide advice on end-of-life planning or specific processes.

[0788] The system of the present invention supports users in end-of-life planning procedures and functions through the collaboration of a server, a terminal, and an emotion engine. The server registers basic data provided by the user in a database and generates emotion data to use for scheduling. Specific data processing includes real-time emotion data collection by the emotion engine. The emotion engine analyzes the user's emotional state through voice input and biosensors and transmits the results to the server.

[0789] Based on this emotional data and registered basic data, the server automatically adjusts the procedure schedule and generates mental support information. This information is intended to alleviate anxiety and stress experienced by the user during the procedure. For example, it may include suggestions for relaxation techniques and contact information for specialists.

[0790] The terminal notifies the user of procedure details and mental support information sent from the server. Smartphones and other mobile devices are used for these notifications. The terminal also displays a list of documents the user needs and supports their online retrieval.

[0791] Users can utilize the information provided by the server to proceed with end-of-life planning with peace of mind. Furthermore, by using an emotional engine, the system can respond to the user's emotional changes in real time. In particular, when stress levels rise, counseling information is provided to facilitate a swift response.

[0792] For example, if an elderly user experiences stress while performing complex procedures, the server can quickly provide guidance on relaxation techniques and contact information for specialists via the terminal.

[0793] Examples of prompt statements are as follows:

[0794] "Generate notification messages using the provided data, suggesting relaxation methods when the user's stress level is high. The messages should be simple and geared towards the elderly."

[0795] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0796] Step 1:

[0797] The server registers the user's basic data in the database. It receives data such as the user's name, age, contact information, and preferences as input. The server organizes this input data and stores it in the database to manage the information necessary for future procedures. The output is the user's basic data correctly registered.

[0798] Step 2:

[0799] The emotion engine collects user emotional data in real time. It takes voice input and data from biosensors as input. The emotion engine analyzes this data to evaluate the user's current emotional state. The output is emotional data indicating the user's stress and anxiety levels.

[0800] Step 3:

[0801] The server adjusts the procedure schedule using collected emotional and basic data. It receives registered user data and emotional data as input. Based on this data, the server generates an appropriate schedule and determines mental support information. The output is an emotionally adjusted procedure schedule and support information.

[0802] Step 4:

[0803] The terminal notifies the user of schedule and support information sent from the server. It receives schedule information and mental support messages from the server as input. The terminal displays this information in a user-friendly format and issues alerts to draw the user's attention if necessary. The output is a notification displayed on the user's terminal screen.

[0804] Step 5:

[0805] The server identifies the electronic documents necessary for end-of-life planning and provides links to assist in their acquisition. It receives the user's basic data and related procedural information as input. Based on this information, the server searches for electronic documents and generates online access links. The output is a list of documents, including the links.

[0806] Step 6:

[0807] If a user experiences stress during the process, the terminal provides relaxation techniques and contact information for professionals. Inputs include user feedback and alerts from the server. The terminal quickly displays necessary information and provides guidance to help the user relax. Outputs include explanations of relaxation techniques and contact information for professionals.

[0808] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0809] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0810] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0811] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0812] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0813] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0814] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0815] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0816] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0817] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0818] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0819] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0820] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0821] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0822] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0823] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0824] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0825] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0826] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0827] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0828] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference.

[0829] The following is further disclosed regarding the embodiments described above.

[0830] (Claim 1)

[0831] A means of collecting user information and registering it in a database,

[0832] A means of generating a schedule of necessary procedures based on registration information,

[0833] A means to notify the user of the start of the procedure and guide them through the details according to the generated schedule,

[0834] A means to help identify and obtain the necessary documents online for the procedure,

[0835] A system that includes means for proposing inheritance plans based on family structure and will information.

[0836] (Claim 2)

[0837] The system according to claim 1, comprising means for providing information on care services and health management based on the user's age and health condition.

[0838] (Claim 3)

[0839] The system according to claim 1, comprising means for displaying a list of documents to be presented to the user and assisting in the acquisition and organization of necessary documents.

[0840] "Example 1"

[0841] (Claim 1)

[0842] A means of collecting basic user information and preference information and registering it in the information storage unit,

[0843] A means of automatically generating a procedural plan based on registered information,

[0844] A means of notifying users to begin the procedure and providing detailed instructions via an automatically generated plan,

[0845] A means to identify the documents required for the procedure and assist in obtaining them electronically,

[0846] A system that includes means for presenting a plan for the transfer of assets based on family structure and will information.

[0847] (Claim 2)

[0848] The system according to claim 1, which uses a generation AI model to present the optimal list of documents to retrieve and assists in the electronic organization of documents.

[0849] (Claim 3)

[0850] The system according to claim 1, which generates specific procedural actions for the user using prompt statements.

[0851] "Application Example 1"

[0852] (Claim 1)

[0853] A means of acquiring basic user information and storing it in a recording device,

[0854] A means for generating a timeline of necessary tasks based on accumulated information,

[0855] A means of notifying the user of the start of work and providing detailed instructions according to the generated timeline,

[0856] A means of advising on identifying the materials needed for the work and obtaining them through digital means,

[0857] A means of presenting a plan for asset inheritance based on family structure and will documents,

[0858] A means of intuitively displaying procedural information to the user using visual information devices.

[0859] A system that includes this.

[0860] (Claim 2)

[0861] The system according to claim 1, which provides instructions regarding daily living support and health maintenance based on the user's physical attributes.

[0862] (Claim 3)

[0863] The system according to claim 1, which displays a list of materials to be presented to the user and assists in obtaining and organizing the necessary materials.

[0864] "Example 2 of combining an emotion engine"

[0865] (Claim 1)

[0866] A means of collecting user information and registering it in a database,

[0867] A means to detect the emotional state of users, acquire and analyze relevant information in real time,

[0868] A means of generating a schedule of necessary procedures based on registration information and emotional data, and making adjustments according to the user's mental state,

[0869] A means to notify the user of the start of the procedure and guide them through the details according to the generated schedule,

[0870] A system that includes means to help identify and obtain the necessary documents for a procedure online.

[0871] (Claim 2)

[0872] The system according to claim 1, which provides information on care services and health management, as well as mental support, based on the user's age and health condition.

[0873] (Claim 3)

[0874] The system according to claim 1, which displays a list of documents to be presented to the user, assists in obtaining and organizing the necessary documents, and provides further assistance in response to changes in the user's emotions.

[0875] "Application example 2 when combining with an emotional engine"

[0876] (Claim 1)

[0877] A means of registering the user's basic data and preferences in a database,

[0878] A means of adjusting the schedule of procedures using collected emotional data,

[0879] A means of providing mental support information according to the user's emotional state,

[0880] A means of notifying users of procedural details and psychological support via smart devices,

[0881] A system that includes means for identifying and assisting in the retrieval of electronically available documents.

[0882] (Claim 2)

[0883] The system according to claim 1, which provides relaxation methods and information on contacting specialists based on the user's emotional state.

[0884] (Claim 3)

[0885] The system according to claim 1, which provides counseling information tailored to the emotional state of the user in order to support the end-of-life planning procedures. [Explanation of Symbols]

[0886] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means of acquiring basic user information and storing it in a recording device, A means for generating a timeline of necessary tasks based on accumulated information, A means of notifying the user of the start of work and providing detailed instructions according to the generated timeline, A means of advising on identifying the materials needed for the work and obtaining them through digital means, A means of presenting a plan for asset inheritance based on family structure and will documents, A means of intuitively displaying procedural information to the user using visual information devices. A system that includes this.

2. The system according to claim 1, which provides instructions regarding daily living support and health maintenance based on the user's physical attributes.

3. The system according to claim 1, which displays a list of materials to be presented to the user and assists in obtaining and organizing the necessary materials.

Images